curl命令总结

た入场券 2022-06-17 06:59 696阅读 0赞

在开发客户端的时候，需要对请求的正确性以及返回数据格式进行验证，每次调试都去发送请求过于麻烦。于是，我找到了一个方便偷懒的工具——curl。curl是一个向服务器传输数据的工具，支持http、https、ftp、ftps、scp、sftp、tftp、telnet等协议。以下总结了一些针对http的常用方法：

**命令使用如下：**

**一、查看网页源代码**

1、直接在curl命令后加上网址，就可以看到网页源码。我们以网址www.baidu.com为例

curl www.baidu.com

2、如果要把这个网页保存下来，可以使用-o参数，这就相当于使用wget命令了。

curl -o [文件名] http://www.baidu.com
    或者
    curl  http://www.baidu.com > [文件名]
    eg:curl -o /home/baidu.html http://www.baidu.com
       curl http://www.baidu.com > /home/baidu.html

**二、发送请求**

**1、GET请求**

默认直接请求一个url就是发出一个get请求，参数的话直接拼接在url里就好了，如

curl http://www.baidu.com/s?wd=curl

上述请求会上百度发起一条查询请求，参数是wd=curl

**2、POST请求**

普通post请求：

curl -d "name=test&page=1" http://www.baidu.com
    -d 参数指定表单以POST的形式执行。

通过脚本发送post请求，顺便附带文本数据，比如通过"浏览"选择本地的card.txt并上传发送post请求

curl  -F "blob=@card.txt;type=text/plain"  "http://172.16.102.208:8089/wiapi/score?leaderboard_id=7778a8143f111272&score=40&app_key=8d49f16fe034b98b&_test_user=test01"

注意：其中-F 为带文件的形式发送post请求，blob为文本框中的name元素对应的属性值。<type="text" name="blob">

**三、HTTP方法**

curl默认的HTTP方法是GET，使用-X参数可以支持其他动词。

curl -X POST www.example.com
    curl -X DELETE www.example.com

**四、自动跳转**

有的网址是自动跳转的。使用-L参数，curl就会跳转到新的网址。

curl -L http://item.taobao.com/item.htm?id=25823396605

键入上面的命令，结果就自动跳转为http://detail.tmall.com/item.htm?id=25823396605

**五、显示头信息**

\-i 参数可以显示http response的头信息，连同网页代码一起。(-I参数则是只显示http response的头信息)

curl -i http://www.baidu.com
    curl -I http://www.baidu.com

**六、显示通信过程**

\-v参数可以显示一次http通信的整个过程，包括端口连接和http request头信息

curl -v www.baidu.com
    
    * About to connect() to www.baidu.com port 80
    *   Trying 115.239.210.26... connected
    * Connected to www.baidu.com (115.239.210.26) port 80
    > GET / HTTP/1.1
    > User-Agent: curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
    > Host: www.baidu.com
    > Accept: */*
    >
    < HTTP/1.1 200 OK
    < Date: Fri, 28 Feb 2014 05:42:37 GMT
    < Content-Type: text/html
    < Transfer-Encoding: chunked
    < Connection: Keep-Alive
    < Vary: Accept-Encoding
    < Set-Cookie: BAIDUID=442AD49501EF253AE71F2BAF3E0181FB:FG=1; expires=Thu, 31-Dec-37 23:55:55 GMT; max-age=2147483647; path=/; domain=.baidu.com
    < Set-Cookie: BDSVRTM=0; path=/
    < Set-Cookie: H_PS_PSSID=5228_1461_5187_5138_5225_5379_5368_4261_4760_5401_5286; path=/; domain=.baidu.com
    < P3P: CP=" OTI DSP COR IVA OUR IND COM "
    < Expires: Fri, 28 Feb 2014 05:41:43 GMT
    < Cache-Control: private
    < Server: BWS/1.1
    < BDPAGETYPE: 1
    < BDQID: 0x906950d16fb1e95d
    < BDUSERID: 0
      % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                     Dload  Upload   Total   Spent    Left  Spee<!DOCTYPE html><html><head><meta http-equiv="content-type" content="text/html;charset=utf-8"><meta http-equiv
    ="X-UA-Compatible" content="IE=Edge">

如果你觉得上面的信息还不够，那么下面的命令可以查看更详细的通信过程。

curl --trace output.txt www.baidu.com

或者

curl --trace-ascii output.txt www.baidu.com

运行后，请打开output.txt文件查看。

当然也有更狠的，查看页面跳转过程：

curl -L -I --trace log http://item.taobao.com/item.htm?id=25823396605

HTTP/1.1 301 Moved Permanently
    Server: Tengine
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html;charset=GBK
    Content-Length: 0
    Connection: close
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Content-Language: zh-CN
    Accept-Ranges: bytes
    X-Varnish: 1206961665
    Via: 1.1 varnish
    location: http://detail.tmall.com/item.htm?id=25823396605&
    X-Cache: MISS
    Cache-Control: max-age=3
    
    HTTP/1.1 302 Found
    Server: Tengine
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: keep-alive
    at_bucketid: sbucket_-1
    X-Bucket-Id: -1
    Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1
    Cache-Control:
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    Set-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Location: http://pass.tmall.com/add?_tb_token_=ktbzEwzFR6qy&cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9&t=d768c73859b40e10ef81f7abd0824704&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d1&pacc=A_12nKe89qHIcAyauBtovg==&opi=110.75.118.230&tmsc=1393568161483632
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Set-Cookie: _tb_token_=ktbzEwzFR6qy;domain=.tmall.com;Path=/
    Set-Cookie: cookie2=6c6bc65b9e9a5159cff5b3d0cae4dfd9;domain=.tmall.com;Path=/
    Set-Cookie: t=d768c73859b40e10ef81f7abd0824704;domain=.tmall.com;Path=/
    Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=1
    
    HTTP/1.1 302 Found
    Server: Tengine
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: keep-alive
    at_bucketid: sbucket_-1
    X-Bucket-Id: -1
    Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2
    Cache-Control:
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    Set-Cookie: _tb_token_=GgU93fEjKGT4;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Location: http://pass.tmall.com/add?_tb_token_=GgU93fEjKGT4&cookie2=ef3c440d74ff391de6b560da4ef8a5c9&t=187a71d8df58caac2c4e08d40245c31f&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d2&pacc=Vo8f-VlYEYPJ6WE3iTX96Q==&opi=110.75.118.230&tmsc=1393568161501736
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Set-Cookie: _tb_token_=GgU93fEjKGT4;domain=.tmall.com;Path=/
    Set-Cookie: cookie2=ef3c440d74ff391de6b560da4ef8a5c9;domain=.tmall.com;Path=/
    Set-Cookie: t=187a71d8df58caac2c4e08d40245c31f;domain=.tmall.com;Path=/
    Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=2
    
    HTTP/1.1 302 Found
    Server: Tengine
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: keep-alive
    at_bucketid: sbucket_-1
    X-Bucket-Id: -1
    Location: http://jump.taobao.com/jump?target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3
    Cache-Control:
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    Set-Cookie: _tb_token_=Uta86PoG6cWC;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.taobao.com;Path=/;HttpOnly
    Set-Cookie: t=618388c77aff03aec08309747a82f440;domain=.taobao.com;Expires=Thu, 29-May-2014 06:16:01 GMT;Path=/
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Location: http://pass.tmall.com/add?_tb_token_=Uta86PoG6cWC&cookie2=cd06dba05f2bf1124200861d0b8a151b&t=618388c77aff03aec08309747a82f440&target=http%3a%2f%2fdetail.tmall.com%2fitem.htm%3fid%3d25823396605%26%26tbpm%3d3&pacc=RptvnJCXDG4WtvFa0JIqoQ==&opi=110.75.118.230&tmsc=1393568161510003
    
    HTTP/1.1 302 Found
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html
    Content-Length: 260
    Connection: close
    P3P: CP='CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR'
    Set-Cookie: _tb_token_=Uta86PoG6cWC;domain=.tmall.com;Path=/
    Set-Cookie: cookie2=cd06dba05f2bf1124200861d0b8a151b;domain=.tmall.com;Path=/
    Set-Cookie: t=618388c77aff03aec08309747a82f440;domain=.tmall.com;Path=/
    Location: http://detail.tmall.com/item.htm?id=25823396605&&tbpm=3
    
    HTTP/1.1 200 OK
    Server: Tengine
    Date: Fri, 28 Feb 2014 06:16:01 GMT
    Content-Type: text/html;charset=GBK
    Connection: keep-alive
    Vary: Accept-Encoding
    at_bucketid: sbucket_-1
    X-Bucket-Id: -1
    Cache-Control: max-age=1
    At_Autype: 4_103979994
    At_Cat: item_50018599
    X-Category: /cat/50008090
    At_Nick: %E8%B6%8A%E5%BA%A6%E6%95%B0%E7%A0%81%E4%B8%93%E8%90%A5%E5%BA%97
    At_Itemid: 25823396605
    At_Isb: 1
    At_Pgty: 2
    At_Cat: 50018599
    At_Brid: 272676782
    At_Prid: 221236332
    At_Autype: 0_103979994
    At_Auid: 25823396605
    Content-Language: zh-CN
    X-Cache: MISS TCP_MISS dirn:-2:-2
    Via: wagbridge010207087016.cm3:8888

**七、Referer字段**

有时你需要在http request头信息中，提供一个referer字段，表示你是从哪里跳转过来的:

curl --referer http://www.baidu.com http://www.baidu.com

**八、User Agent字段**

这个字段是用来表示客户端的设备信息。服务器有时会根据这个字段，针对不同设备，返回不同格式的网页，比如手机版和桌面版。 iPhone4的User Agent是: “Mozilla/5.0 (iPhone; U; CPU iPhone OS 4\_0 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8A293 Safari/6531.22.7”。curl可以这样模拟：

curl --user-agent "\[User Agent\]" \[URL\]

**九、cookie 使用**

\--cookie参数，可以让curl发送cookie。

curl --cookie "name=xxx" www.baidu.com

至于具体的cookie的值，可以从http response头信息的Set-Cookie字段中得到。也可以例如：

curl -c ./cookie.txt http://www.baidu.com

**十、增加头信息**

有时需要在http request之中，自行增加一个头信息。--header参数就可以起到这个作用。

curl --header "xxx: xxxxxx" http://baidu.com

**十一、HTTP认证**

有些网域需要HTTP认证，这时curl需要用到--user参数：

curl --user name:password baidu.com