Linux – CURL – saving multiple HTTP responses

curlhttplinux

I've learned that we can send multiple HTTP requests with CURL by doing this:

curl -I http://linuxbyexample.co.nr http://lne.blogdns.com/lbe

or this:

xargs curl -I < url-list.txt

How can we save the all responses we get – every one of them to a different file?

Best Answer

You can use the -o command line option to write the output to a file instead of stdout. You can use multiple -os e.g.

curl -I http://linuxbyexample.co.nr lbe.co.nr.txt http://lne.blogdns.com/lbe -o lne.txt

If you format you urls-list.txt like so

http://serverfault.com -o serverfault.com.txt
http://example.com -o example.com.txt

it should work as you want.