Sometime, cURL is a useful tools. And useful to download data from the web.
And scripting to download data. It support major protocol, like ftp, http, https. It is useful for testing, stuff too.
I am working on a pet project, involve twitter, I am try to see how it look like so i download a twitter feed using cURL. And it is really easy. Thanks to the twitter REST interface.
curl –basic –user $username:$password http://twitter.com/statuses/user_timeline.json
All in one line, This is for json, if want xml, the replace json with xml. You might want to save it to a file. You can just redirect to a file. Just replace anything start with the $ with the appropriate value.
curl –basic –user $username:$password http://twitter.com/statuses/user_timeline.json > $filename