Today I was editing some video for Youtube and was looking for some free stock music. I ended up at a site I’ve seen many times before, DanoSongs.com, but haven’t really ended up using since finding a song involves going through a long list and playing them in an embedded player and then downloading the one you want. What I wanted to do was download every MP3 and put them in a folder that I have full of stock music and then when inside my video editing software I can preview it along with the rest. So here’s the command I used:
wget -r -l1 -H -t1 -nd -N -np -A.mp3 -erobots=off http://www.danosongs.com/
This is of course done with wget, a powerful command line utility for Linux. To tweak the command all you need to do is replace the URL with the page you’d like to scrape and then replace “mp3″ with whatever file you’d like to grab. So you could easily scrape a page for all .png files or .docx files if you wanted.