This will spider a website on a specific URL going down no more than 2 levels deep staying on the target URL end point:
wget -np -r -nH --cut-dirs=2 -U "Mozilla/5.0 (Windows NT 5.1; rv:10.0.2)" -l 0 -p http://docstore.mik.ua/orelly/unix2.1/sedawk/
Change the URL to whatever you want
No comments:
Post a Comment