Find the answer to your Linux question:
Results 1 to 3 of 3
hey guys! new to this forum. can anyone help me find a good opensource webcrawler. we are trying to inventory our site and its huge. and manual check is not ...
  1. 11-19-2008 #1
    shahinm
    shahinm is offline
    Just Joined!
    Join Date
    Nov 2008
    Posts
    2

    Opensource crawlers

    hey guys!
    new to this forum.

    can anyone help me find a good opensource webcrawler.
    we are trying to inventory our site and its huge. and manual check is not an option.


    thanks a bunch

    Shahin
    Reply With Quote Reply With Quote
  2. 11-19-2008 #2
    HROAdmin26
    HROAdmin26 is offline
    Linux Guru
    Join Date
    Nov 2007
    Posts
    1,695
    Google "crawl website wget" => The wget command can be used for this.
    Reply With Quote Reply With Quote
  3. 11-19-2008 #3
    shahinm
    shahinm is offline
    Just Joined!
    Join Date
    Nov 2008
    Posts
    2
    wow thanks!.. saved me alot of work
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules