Find the answer to your Linux question:
Results 1 to 3 of 3
Enjoy an ad free experience by logging in. Not a member yet? Register.
  1. #1

    Opensource crawlers

    hey guys!
    new to this forum.

    can anyone help me find a good opensource webcrawler.
    we are trying to inventory our site and its huge. and manual check is not an option.

    thanks a bunch


  2. #2
    Google "crawl website wget" => The wget command can be used for this.

  3. #3
    wow thanks!.. saved me alot of work

  4. $spacer_open

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts