Find the answer to your Linux question:
Results 1 to 2 of 2
i want to programing (C on linux) web spider or web crawler for get data from website (same google).and idon't know how to start it....
  1. #1
    Just Joined!
    Join Date
    Jun 2007
    Posts
    84

    how to programing "web spider"

    i want to programing (C on linux) web spider or web crawler for get data from website (same google).and idon't know how to start it.

  2. #2
    Linux Engineer RobinVossen's Avatar
    Join Date
    Aug 2007
    Location
    The Netherlands
    Posts
    1,422
    Its really Easy.
    Download a Page.
    Make the program look for a <a></a> tags.
    And then make the Spider download that page and make it do the Same

    Cheers,
    Robin
    New Users, please read this..
    Google first, then ask..

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
...