Hi,
I want to build a local search engine on my computer,then use it to search various sites
(of course not the entire web,only a few specific domains like that of my university,etc).

I have tried Htdig but it works only for ones own website--as far as I can infer
so,please help me by giving valuable information.
Please also mention good easy to use webcrawling tools