How can I prevent the offline browsing webspider to download my website content

[andy_ng]

Hi,

I am concerning how to prevent the offline browsing webspdier (e.g. Teleport) to download my website content for security purpose.

I have add below content in the .htaccess file but I have tried to use Teleport, it still can download my website content.

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro
RewriteRule /*$ http://www.mywebsite.com [L,R]

Is there any thing wrong setting in .htaccess file?

Please check and give advice.

Thanks and regards,

Andy

[ZakaqerE]

You cannot prevent offline browsing. Period. It is extremely easy for an offline browsing program to spoof a web browser and download whatever it pleases. Furthermore, browsers such as mozilla-firefox allow you to save content to your hard disk after it has been downloaded for viewing. Oh, and how does saving the information offline compromise security? They have already seen it after all.

[Zelmo]

If I understand you right, what you might be looking for is a properly set up robots.txt file (see this link for more info about robots).

[ZakaqerE]

xD That will only prevent robots that conform to the standard! :P