Robots.txt Installation

 

Robot.txt is what tells the spiders where they can and cannot go on your website; this is particularly effect when keeping the search engines out of your shopping carts area because you will find that the search engines will attempt to index many of the items you have in there. By keeping the crawlers out of these types of pages you will be able to save your bandwidth and use it in areas that will be far more beneficial to you.

 

Website Design Quote
Get in touch

Web programming, web design & support

Artofdata.com Ltd
1210 Parkview
Arlington Business Park
Theale
Berkshire
RG7 4TY

Artofdata.com Ltd
The Studio
47 Brooksby Road
Reading
Berkshire
RG31 6LZ

Tel: 0118 942 0101

Free website analysis

We analyse your website's SEO and tell you how we can increase your rankings and traffic.

Click here for more information.