Robots.txt Installation


Robot.txt is what tells the spiders where they can and cannot go on your website; this is particularly effect when keeping the search engines out of your shopping carts area because you will find that the search engines will attempt to index many of the items you have in there. By keeping the crawlers out of these types of pages you will be able to save your bandwidth and use it in areas that will be far more beneficial to you.


Website Design Quote
Get in touch

Web programming, web design & support Ltd
1210 Parkview
Arlington Business Park
RG7 4TY Ltd
The Studio
47 Brooksby Road
RG31 6LZ

Tel: 0118 942 0101

Free website analysis

We analyse your website's SEO and tell you how we can increase your rankings and traffic.

Click here for more information.