# robots.txt automaticaly generated by PrestaShop e-commerce open-source solution# http://www.prestashop.com - http://www.prestashop.com/forums# This file is to prevent the crawling and indexing of certain parts# of your site by web crawlers and spiders run by sites like Yahoo!# and Google. By telling these "robots" where not to go on your site,# you save bandwidth and server resources.# For more information about the robots.txt standard, see:# http://www.robotstxt.org/wc/robots.htmlUser-agent: *# Private pagesDisallow: /*orderby=Disallow: /*orderway=Disallow: /*tag=Disallow: /*id_currency=Disallow: /*search_query=Disallow: /*back=Disallow: /*n=Disallow: /*controller=addressesDisallow: /*controller=addressDisallow: /*controller=authenticationDisallow: /*controller=cartDisallow: /*controller=discountDisallow: /*controller=footerDisallow: /*controller=get-fileDisallow: /*controller=headerDisallow: /*controller=historyDisallow: /*controller=identityDisallow: /*controller=images.incDisallow: /*controller=initDisallow: /*controller=my-accountDisallow: /*controller=orderDisallow: /*controller=order-opcDisallow: /*controller=order-slipDisallow: /*controller=order-detailDisallow: /*controller=order-followDisallow: /*controller=order-returnDisallow: /*controller=order-confirmationDisallow: /*controller=paginationDisallow: /*controller=passwordDisallow: /*controller=pdf-invoiceDisallow: /*controller=pdf-order-returnDisallow: /*controller=pdf-order-slipDisallow: /*controller=product-sortDisallow: /*controller=searchDisallow: /*controller=statisticsDisallow: /*controller=attachmentDisallow: /*controller=guest-tracking# DirectoriesDisallow: /*classes/Disallow: /*config/Disallow: /*download/Disallow: /*mails/Disallow: /*modules/Disallow: /*translations/Disallow: /*tools/# FilesDisallow: /*ru/password-recoveryDisallow: /*ru/addressDisallow: /*ru/aдресаDisallow: /*ru/authenticationDisallow: /*ru/cartDisallow: /*ru/discountDisallow: /*ru/order-historyDisallow: /*ru/identityDisallow: /*ru/my-accountDisallow: /*ru/order-followDisallow: /*ru/order-slipDisallow: /*ru/orderDisallow: /*ru/searchDisallow: /*ru/quick-orderDisallow: /*ru/guest-tracking
Disallow:
Disallow: /*controller=header?
Если нет каких-то собственных классов, контроллеров, модулей, то в нем можно ничего не менять.
# SitemapHost: web-shopnet.comSitemap: http://web-shopnet.com/sitemap.xml
User-agent: *
Disallow: /*tag=
Disallow: /*n=
Все индивидуально, для одного сайта нужно ставить запреты на индексацию, для другого нет.