This topic has 2 voices, contains 1 reply, and was last updated by TB Support 2827 days ago.

Specific recommendations regarding the robots.txt file?

This topic has been marked as not a support question.

Dear ThemeBurn, Thanks for this support forum! I wonder if you guys have some specific recommendations regarding the robots.txt file? For example, a special configuration recommendations that optimize Google search result in the best way? For example, right now I can see following indexed pages: “Register one account”, “Cart” and other pages that are maybe not important to index. I´m using following text in my current robots.txt file: Disallow: /&limit Disallow: /&sort Disallow: /?route=checkout/ Disallow: /?route=account/ Disallow: /?route=product/search Disallow: /?route=affiliate/ I´m using Seo pack with Pretty System URLs activated and Seo Keyword function to everything. maybe the details from my robots.txt does not work correctly when I´m using Pretty System URLs? Best regards Thomas, Sweden This reply was modified 2835 days ago by OCstore.	OCstore
July 21, 2016 at 11:15 pm #49805
Hi, The first two patterns from the robots.txt you have posted will work as they are general. The last four won’t work with `Pretty System URLs` enabled as there is no `route` parameter in the url. You can use on of the freely available robots.txt generators to disable specific pages. Generally we allow everything in robots.txt as google is smart enough to decide when building indexes and distributing page weight. Regards, ThemeBurn team	TB Support
July 29, 2016 at 6:30 pm #49980

Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.