Defect #38201
closed
Fix robots.txt to disallow issue lists with a sort or query_id parameter in any position
Added by Felix Schäfer almost 2 years ago.
Updated almost 2 years ago.
Description
Currently the robots.txt file only disallows issue lists where the sort parameter is first in the list /issues?sort=, the sort parameter might not always be the first in the parameter list though, e.g. /issues?page=2&sort=.
Files
The attached patch improves the robots.txt file in a way similar than the line for the set_filter parameter for the parameters sort and query_id.
- Related to Defect #6734: robots.txt: disallow crawling issues list with a query string added
- Target version set to 4.2.10
Setting the target version to 4.2.10.
- Subject changed from Improve robots.txt to Improve robots.txt to disallow issue lists with a sort or query_id parameter in any position
- Category changed from Performance to SEO
- Status changed from New to Resolved
- Assignee set to Go MAEDA
Committed the fix. Thank you.
- Status changed from Resolved to Closed
- Tracker changed from Patch to Defect
- Subject changed from Improve robots.txt to disallow issue lists with a sort or query_id parameter in any position to Fix robots.txt to disallow issue lists with a sort or query_id parameter in any position
Also available in: Atom
PDF
Updated by 
Updated by