Patch #38201
Improve robots.txt to disallow issue lists with a sort or query_id parameter in any position
Status: | Closed | Start date: | ||
---|---|---|---|---|
Priority: | Normal | Due date: | ||
Assignee: | % Done: | 0% | ||
Category: | SEO | |||
Target version: | 4.2.10 |
Description
Currently the robots.txt
file only disallows issue lists where the sort parameter is first in the list /issues?sort=
, the sort parameter might not always be the first in the parameter list though, e.g. /issues?page=2&sort=
.
Related issues
Associated revisions
Fix robots.txt to disallow issue lists with a sort or query_id parameter in any position, not just first (#38201).
Patch by Felix Schäfer.
History
#1
Updated by Felix Schäfer 14 days ago
- File 38201.patch
added
The attached patch improves the robots.txt
file in a way similar than the line for the set_filter
parameter for the parameters sort
and query_id
.
#2
Updated by Go MAEDA 14 days ago
- Related to Defect #6734: robots.txt: disallow crawling issues list with a query string added
#4
Updated by Go MAEDA 11 days ago
- Subject changed from Improve robots.txt to Improve robots.txt to disallow issue lists with a sort or query_id parameter in any position
- Category changed from Performance to SEO
- Status changed from New to Resolved
- Assignee set to Go MAEDA
Committed the fix. Thank you.