tobi baed591a1d [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737) ... * [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers * use switch for RobotsHeaders		2025-02-05 12:47:13 +01:00
..
robots.go	[feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737)	2025-02-05 12:47:13 +01:00