mirrors
/
gotosocial
mirror of
1
Fork 0
Code Issues Releases Activity
gotosocial/internal/api/wellknown
History
tobi baed591a1d
[feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737) 
* [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers

* use switch for RobotsHeaders
 		2025-02-05 12:47:13 +01:00
..
hostmeta [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737) 2025-02-05 12:47:13 +01:00
nodeinfo [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737) 2025-02-05 12:47:13 +01:00
webfinger [feature] Use `X-Robots-Tag` headers to instruct scrapers/crawlers (#3737) 2025-02-05 12:47:13 +01:00