[chore] More AI blocking (#3273)
This commit is contained in:
parent
6ee540a503
commit
0e2ee857ac
|
@ -52,6 +52,7 @@ User-agent: GoogleOther
|
||||||
User-agent: GoogleOther-Image
|
User-agent: GoogleOther-Image
|
||||||
User-agent: GoogleOther-Video
|
User-agent: GoogleOther-Video
|
||||||
User-agent: GPTBot
|
User-agent: GPTBot
|
||||||
|
User-agent: iaskspider/2.0
|
||||||
User-agent: ICC-Crawler
|
User-agent: ICC-Crawler
|
||||||
User-agent: ImagesiftBot
|
User-agent: ImagesiftBot
|
||||||
User-agent: img2dataset
|
User-agent: img2dataset
|
||||||
|
|
Loading…
Reference in New Issue