Bot and AI crawler control
ВыпущеноWeb· v0.3.29· 17 нояб. 2026 г.
Per-website rate limits and block lists for crawlers, including AI bots, with a report of who is crawling what.
Per-website rate limits and block lists for crawlers, including AI bots, with a report of who is crawling what.