cgit got disabled. Send your thanks to the AI bots.
Links:
- https://techcrunch.com/2025/03/27/open-source-devs-are-fighting-ai-crawlers-with-cleverness-and-vengeance/
- https://xeiaso.net/notes/2025/amazon-crawler/
and many more.
Thanks Amazon, Google, OpenAI, and the thousands of Chinese crawlers hiding behind arbitrary UAs.