Disclaimer: I don’t have a background in computer science
I recently heard about a lightweight opensource software called Anubis.
Anubis is designed to stop AI crawlers that download a lot of data to train artificial intelligence models
Several websites have deployed Anubis:
https://gitlab.gnome.org/GNOME
My question is extremely simple.
If this software is so damn great, why isn’t it everywhere?
Seriously. Why isn’t it used on Lemmy? On Wikipedia? On CBC?
seems like some crawlers already know how to bypass it: https://social.anoxinon.de/@Codeberg/115033782514845941
Yeah. It’s an arms race. Any technological defense will be countered eventually. In the long run, I’m not sure a technical defense like this will be sufficient - we’ll need legal defenses that are enforced.