This is why I deleted my BlueSky the other day. If the question even has to be asked, then the platform is not safe
EDIT: I'm mostly worried about the Federal Nazis scraping our data. At this point I don't give a shit about Microsoft.
@Lydie " But in general, this robots.txt file gets respected by a lot of search engines,” "
AI scraping bots are not search engines, of course, and they routinely ignore robots.txt. No doubt Graber chose her words carefully.
@cratermoon ROBOTS is NOT generally respected even by certain search engines. But definitely not by AI scrapers.
@Lydie The distinction between search engine scraper and AI scraper is shrinking. The decline of the value of letting your site be scraped is an aspect of the current #enshittification rot economy.