openai, google, microsoft and anthropic will honor one shared "no ai training" line in robots.txt. anthropic already does, openai "in the coming months", the other two next year. meta said it supports it, then didnt say it'd comply lol. my robots.txt is from a stackoverflow post