I considered updating my robot.txt file today. It made me feel a certain kinda way— Iike I was in a Richard Matheson book.

Anyway, I signed up for buymeacoffee as a little experiment. I posted some thoughts on there about robots.txt files.

The post is free and open, and doesn't require login or anything like that. Feel free to check it out and let me know your thoughts. #robotstxt #webcrawler #ChatGPT #openai

https://www.buymeacoffee.com/fromjason/we-legend-some-thoughts-robots-txt