Restrictions don't apply to current OpenAI models, but will affect future versions.
  • The Doctor@beehaw.orgEnglish
    1·
    2 years ago

    Very early on, at least, their spiders respected robots.txt.

    I know there are folks that have all of the Big G in their robots.txt files on principle, might want to ask them if it works or not.