I do like the idea of supporting a logged-in only view mode, but we have not currently built that. I'll see if we can do that / talk about it with the team!
In general, if the content is publicly visible, then it will be possible for AI crawlers to get them if they ignore things we put in place. For example, we can try to block on the user agent and such -- but if the content is public, it's all advisory.
I imagine that Anthropic respects these things... but there's other, less scrupulous entities.
no subject
I do like the idea of supporting a logged-in only view mode, but we have not currently built that. I'll see if we can do that / talk about it with the team!
In general, if the content is publicly visible, then it will be possible for AI crawlers to get them if they ignore things we put in place. For example, we can try to block on the user agent and such -- but if the content is public, it's all advisory.
I imagine that Anthropic respects these things... but there's other, less scrupulous entities.