196

16489 readers

4086 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

founded 1 year ago

MODERATORS

318

rulebots.txt (lemmy.world)

submitted 2 months ago by GroupNebula563@lemmy.world to c/196@lemmy.blahaj.zone

33 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] itsnicodegallo@lemm.ee 8 points 2 months ago (5 children)

As annoying as this is, it's to prevent LLMs from training themselves using Reddit content, and that's probably the greater of the two evils.

[–] jbk@discuss.tchncs.de 32 points 2 months ago

I thought major LLMs ignored robots.txt

load more comments (4 replies)