Andy Reid to Technology@lemmy.worldEnglish • 1 year agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square92fedilinkarrow-up1964arrow-down114
arrow-up1950arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid to Technology@lemmy.worldEnglish • 1 year agomessage-square92fedilink
minus-square@Sorgan71@lemmy.worldlinkfedilinkEnglish-4•1 year agogood. robots.txt was always a bad idea
minus-square@Reddfugee42@lemmy.worldlinkfedilinkEnglish7•1 year agoLike so many terrible ideas, it worked flawlessly for generations
good. robots.txt was always a bad idea
Like so many terrible ideas, it worked flawlessly for generations