Clickbait is one of the bigger problems on the net. I don’t want to pay for more of it.
I am much less opposed to being tracked than some people here. But the complete and unavoidable surveillance implied by such a scheme takes it a bit far.
Actually, given Lemmy’s usual knee-jerk reaction to tracking and commercialization, I can only assume that people aren’t thinking through this proposal.
But the article later does back it up
The CEO of Cloudflare did not assert that. I was surprised that he would claim such a thing, and that should have made me read more carefully. Elon Musk notwithstanding, neither incompetence nor conspiracy theorizing are common at that level, publicly anyway.
You can believe whatever you like, of course. Freedom of opinion is nothing if not the right to be wrong.
It would be a lot to write, if you had to say what something does not do rather than what it does.
I looked at what the Cloudflare CEO said again. To be fair to him, he is not actually backing you up. He’s saying that Google makes no difference between the AI overview and the other search results. That is true. The AI overview is a search feature. I’m not sure why someone would want their link listed in search but not appear much more prominently in the AI overview.
You look up what Googlebot does. No AI.
You want to know what crawlers do AI? Just search for “AI”, or “training”, or some such, or skim through. It’s not long. Google-Extended collects training data. Note that Google-Extended is explicitly not used to rank pages.
Did that help?
I’m not really sure what you are asking here. Did you notice that you can scroll down and see a list of their crawlers?
that is not how general news media has been talking about robots.txt.
Ahh, yes. I think there is a lesson there.
Ok. That quotes a tweet by Cloudflare’s CEO. IDK what his qualifications are, but his conflict of interest is obvious enough. Real quality journalism there.
ETA: I looked at what the Cloudflare CEO said again. To be fair to him, he is not actually claiming that Googlebot collects AI training data. He’s talking about the AI overview, which is a search feature. The data for search features is collected by Googlebot. I’m not sure why someone would want their link listed in search but not appear much more prominently in the AI overview.
Here’s Google technical documentation on its crawlers: https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
That’s very different from what I called false.
What you describe may happen, but probably not as much as you think. Much of that stuff is just not that valuable. Some personal, colloquial writing is necessary, but Google already pays Reddit. Other stuff is better obtained from torrents or shadow libraries like Anna’s Archive.
Googlebot if enabled won’t just list you for search, but will also scrape your contents for Google’s AI.
False.
What did he think a crawler is? Why was he surprised that not allowing companies to use his data lead to them not using his data? Looks like he has another surprise coming when he notices that search engines no longer index his blog.
You’re looking for drugs and suddenly there’s spiders everywhere. You’d think that only happens to junkies.
Actually, is it ever spiders or just always bugs? Anyway…
Aaaargh! They’re under my skin! [sound of skin being scratches bloody] Argh! AAAAARGH!
Is this the Region, this the Soil, the Clime,
Said then the lost Arch-Angel, this the seat
That we must change for Heav’n, this mournful gloom
For that celestial light?
[…]
Farewel happy Fields
Where Joy for ever dwells: Hail horrours, hail
Infernal world, and thou profoundest Hell
Receive thy new Possessor
Tarantulas aren’t supposed to smell, from what I read.
Customs officials found the shipment at Cologne Bonn airport in a package that had arrived from Vietnam, tipped off by a “noticeable smell” that didn’t resemble the expected aroma of the seven kilograms of the confectionery treats, Cologne customs office spokesman Jens Ahland said.
Anyone care to guess what that smell might have been?
He was arrested in September 2022 on allegations of bribing an executive related to the Tokyo Olympics in exchange for KADOKAWA receiving preferential sponsorship treatment.
He was later charged by prosecutors and stepped down as chairman of the company on October 4, 2022. He denies the charge. KADOKAWA’s current CEO, Takeshi Natsuno, confirmed as recently as March 2025 that Tsuguhiko is barred from meeting with him and is not involved in the company (Toyo Keizai). Despite Tsuguhiko’s lack of involvement with KADOKAWA, which is active in conventional and short anime while also “actively investing” in AI for production, his words underscore a growing trend.
From the article.
reason based robots
What’s that?
This is mandated by UK law. If you created a node so that UK users can bypass this, you would be doing something illegal. You’d probably get defederated.
The murder of political enemies by the Nazis is usually not considered part of the Holocaust.
The Nazis created concentration camps to detain people immediately after they assumed power. The death camps in which millions were gassed were its own thing within that system.
The detainment concentration camps were for leftists and democrats. Then also people from the margins of society. The so-called “work-shy”; meaning people who had for whatever reason troubles functioning. It would have included Hitler if he hadn’t succeeded with that politics grift. Gay people, of course. Jehovah’s Witnesses because they were conscientious objectors. Of course, people were tortured and maltreated in these camps, too. But how bad it was very much depended on the status of the prisoner.
The first Holocaust killings are usually said to be the hospital patients who were victims of the Aktion T4 in September 1939 when the war started. Disabled people who needed care were murdered to free up resources for the war effort. One method was locking them in an idling truck and suffocating them with exhaust fumes.
You mean like a nerd who reads too much?
This is closer to the idea: https://www.w3.org/TR/1999/WD-Micropayment-Markup-19990825/