Amazon will stop accepting new customers for Mechanical Turk (techcrunch.com)
105 points by bookofjoe 5 hours ago
CodesInChaos 3 hours ago
> In a snake-eating-its-own-tail irony, a 2023 analysis found that between 33% and 46% of workers on the platform were using large language models to complete their tasks,
I assume AI use by workers has risen to the point where it renders Mechanical Turk pointless.
skt5 an hour ago
This likely means those consuming the outputs of Mechanical Turk don't have a good way to measure the value (aka quality) of the outputs.
If they did - then they shouldn't care whether it's a human or a LLM. And if it's a LLM - then the cost will roughly correlate to the MIN(cost of the LLM, cost of a human) to do the task.
AndrewOMartin 20 minutes ago
I think the "state of the art" of measuring the quality of outputs was to send the same task to multiple "agents" and only accept answers if over a certain amount agree. With some human review and reputation scoring sprinkled on top. It was a while since I was in this field though
moralestapia 2 hours ago
Yeah, I was doing this kind of Artificial Artificial Artificial Intelligence back in 2012 to make some extra $$$. Glad they finally "patched" that hole ^^.
pc86 2 hours ago
You were using LLMs in 2012?
subarctic an hour ago
simlevesque 2 hours ago
pixel_popping 2 hours ago
moralestapia 2 hours ago
root-parent 2 hours ago
I can see a high value startup, that will provide Human Intelligence with real Humans, locked in the room, with no network, books, LLMs and monitored 24x7 with cameras.
HoldOnAMinute an hour ago
Please enjoy each task equally
mcmcmc 28 minutes ago
24/7 isolation with no stimulation outside of work? Wonder if the hallucination rate would be higher or lower
nullsmack 3 hours ago
I had no idea this was still around.
It helped me buy a Battlefield 2 "Special Forces" expansion pack back in the day.
Well, I could've bought it either way but buying it didn't impact my normal income because I did Mechanical Turk in my free time enough to get it.
obblekk 2 hours ago
Maybe the most unambiguous "ai will automate work" example I've seen yet.
Absolutely does not imply the workers are automated since they can now use the current models to do more complex tasks at the vast number of new AI training data startups.
Turk was simply not designed for greater complexity tasks and so much of their lunch has been eaten by startups specifically built to collect AI training data.
leohonexus an hour ago
Where do I find participants for my user studies then?
josefritzishere 4 hours ago
It's a shame. Mechanical Turk works better than any AI.
xandrius 3 hours ago
It's still AI, just a different type.
CodesInChaos 3 hours ago
The Actually Indian kind?
testuser1984 13 minutes ago
mghackerlady 3 hours ago
shshsjsj an hour ago
brokensegue 2 hours ago
personally, i've never had good luck with MT's quality.
baggachipz 3 hours ago
They moved all the Mechanical Turk workers over to robot and autotaxi piloting.
teddyh 2 hours ago
And monitoring of “cashier-free” grocery stores.