I really don't understand this take. If you're a carpentry shop that just bought power tools for the first time and you're worried that your employees are sticking with hand tools because that's what they know, then you look for sawdust.
The goal isn't to have people work at converting wood into sawdust, the point is that if you wanna see if the tools are working you wanna see proof they're actually being used.
I'm sure there were some people cargo-culting this stuff, but suggesting that the people who run FAANG don't understand the dangers of bad metrics is... interesting.
Why would a carpentry shop buy hundreds of thousands of dollars of power tools without consulting with their employees to see what they actually need to get their job done more effectively? The logic of buying the tools then forcing the employees to use them "or else" is completely backwards in any sane world.
(Of course, we've all had bosses that went to some marketing seminar and come back having been tricked^Wsold into buying some wizz-bang widget that we need to now integrate because of a sunk-cost fallacy, but I thought everyone was on the same page that this is not how normal procurement was supposed to work.)
> the point is that if you wanna see if the tools are working you wanna see proof they're actually being used.
That is way too charitable, people were being fired based on these metrics and people were absolutely talking about token burn as being a metric for productivity (do I really need to link the Jensen Huang quote?). That isn't an indication of this hysteria being based on "just trying to see if the tools work".
If you want to see if the tools work, why don't you just ask your employees? Like any normal employer would?
>If you want to see if the tools work, why don't you just ask your employees? Like any normal employer would?
I run a small business with two employees.
N=2 here, of course, but one of them will experiment with any new process you introduce (as well as plenty more that you don't!)
The other will keep doing what he's always been doing, even if it's frustrating and inefficient, unless you monitor him and force him to use the new process.
I could imagine most "normal employers" would understand that both type of person exists and, assuming you're getting good first impressions from group A, it's usually better off in the long run to shove the new process down group B's throat.
(This isn't to say that the "Group B" employee is less valuable or anything - he is more conscientious and reliable than anyone else we've ever hired - but just that different people need different management styles)
> If you want to see if the tools work, why don't you just ask your employees? Like any normal employer would?
because that would require actually admitting that employees are the people in an organisation who are responsible for the success of that organisation, rather than the people higher up the org chart.
And here we are. AI use mandates are a humiliation ritual, at least how I've seen them. Because it's not just a matter of making the employees use AI; public criticism or speaking about the drawbacks are also punished. It's get totally on board or get out; if you're not completely gung ho, despite the testimony of your lying eyes, maybe you don't have what it takes to work here, son. It's something they use as a shit test, just like the North Korean dogma that Kim Jong-il scored a perfect 18 holes-in-one every time he stepped on the course: are you willing to compromise your values, to the point of mouthing naked untruths, in total submission to the company's leadership?
Do you actually have a job? Do you talk to your coworkers?
This is an insane take. Plenty of people are critical of AI at my job despite a big push to use it. I find the comparison to NK distasteful, coming from someone who presumably is pretty well paid and can quit their job whenever they want.
If you're feeling humiliated... well, I don't think it's because your boss wants you to try AI.
> The logic of buying the tools then forcing the employees to use them "or else" is completely backwards in any sane world
People are stubborn. A lot of productivity improvements had to be almost forced upon farmers, for example. Even when early adopters demonstrated the benefits, a decent fraction of them just didn’t want to change.
> Why would a carpentry shop buy hundreds of thousands of dollars of power tools without consulting with their employees to see what they actually need to get their job done more effectively?
Are you suggesting that changes to new production technologies are always driven bottom up by line workers? I'm guessing that historically that's rare.
Because people don't know what they want until they have and use it. Faster horses, etc. One can only really implement systemic change from the top down, as Moloch indicates.
> Why would a carpentry shop buy hundreds of thousands of dollars of power tools without consulting with their employees to see what they actually need to get their job done more effectively? The logic of buying the tools then forcing the employees to use them "or else" is completely backwards in any sane world.
For one, software tools are cheap, especially with OSS in the mix. You're buying one "tool" and paying for operational expenses that scale with total usage across all company.
But secondly, and more importantly, the "consulting" and discussing was done over the period of last 3 years, by ~1 year ago the high-level conclusions were pretty much locked in, the worthiness of the adoption was blindingly obvious at that point, so I can see why tokenmaxxing would be where this ended up, even though (here I disagree with the article a bit) the tools aren't at the "compounding correctness" stage just yet. It's really quite simple: the stick didn't work (telling people in increasingly direct ways to try using AI for stuff), so they tried the carrot.
$deity knows a good chunk of engineers will inadvertently fall for any trick that involves a scoreboard. That holds even when they're perfectly aware they're being tricked.
> If you want to see if the tools work, why don't you just ask your employees? Like any normal employer would?
Again, they did that, they've been doing it continuously over past 3 years. Some people are excited, some people don't care, but some - a population that's definitely overrepresented in HN comments - just stubbornly refuse to try. Now that the answers are in, and they speak in favor of AI, the companies are doing what "any normal employer would": trying to get the stubborn employers to do their job they way their bosses want them to.
(In fact, normal employers would be more eager to fire people who keep refusing top-down instructions - but it's also obvious this technology is experimental; the models and harnesses get more powerful faster than people can learn to use them - so carrots make more sense than sticks in this transition period. Stubborn people begrudgingly using those tools offer an entirely unique perspective and explore use cases and approaches that you won't get from excited adopters.)
> Why would a carpentry shop buy hundreds of thousands of dollars of power tools without consulting with their employees to see what they actually need to get their job done more effectively?
I mean, the difference in the metaphor is that we have pretty fully understood carpentry for many hundreds of years. We still find it difficult to write even simple software to address all our needs, as is evidenced by the insane pay in our industry. Carpenters can suggest tools because they know what's out there. The same was not true about LLMs a year ago.
> That is way too charitable, people were being fired based on these metrics
People get fired for all kinds of reasons including no reason at all. Oftentimes leadership even lies about the real reasons for firing people because they don't sound good!
I'm gonna be blunt: if you're in software and you refuse to use AI for moral reasons, I think you should be fired. There's being principled and there's being obstinate and the difference between the two is how well you can convince people that you _have_ principles. Most LLM-hating people fall short on this point, because
> do I really need to link the Jensen Huang quote?
Sure! Link it again, we all know it's highly immoral when shovel salesmen try to make you want shovels.
> If you want to see if the tools work, why don't you just ask your employees? Like any normal employer would?
I do not like this HN take of "let's do this thing that works great in small companies and then just blindly pretend that it'll also work at the largest companies in the world!" No, this doesn't work at "normal companies" because you cannot "just ask" 30k+ employees what they want.
Employees, like EVERYONE ELSE, are resistant to change. If I, as CEO of a company, want to get my company to try Claude I have to measure tokens to see if it's getting used. That's it. There's no wave of delusion here.
Because Japanese hand tools are objectively less efficient than power tools in a carpentry shop. The guys that want to use hand tools can go work in a boutique that charges a premium for that level of craftsmanship. If you told them to use power tools, no amount of utility would convince them to use them, with most of their justification being psychological. Also, "It is difficult to get a man to understand something, when his salary depends on his not understanding it."
Because those power tools had just been invented and no one had experience with them.
Though in theory power tools are faster than hand tools.
So do a workshop on power tools, measure their efficacy and the quality of the result, do some demonstration videos on power tools, get people to compare, seek feedback on their usage. Don't count electricity and sawdust, or you'll find people getting very good at expensively turning blocks of wood into sawdust.
The logic of trusting employees who are worried that power tools will replace them to utilize power tools effectively is completely backwards in any sane world. People don’t like change, sometimes it needs to be forced on them.
Doubt. People brought in all kinds of web applications in the early Web 2.0 era because corporate IT was being too stingy (for a lot of reasons). People will find efficiencies on their job on their own. No need to denigrate them.
I don’t know, at my company at least tons of devs were holding out on ai usage until the token maxing stuff really started. It was beyond clear by that point that coding agents were a productivity multiplier.
A lot of people believe that. Not a lot of evidence on the table for it (it’s not agent developers’ fault; empirical studies are expensive and rarely live up to scrutiny). Not sure it’s worth forcing people unless you like malicious compliance.
Well here’s where you can level valid complaints against management I think. “Move fast and break things” doesn’t line up super well with “wait for empirical studies to back up your suspicions”
For sure. Just because the studies are incomplete or difficult doesn’t mean they’re useless. We still do unit testing and type systems continue to get more sophisticated and spread further because we believe they have an effect on quality and productivity regardless of the lack of evidence.
However it takes some taste in engineering and perhaps some mathematical sophistication to figure these things out. “Just use AI,” is not a very convincing argument either.
It’ll take time to sort out, I wager.
“Beyond clear” I wouldn’t say that confidently. Even now I’m not sure I agree with that, especially looking at it long term.
Yeah but if you can't attack the workers and make them hate their lives, are you even a good capitalist? Didn't Milton Friedman die for our bosses right to stomp on our faces in the pursuit of profit?
> who are worried that power tools will replace them
maybe, just maybe, it would have been a better idea to engage with employees first rather than posting on linkedin about how everyone is going to lose their jobs.
cos it's the kinds of people trying to force this stuff on employees that are the ones who have been shouting about that from the rooftops.
If you take LinkedIn at face value everyone who uses the Internet is a sociopath who lives for no purpose beyond maximizing shareholder value.
Seriously, some of the most deranged things I've ever read were by relatively normal people trying to promote themselves on LinkedIn.
What people SAY does not matter nearly as much as what everyone KNOWS and it's pretty damn clear that AI is never going to be able to replace humans in complex domains. Every time a frontier lab announces a breakthrough it's pretty obvious that the setup was more complicated than "hey chat prove the Riemann hypothesis."
The world is gonna need skilled human beings to drive LLMs, no matter how desperately some people like to pretend otherwise.
The level of trust in leadership is remarkable. There’s reasonable ways to have people try power tools. Have one team use power tools and another hand tools and see the outcome.
The mandate was literally “the more sawdust you create the more money you’ll make”. Nothing of value is learned by that mandate. Sure it’ll make people use power tools but it won’t cause anyone to learn how to use them to make furniture.
They might understand the danger of bad metric but that doesn’t mean they aren’t victims of them. If there was intentionality here it was lazy as hell at best.
> suggesting that the people who run FAANG don't understand the dangers of bad metrics is... interesting.
from my time in FAANG... that seems about correct. Probably the people at the absolute top don't want to just pointlessly burn tokens, but pass that down the chain and eventually the rumor mill turns that into "tokens are an input for your performance review" and people start running Wiggum loops to fix minor typos or linters or something—especially if you do it at a time when every company seems to be doing layoffs.
Bad managers, in general, grab a metric and then unthinkingly optimize it. I’ve never worked for FAANG, but I’d be surprised if they didn’t have bad managers too.
Looking for sawdust is a far cry from having a leaderboard of who turned the most wood and electricity into dumpsters full of sawdust
> If you're a carpentry shop that just bought power tools for the first time and you're worried that your employees are sticking with hand tools because that's what they know, then you look for sawdust.
Or count the fingers, I guess. It's all fun and games until someone looses AI.
> the people who run FAANG don't understand the dangers of bad metrics is... interesting
They don't. They want some metric to support what they want to do and don't care about good metrics at all.
I've spent the vast majority of my career in FAANGs and it's been the pattern everywhere.
Right now my org has a senior director who is constantly battering managers to tell their reports to fill out the weekly surveys.
Why are the employees not filling out the surveys? Because instead of the old once a year large survey with questions about various levels (including local teams where management cared about the numbers and I could see the actions they took) we now get a survey every week with questions that are meaningless and I have no answer for.
"How does team X deliver on its priorities"?
Team X has O(10K) peoples and a barely countable infinity of projects. Most of which I don't know about and most of which I'm not supposed to know about since things are compartmentalized. So I don't know what team X's priorities are, I don't know how they deliver on them, and I never will know. Asking me and my colleagues is a waste of time and money.
...but none of that matters because the directors want "data" and they want a dashboard showing that we're all giving them "data".
The switch away from hand to power tools was a while ago but not, like, ancient history. In the era with fairly widespread literacy and records. Did this sort of check for sawdust thing actually happen?
> but suggesting that the people who run FAANG don't understand the dangers of bad metrics is... interesting
You're far too charitable. Understanding has nothing to do with it. Big companies are too far insulated from bad metrics. Middle managers get away with anything and everything because their decisions are too far removed from reality. And they're nowhere to be seen when the other shoe drops. And they'll just leave to a promotion elsewhere if they stay and results are bad.
Everything is far removed from reality in bigco. So you get a bunch of theater and house-playing with "data-driven" posters up on the wall. It's a show that everyone is aware of and seemingly we all still attend.
I worked at FAANG. If anything, people are not nearly skeptical enough about how dumb it is with all this going on.
People are (in this analogy) building sawdust farms there.
[dead]