I mean, all the research (to be fair there's very little) suggests that in CS (customer support) the major gains are for people who are worse than others, and there was little to no impact for the higher skilled cs people.

And that's kinda what one would expect, given that LLMs are basically a blurry JPEG of the web/github etc.

Like, I think reasoning can help here, but I rarely see good results when prompting an LLM with something complicated (technical statistical problems and good approaches) while they are fantastic at less edge case stuff (working with docker and well known frameworks).

So yeah, definite productivity gains but I'm not convinced that they're as transformational as they are being pitched.

That's clearly why the VCs are now pushing 996 and everyone has to work twice as hard. Lol