Discussion about this post

User's avatar
Carsten Bergenholtz's avatar

Excellent post, thank you. I think the selection effects that you present are important. I have two additional angles on (un)equalization that might be of interest and offer further support for being somewhat cautious of expecting the democratization effects found in a range of studies, to generalize to more messy, real-life situations.

One angle is related, just framed differently: 1) You rightly show that a bunch of studies have shown democratization effects - but these generally take departure in fairly well-defined problems. In our recent Academy of Management Learning & Education paper, we argue that the distinction between well-defined and ill-structured problems is likely relevant. In a well-defined problem LLMs are a) more likely to get answers right, and b) it is easier to identify if the answer is correct or not. In ill-structured problems, it is more likely that a user has to spend more effort on engaging with and iterating on the answer. 2) This links to the second angle and the equalization findings we find in our experiment: low-performers improve, while high-performers do not (actually decline) - thus, the effects are democratizing, but not in the way we one would hope. We use cognitive load theory to explain the mechanism (see https://journals.aom.org/doi/10.5465/amle.2025.0029): While low-performers know little and thus benefit from getting something - high-performers already know something and now get even more information (extraneous load), which can be metacognitively challenging.

Hence, I suspect that while one might see positive effects in well-designed, limited studies, the typical user is often in more messy situation, potentially getting a lot of information from LLMs, and then struggling to integrate this - in particular if the user already has relevant information.

Ready for more?