Workers Report Limited Gains from Prompt-and-Pray AI

A survey of 6,000 workers by Glean's Work AI Institute, in collaboration with Stanford, UC Berkeley, and Harvard, found AI automation saved an average of 11 hours per week, but only 13% of respondents reported significant organizational performance gains. The study identified a top-performing 13% that achieved both productivity and quality improvements, while 53% of workers said critical information was not accessible through their AI systems.

Workers Report Limited Gains from Prompt-and-Pray AI Per a Forbes piece citing a study from Glean's Work AI Institute, a survey of 6,000 workers found AI automation saved an estimated 11 hours per week on average, yet only 13% of respondents say their organizations are performing significantly better as a result. The study, which was run in collaboration with researchers at Stanford University , UC Berkeley , and Harvard University , identifies a top-performing segment representing 13% of the sample that reports both productivity and quality gains. The study authors write, "High AI achievers don't just prompt and pray." The report also finds 53% of workers say critical information is not accessible through their AI systems, while workers in "context-rich" AI environments show large reductions in exhaustion and unexplained outputs, per Forbes. Editorial analysis: This reporting reinforces a recurring pattern where tool acquisition alone delivers limited organizational performance without changes to work design and data context. What happened Per a Forbes article citing a study from Glean's Work AI Institute , a survey of 6,000 workers found that AI automation saved respondents an average of 11 hours per week, while only 13% of workers reported their organizations were performing significantly better as a result. The Forbes piece notes the study was produced in collaboration with researchers at Stanford University , University of California at Berkeley , and Harvard University and includes the quote, "High AI achievers don't just prompt and pray," from the study's authors. Technical details The study separated respondents into a top-performing cohort and the rest, with the top performers comprising 13% of the sample and reporting both productivity and quality gains. Per Forbes' summary of the study, 53% of workers said critical information needed for their jobs was not accessible through their AI systems. The study reports that workers in what it calls "context-rich" AI organizations were 64% less likely to feel worn out by AI, 52% less likely to ship work they could not explain, spent 9% less time "botsitting," and 31% less time "botshitting," as summarized by Forbes. Editorial analysis: Companies and teams that focus first on work design , data access, and embedding context into AI flows tend to report the biggest operational improvements, according to longstanding adoption patterns seen across digital transformations. Observed patterns from prior technology waves show that buying more tooling without redesigning tasks or changing information flows commonly produces modest efficiency gains but few systemic performance improvements. Context and significance Industry context: The findings reported by Forbes and the Glean study align with recurring practitioner concerns that generative AI outputs are highly sensitive to data plumbing, context, and human oversight. For practitioners, this means measurable time savings at the individual level do not automatically translate into organizational gains unless models are integrated into processes that supply the right context and governance. What to watch Indicators an observer can track include changes in how organizations map work processes to AI capabilities, metrics that move beyond raw token usage for example, quality-by-task and explainability rates , and whether vendors begin offering integrated context pipelines rather than standalone prompt services. The Forbes article does not quote organizational leaders explaining rationale or rollout plans, and the study authors provide the analysis cited; the organizations surveyed have not been named in Forbes' reporting. Scoring Rationale The story compiles a sizable survey with actionable findings for practitioners about adoption pitfalls and the importance of context, making it a notable read for teams operationalizing AI. It is not a frontier-research or major product release, so the impact is solid but not transformational. Practice with real Ad Tech data 90 SQL & Python problems · 15 industry datasets Active Search Campaigns by BudgetEasy /problems/sql/active-search-campaigns-by-budget High CPC Clicks & Poor Landing PagesMedium /problems/sql/high-cpc-clicks-poor-landing-page Campaign ROAS by Attribution ModelHard /problems/sql/campaign-roas-by-attribution-model 250 free problems · No credit card See all Ad Tech problems /problems/datasets/adtech