In the workplace, research is starting to tease out how, and for whom, strategic use of LLMs could boost cognitive outcomes such as creativity. Lu, of MIT, and his colleagues studied 250 employees of a technology consulting firm in China who were randomly assigned to either receive access to ChatGPT or work without it for one week at a time when ChatGPT was not yet publicly available in China. Separately, employees completed surveys assessing their metacognitive skills, which involve actively monitoring and regulating one’s thinking to complete tasks and achieve goals.
Work done by employees with access to ChatGPT was rated as being more creative by supervisors and external reviewers, particularly when those employees also scored high on metacognitive skills. These employees appeared better able to use AI to generate ideas, switch between perspectives, and retrieve useful information (Journal of Applied Psychology, Vol. 110, No. 12, 2025opens in new window).
“Our findings suggest that employees higher in metacognition are more likely to use generative AI deliberately rather than passively,” said Lu, adding that these nuances can help companies consider when and how humans and AI may collaborate to optimize results.
Research is also exploring whether using AI affects specialized job skills, including experts’ ability to analyze medical images, legal documents, and financial transactions once AI assistance is taken away.
In Poland, researchers in a natural experiment—a real-world study that observes changes already occurring—measured how well physicians could detect polyps on colonoscopies without AI assistance both before and after AI tools were added to their workflow. The polyp-detection rate without AI assistance fell 6 percentage points, from 28.4% to 22.4%, in the 3 months after the AI system was introduced (Budzyń, K., et al., The Lancet Gastroenterology & Hepatology, Vol. 10, No. 10, 2025opens in new window).
With funding from the National Science Foundation, Macnamara is further investigating skill decay in medical settings. Focusing on AI-assisted radiology and laparoscopic (minimally invasive) surgery, she is exploring three questions: When a skill has already been learned, does using an AI assistant lead to skill decay? If clinicians train with AI, do they learn the skill as deeply as those who train without it? And finally, does using AI make clinicians overconfident in their abilities?
These studies point to a new challenge for organizations—not just whether to adopt AI but how to use it strategically alongside human strengths, Lu said. Part of the answer involves deciding which tasks to offload. Cukurova suggests performing a “task analysis” for each employee, separating tasks that simply need to be completed (such as drafting routine legal memos) from those that involve essential learning (such as analyzing case law to build a legal argument). Psychologists and learning scientists can help guide these decisions by identifying the cognitive processes involved.
An employee’s prior knowledge and experience also matter. Experts are generally better equipped to critically evaluate AI outputs, whereas novices may struggle to do so. For example, an experienced lawyer using AI to find novel outputs can better spot flawed reasoning than a first-year law student can, Farahany said. Like an intern, AI can support work, but it cannot replace the judgment needed to catch mistakes, edit weak ideas, or recognize when something has gone wrong. In practice, however, organizations may not always know which employees have enough experience to use AI independently and which still need to build foundational skills.
“The problem is that it’s not always easy for employers to distinguish between novice workers and experienced ones,” Cukurova said.
Without clear guidance, employees with high workloads and those who fear losing their jobs may also turn to AI for support or to gain a competitive advantage, said Mindy Shoss, PhD, a professor of psychology at the University of Central Florida who studies AI use through an industrial and organizational lens. Organizations tend to be most successful when they set clear norms and guardrails for AI use, she said.
“When incentives are vague, you can end up with a chaotic situation where people are sending AI-generated content back and forth, but no one is quite sure how it’s being used or evaluated,” Shoss said, describing what some have called “AI slop.”