Kim Mills: Over the past several years, generative AI has moved into the classroom at lightning speed. Students are using AI to brainstorm ideas, write papers, solve math problems, and study for exams. Teachers are experimenting with it to create lesson plans and develop assignments. Meanwhile, schools and universities are trying to adapt to a technology that is evolving faster than many policies and teaching practices can keep up.
Today, we’re going to talk to two experts who are helping educators navigate these changes, using the science of learning to help answer questions about how AI can support and not hinder student learning. So how are students using AI in their work right now? What counts as cheating in the age of AI? What kinds of assignments, projects, and exams can teachers use to make sure that their students are really learning, not just copying AI-generated answers? What are the potential benefits of AI in education? And how should colleges and universities think about educating an AI-literate workforce in the future?
Welcome to Speaking of Psychology, the flagship podcast of the American Psychological Association that examines the links between psychological science and everyday life. I’m Kim Mills.
I have two guests today. First is Dr. Eddie Watson, vice president for digital innovation at the American Association of Colleges and Universities, and founding director of the association’s Institute on AI, Pedagogy and the Curriculum. His work aims to help colleges move beyond fear or hype toward a thoughtful evidence-informed integration of AI into teaching and learning. He is focused on how institutions can respond to AI’s challenges for academic integrity, student learning, curriculum design, and workforce preparation. He’s the author of the book, Teaching With AI: A Practical Guide to a New Era of Human Learning, and was recently recognized by EdTech Magazine as one of the top 25 higher education influencers to follow in 2026.
My second guest is Dr. Beth Schwartz, senior director of teaching and learning at APA. She leads the association’s efforts to advance evidence-based teaching and learning across educational settings. Before joining APA, Dr. Schwartz spent decades working in higher education as a psychology professor, university dean, and provost. She’s a fellow of APA’s Division 2, the Society for the Teaching of Psychology, and she’s leading APA’s efforts to provide educators with practical evidence-informed strategies on how to use AI in their classrooms, guided by psychological research on how students learn. Dr. Schwartz, Dr. Watson, thank you for joining me today.
Edward Watson, PhD: Thanks for having us.
Beth Schwartz, PhD: Yes, great to be here.
Mills: Let’s start by talking about how common AI use is in the classroom is right now, at the K through 12 and university level. I mean, what do we know from research and surveys, and what are you hearing from the educators you work with? Dr. Watson, maybe you want to grab that.
Watson: Well, it’s interesting that the data is a little bit mixed. We can probably estimate that it is a large percentage of students that are using it, especially at the university level. But surveys of students where they self-report how active they’ve been using generative AI, the results, depending on the survey, are wildly divergent. I’ve seen them in as low as in the 20% range and in other surveys up near 90%. So I’m imagining that some students might not want to self-report that they have been using it, but without a doubt, I would imagine it’s certainly more than half, maybe three quarters of students are using it. And of course, there’s a lot of different ways to use it. I mean, some students are using it for career planning or to help them learn various topics. And of course, there are other ways that they might use it that might diminish their learning or might be outright cheating, but certainly the vast majority of students are indeed using AI today.
Mills: And are we talking about mostly high school and college level or are kids younger than that using AI right now?
Schwartz: In the primary schools and secondary schools, a lot of the surveys have focused less so on the students’ use of AI and more so on the teacher’s use of AI.
Mills: That makes sense.
Schwartz: Yeah, we see that it’s obviously increased a great deal in the last year and a half. The use by faculty or educators is about the same in the primary and secondary and higher ed where it’s primary, it’s about 43%, in middle school, we see it about 63% up to 72% in high school and college. But the use for students is much less commonly asked on those surveys. So we have much less data on that. There is more on the high school use, but in the primary and secondary schools, educators are still trying to figure out for themselves how to use it, let alone how to incorporate it into the learning environment for those younger students.
Mills: Yeah. And we’ll talk about that. But, Dr. Schwartz, I want to ask you, what are the biggest concerns you hear from educators about how the students are using AI?
Schwartz: We see time and time again, I think the top two concerns reflect cognitive offloading, which simply means that the AI is doing the thinking, the reasoning for them. And in other words, they’re not learning. And there’s the issue of cheating or academic integrity. Those kind of rise to the top when you ask educators about AI. But there’s also concerns about the fact that the reliability of AI, so they’re speaking less so about the learning part, but just what the content is when they’re using it or their students are using it. Educators also speak sometimes about the erosion of trust that happens because whether or not students turn in work, then they have to determine whether or not it’s the student’s work or the work of AI and that relationship that exists between the student and the faculty member can be eroded just by those questions.
There’s issues of equity that’s of concern. So does everybody have the access that they need when AI is available, particularly since there are some that are free and some where there’s costs? And I’ve heard often from faculty about just the lack of professional development. So there’s an expectation sometimes from administrators that they should be using AI, and yet they are not given professional development on the technical proficiency that they need or the pedagogical strategies that they need to learn to incorporate AI into their everyday classrooms.
Mills: Well, Dr. Watson, that’s something that you’re working on, right? Can you talk about that?
Watson: So specifically how faculty are using AI in the classroom?
Mills: Yeah.
Watson: Well, I guess what we’re kind of seeing is that there’s maybe 20% of faculty, give or take, that are sort of leaning into figuring out how to use AI themselves, leveraging it for the improvement of learning outcomes for their students. There’s probably this big middle 70% that are sort of like wait and see, but learning to use it in a variety of different small ways. And then there’s certainly a resistance pocket as well. So it’s kind of like the broader landscape of how faculty at least are self-reporting that they’re using AI. But then when it comes to specifically the notion of leveraging AI for maybe teaching and learning purposes or course improvement, there are literally tools out there that help with every aspect of the teaching and learning life cycle from developing a syllabus, to finding course materials, to sorting course materials, to assignment design, putting together lectures, developing PowerPoint slide decks, creating active learning activities for the classroom, all the way through providing feedback to students and even grading.
About a year ago or a little bit less than a year ago, one of the big learning management system providers came out with tools nested within university learning management systems that purports to be able to grade just about anything. So the question is, it’s like, yes, AI can do these things, but do we want AI to do these things? Is this something that we would like to ask AI to perform that kind of task? Or are there certain aspects that really belong within the identity of what it is to be a professor in higher education? And a lot of that’s being hotly debated right now.
Mills: Yeah, because from what you described, I mean basically AI, it sounds like can do almost anything. Why do you need a teacher if AI can do all of these things?
Watson: Well, that’s one of the debated topics. In fact, I had an interview with a press outlet just yesterday about a new program that had been launched in London. It’s a master’s program that’s largely taught by AI. So is that a good idea? That was the question for me was like, do you think this is a good idea? And it’s like, well, I guess I’m of different minds. I mean, one is very much from a learning aspect. Would there be evidence to show that how they’ve designed and are leveraging AI, does it result in learning outcomes that are at similar or the same level of proficiency as a face-to-face program? And indeed, these are questions that we ask about online learning 25, 30 years ago. So it’s kind of like the same kinds of questions. And then we, of course, through inquiry around face-to-face and online learning, we found that there’s nuances.
I mean, online learning can be done very successfully, when done well, it can have really good outcomes. And when done poorly, face-to-face instruction could be worse than an online course. So I think that that’s likely going to be the outcomes of some of these, I guess, emerging studies around leveraging AI for instructional purposes—but we don’t know yet. I mean, those research studies haven’t been done and certainly evidence should guide the practice that we might employ or where we might encourage our students.
Mills: Well, Dr. Schwartz, let me ask you this. This is not the first time that people have worried about disruptive technology in education. I mean, AI is just the latest example of schools and universities and students needing to adapt to changing technology, whether it was calculators or Google. Now we’ve got AI. Is that fundamentally different from these earlier disruptions, do you think?
Schwartz: It’s a great question. And one that I’m often asked, and the calculator example’s often brought up, and then the internet. And most educators would agree that it’s fundamentally different. And it’s fundamentally different because well, the calculator, it did routine computations. It didn’t do any arithmetic thinking. It didn’t come to arithmetic conclusions like concepts or reasoning. The search function like of the Google search, it just removed the search process from the learning. And I remember as a faculty member, I would sit there and think about the times I had to go to the library, open up those onion-skin abstract books to find the articles. And then I was teaching and my students could literally just lie there with their laptop and just find something instantly. And I thought to myself, but that’s not a learning goal of mine. That’s not one of my learning goals. So it’s okay for the search process that’s being assisted with the internet and with Google searches to get in the way of learning.
Whereas AI is a much different type of technology right now. It’s producing the output. It’s producing the evidence of learning that students are turning in. So it’s a very different type of disruption. It generates explanations. It writes essays. It does problem solving instantly for students. So between solving problems, summarizing readings, and the list can go on, it’s a very different type of output compared to the former technologies that were considered disruptive in the classroom.
Mills: Well, so, Dr. Watson, keying off of that, do you think AI is going to erode students’ critical thinking ability?
Watson: Well, we did a survey at AAC&U. It was fielded in November of 2025, published in January of 2026. It’s available full text online. It’s called The AI Challenge. And we surveyed faculty in higher education across all disciplines, all institution types. And of that corpus of intelligence, 90% of respondents said that they thought that generative AI will diminish students’ critical thinking skills, that that was their perception. And more than two-thirds said that it was going to have a significant impact, a really large impact on students’ critical thinking skills. So that’s a lot of opinion that points in the same direction that is likely suggestive of an outcome that we will see around student usage of generative AI if we’re not careful. There’s definitely professional intervention that we could do to address that, but without that, we could expect that erosion.
Mills: Well, and what are those interventions? What do you do to ensure that your students are still using their full brainpower?
Watson: Well, it’s interesting. I mean, it varies from one discipline to the next, but I think part of it is engendering in students a healthy dose of skepticism regarding the output of generative AI, that AI doesn’t do the work for you, but it does work with you, but you’re the executive decision maker. You see the output, you have to evaluate it. You should read every sentence, you should examine every line of code, and you should anticipate that there will be things that you would need to correct. Or if it’s not wrong, that you as the human partner in this, as the one providing oversight, that you could improve the quality of the output given the nuance of understanding you have regarding whatever the particular task might be. So I think what we need to teach students going forward is a new habit of mind that is to have this ongoing almost moment to moment level of critique or criticism of the output of AI expecting that it will not have accurate outputs and then to engage with it appropriately.
So that’s new habit of mind that I think is part of a signature pedagogy for higher education.
Schwartz: And I’ll just add that that requires faculty to reconsider or redesign their assignments so that that can incorporate what Eddie just described into those assignments. Because a lot of the assignments that faculty for decades have used have not required that reflection because they didn’t have that tool that would generate the answers for them. But now with that tool in mind, we have to sit back and think about the exact assignment and can it be done with AI? Can it be done without AI? And when is AI removing the effort for learning that we know that leads to understanding, retaining information, and when is AI actually enhancing the learning? So redesigning assignments with those thoughts in mind will help students also in the end with greater learning outcomes.
Mills: I want to talk about cheating. A lot of the public conversation around AI and education has focused on this. How should educators and students think about what constitutes cheating with AI versus what is legitimate permitted assistance?
Schwartz: And cheating is a question and a concern that, as I said earlier, is a top concern for faculty. And I always want to mention when people ask questions about generative AI and cheating is that it’s not what created cheating. We know that cheating has been around and has been a problem, academic dishonesty has been there long before generative AI came about because we had to deal with cutting and pasting from those searches that students were doing. And then we had the larger issue of paper mills where students could purchase papers. And I don’t know if you’ve ever gone to those sites, but in the past when I was researching cheating—you can put in the topic, the grade level, the grade that you want, the date that you wanted it. So there were very sophisticated ways of cheating prior to generative AI.
And when it comes to defining cheating, what research shows us is that students and faculty define cheating very differently. When you give them examples of academic behavior, you don’t get agreement in what they consider to be cheating. And a lot of that has to do with the fact that faculty or educators have to define very clearly for their students what their expectations are and have clear policies on when they can use AI and when they should not use AI. And what we find is that the best practice that reduces cheating overall is when you talk about academic integrity with students. When you have that conversation and you talk openly and clearly and regularly, and not just one time because we typically, most faculty have it on their syllabus and they have a statement about academic integrity and define cheating there, but just stating it one time at the beginning of the semester is not enough. We find that if you repeat it over and over again with each assignment and explain to students what is allowable, then you reduce the likelihood of academic dishonesty.
And the same is true for generative AI. You have to be clear how they can use AI in the assignment that you’re giving to them. And if you don’t, the assumptions will be made. And this is actually a big concern for students. We hear from students that they don’t know when to use it and it creates great anxiety. And that’s the last thing that we want to do. So that communication piece is really important.
Mills: So, Dr. Watson, is there any work toward developing a consensus around the standards so that if I’m a student, for example, I know, okay, I can’t use AI to write my paper, but can I use AI to write the outline, for example?
Watson: Well, that’s a really good example. We actually gave in that survey that I mentioned to faculty, we found that there were large disagreements about what constitutes legitimate and illegitimate uses of generative AI. We gave scenarios and working from an outline was one of them. In fact, we gave, the language was a student receives a writing assignment and asks AI to provide a detailed outline of an appropriate response. The student then follows the outline to write the paper. Fifty two percent said that that was an example of how to use AI to cheat, while the other 48% said, this is faculty again, said that it was either legitimate or they weren’t quite sure.
And to be honest, I think it depends on what the learning goal might be. If you wanted students to have practice writing, and sometimes it’s difficult when you’re 17, 18 years old to think of something to write about. And so having an outline and then now you have something that you can practice creating sentences and grammar and syntax and all of those things. For that goal, that learning goal, that’s very helpful. But then on the other side of things, maybe you’re not using writing to learn to write, but you’re using writing to learn other things. And then in that case, you want to see the student’s thinking as made transparent by their writing. So I think that’s why there’s such disagreement is the scenario doesn’t speak to what the learning goal is. I think the learning goal’s going to vary from one assignment to the next, from one faculty member to the next. And as a result, I don’t think we’re going to find a consensus regarding what is the best way to use generative AI or what is a legitimate versus illegitimate way to use AI.
In fact, I think that most institutions now have some level of policy, and often the policy says, look at the faculty member’s syllabus. But I even go further in recommending that we’re probably at a moment where we don’t just mention it on the syllabus, but probably every assignment we give students, even a discussion board post should address that question. Can you use AI for this particular assignment? And also address the question of why or why not? I think students are far more likely to follow along if we make our pedagogical choices transparent. Oh, I can see I don’t have enough foundational knowledge to be able to use AI in this way yet as a partner. I would just be leaning on it too much. And so it’s more of a conversation than we’ve ever had regarding our teaching choices and our teaching practice to make sure that we’re providing students with guidance and understanding so that they’ll be more willing to follow along with the recommendations that we make.
Schwartz: And I’ll just add, because Eddie brought up a great point, is the question of whether or not there should be an institutional policy versus just leaving it up to the faculty and giving the autonomy to the faculty. And if you put yourself in the role of the student, if they have to go from one class to the next and figure out what each educator’s policy is, that gets very confusing. If there can be one overarching one that could be helpful. But as Eddie pointed out, it’s the learning goal of each and every assignment that will determine when it’s appropriate and how is it appropriate to use AI for that particular piece of work. That’s what will lead to achieving the learning goals and having students learn to whatever skill it is or content it is that you want them to achieve.
Watson: Yeah, I think that’s really good points. I think students though have been, even whenever all of us were back in college, we navigated the syllabus. We’d go to one class that’s like class participation’s worth 40% of the grade here and here it’s worth 5%. So then I might adjust my behaviors. I know I have to be social today because I’m in that particular psychology class versus my math class or whatever it might be. It adds additional levels of sophistication to that navigating from one class to the next. But given that learning should dictate a lot of the choices regarding technology use and indeed as grade breakdown is distributed within a class, it’s complexity and it does make it more difficult for the students, but that just further signals that this is additional change, not so much in student practice, but in faculty practice.
Mills: What about for faculty? What would constitute cheating or an unethical use of AI? For example, could you use AI to read all your students’ papers and assign grades? Can you use it to develop the syllabus? And where is the line for the faculty member?
Watson: Well, so we included questions in that survey specifically about the profession of the faculty member. Is it okay to use it to create your syllabus or is it okay to leverage it in some minor ways in terms of scholarship? And when we’re talking about creating an article to submit to a journal, more than four out of five of faculty said, no, that is an illegitimate use, an unprofessional use of AI. And as you got further down the food chain of teaching from syllabus development all the way to grading, there is less and less comfort with using AI for those purposes. So specifically we ask—a faculty member uses generative AI tools to grade essays in their course. 71% said that that was an illegitimate use for faculty to leverage AI in that way. Only 10% said outright, yes, that is acceptable. Another 20%, 19%, they said that they weren’t really sure.
But it’s suggestive that we need to have larger conversations because there are some that indeed see it as acceptable and are indeed doing it. And then there are others that see it as really just absurd for a professor to think about allowing AI to do the grading in a course. So again, everything is evolving and we still haven’t gotten to a sense of what are the common norms even for our own practice within our own disciplines regarding using generative AI.
Schwartz: And it brings up acceptance and transparency as well. If you think your colleagues believe that use of generative AI is not acceptable, even when you do use it, you’re not going to be transparent that you’re using it. And that brings up a whole other issue in the world of education. So Eddie’s so right in terms of that conversation is needed to really better understand when is it acceptable? When is it appropriate? Because I’ve also heard students concern about their faculty members using generative AI to grade their work. I mean, you’re not reading my papers, you’re using this technology to give me a grade, which for them is disconcerting.
Mills: Sure.
Watson: Yeah, I think it’s really, I think, important for faculty to be transparent with their students if they do indeed make that choice. And if they do make that choice for grading specifically, again, the explanation of here’s why I’m doing this because you’re going to get feedback immediately. Here’s a process where if you want to debate the grade that you received and would prefer to have a human grade it, here’s a path for that. But whatever the rules are, be transparent with students and talk about what the benefits are to them.
But there’s also the other side of the coin, what do students really think? And as we were putting together the second edition of Teaching with AI, we did a number of different student focus groups and we asked students the question. And I had made the erroneous assumption that students would not want this, that they would not want faculty to be using AI for grading. And it was a diversity of perspectives that emerged. One student said, I think I would prefer that because I think AI would be more fair. And he said, I lean more politically to the right and I’m kind of careful about things that I say in class as a result. But I think if I voice some opinions, I’m afraid that the faculty member might get back at me through grading. I had another student say that they showed up late for the first day of class and they though that their professor had it out for them for the entire semester because of that first day of class. So they like the idea of AI grading as a unbiased arbiter of the graded work.
Schwartz: Which is interesting because we know the bias that exists in AI itself, right? And for people who have English as a second language or even gender differences, that there’s some clear biases. So yeah, that’s an interesting point, Eddie.
Mills: But AI won’t know that you were late. Well, how might AI change the sorts of tests and assessments that teachers use to evaluate their students? I mean, I’ve read that there’s been an increase in orders for those old-fashioned blue books that a lot of us used in college. Will teachers need to go back to handwritten or oral tests and assignments?
Schwartz: There definitely has been an increase in blue books, and that’s the one thing I hear from faculty most often is that they’re asking for some work that’s taking place right in the classroom where it’s proctored or supervised or where no technology, so to speak, is available for students to use for answers. So essentially, many faculty are redesigning those assignments. And in some cases, assignments where AI is not allowed to be used or in other cases where AI is allowed, but there’s clear guidelines to ensure that the learning goals are met. But here’s really where basic learning science can guide the way because AI will hurt you when you remove the effort that’s involved in learning. So when there’s shortcuts for problem solving and it leads to what—I guess you’ll call it passive acceptance of answers, that’s when AI acts like a substitute and it’s doing the work for you.
And faculty are trying to avoid take-home tests, for example. I mean, I don’t know what many faculty these days, even if you give clear guidance—when I worked at a college with an honor system and an honor code, and all of my exams were just placed on at my door with two envelopes, one that said, Here’s the test and here’s where you return the test. Take it where you will throughout this 24 hours. I wonder how many faculty can still do that, even at an institution with an honor system, where AI is available. Faculty are more likely to do more assessment of learning in the classroom. So it could be oral exams where the person is, the student is speaking. It could be in classroom work using blue books or not, as opposed to I would guess, and, Eddie, I don’t recall if the AAC&U survey asked this, but less homework assignments, right? Will there be fewer homework assignments where there’s less monitoring of what’s taking place when the students are completing the work? Because the big question is when students turn in that product, can you tell whether or not it’s student work or AI generated work? That’s the ultimate question there.
Watson: Yeah, I had a colleague this spring, she was telling me that, Well, I’m making this interesting observation. My students are doing really good on the homework, but they’re doing really poorly on the in-class exams. I don’t know what that means. It’s like, Well, what do you think that means? When you’re watching them, they do poorly, but when they’re home, do you think they might be getting assistance in any sort? So there’s things that we can do in our class to collect information to better guide some of our practice or at least inform what’s actually taking place within the classroom. But everything that Beth just shared are observations that we’re seeing at AAC&U.
And I also have the good fortune of having an N of two in my household. So I’ve got two sons that are college age. And this past summer, my youngest came home from college and I was doing the dad thing. So son, how was college? How did you do on the finals? And he said, Well, it was interesting. I did great on the finals, but for two of them, I had to go to the bookstore and buy a packet of papers stapled together. And I said, Well, was the cover blue? And he was like, Dad, how did you know? Keeping up on the latest trends in higher education, son, that’s my job.
Mills: Well, I didn’t have to pay for them. I was lucky, I guess. But speaking again about basically being able to suss out what’s the student’s work and what’s AI, I mean, do detectors work and should faculty rely on those tools to figure out whether their students are doing the work themselves or using AI?
Schwartz: From the research that I’ve read, the detectors, if I was in a classroom, I would not be using those detectors because the range of accuracy of the detectors is so great that if I was placing the percentage that was created by that detector on a high stakes type of assignment, I just don’t think it would provide fair grading. And the interesting thing is that the people who are generating or developing the generative AI technology are also generating the AI detectors at the same time. And I wonder about that fact. Faculty often say, I can tell when a student has used AI. And I don’t believe that there’s evidence to date that shows that faculty are very good at differentiating papers written by their students versus AI. I will say that if you’re in a small classroom and you know your students’ writing skills and you have trends in their assignments and you know their voice, then yes, you are much better at detecting whether or not the paper was written by AI versus the student.
But when you go to the larger classrooms, which many of our colleagues are in classrooms with 200 students and they have writing assignments, then that becomes a much more challenging issue. But just to summarize again, I don’t believe that AI detectors are at the point where I would comfortably use them to differentiate AI written work versus student work.
Watson: Yeah, they’re definitely not smoking gun evidence of students cheating. I mean, at best you might use it as one data point among other points of triangulation such as Beth was describing, knowing the student’s voice—like this really doesn’t sound like this student. But sometimes even that doesn’t give you the evidence that you think that it is. I had one student tell me that they were accused of using AI and she said that the reason her work was so much better was that where she works, they were doing inventory over the weekend and she usually works 16 to 20 hours on the weekend. So she had this one weekend where she had all day both days, and so she was able to do really her best work. And so she turned in her best work and the faculty member’s like, Well, this doesn’t sound like your papers from earlier in the semester. You must be using AI. And the AI detector had flagged certain elements of it.
So the student had to, when they had the actual, I guess, case heard on campus, her boss came in and said, Yeah, she was off that weekend and she usually works every other weekend. And so she was able to win the case, but that’s kind of a harrowing experience for students to go through. And I actually had another student in the focus group share late last year that whenever I finish writing a paper, if I think that it sounds too smart, I’ll go back and dumb it down a bit so that my professor won’t think it was produced by AI. And I just found that heartbreaking. That’s not a skill you need in the real world is to dumb down your best work. That’s not something we want to promote, but some students are indeed trying to walk that line to prevent themselves from being suspected of having used AI.
Schwartz: There was also an interesting story that I heard about a student who was accused of using AI. There was a percentage that was generated for the paper that they turned in, and they took the faculty member’s work, something that the faculty member did and put it into an AI generator and then provided for the faculty member a percentage of that work that was detected as AI generated as evidence of the precarity of those types of detectors. I just thought that was ingenious. That’s great.
Watson: Yeah. In our book, Teaching with AI, we documented a case exactly like that where they went to the honor court meeting and they took the professor’s last single authored paper prior to November 2022 and ran it through one of those AI detectors tools. And sure enough, it was flagged as being 33% AI generated before generative AI existed. So yeah, I think it’s probably, if you’re going to use a gen AI detector, maybe run some of your own work through it and that might give you pause before you would actually bring that to your classroom.
Mills: Is there an age below which you think students shouldn’t be using AI at all?
Schwartz: So I would say that as is true in any kind of a learning environment, it just has to be age appropriate or developmentally appropriate when you introduce any type of technology or technique. And for younger students, you have to be really careful and aware of protecting learning, making sure that students, particularly younger students, you’re not outsourcing the learning of basic reading skills or writing skills or mathematical skills or reasoning because you want to build those foundational thinking skills. But at the same time, you want to start to introduce, if you can, an understanding of what AI is, but at a very basic awareness level when it comes to elementary school. And then when you start to look at middle school, you can look more at the guided use, teach the guided use of AI, where students can begin to learn how AI can give answers, but why the answers can be wrong or biased and how you can compare AI output to what are considered trusted resources for middle schoolers.
The emphasis for middle school should probably be more on the curiosity and safety and responsible habit use of AI, not the nitty-gritty how AI works. But then when you start to get to the high school level and even higher ed, there’s more of the critical and ethical use of AI. So it just develops over time where in higher ed, it’s more the advanced and workforce-oriented use. How does this transfer to the workforce when I’m in the college classroom and I’m learning how to use AI? How will this work when I’ve graduated? So it’s all about being age appropriate. But I think we are going to learn over time as educators start to learn how to incorporate AI into the classroom, what is age appropriate and what is the appropriate pieces to incorporate from a very early age.
Mills: Well, just to wrap up, what are the big questions you’re trying to answer? What are you each working on in this area right now? Dr. Schwartz, you want to take that first?
Schwartz: Yeah. Well, at APA, a lot of what we’re looking at is, well, one of the collaborations at APA and AAC&U is going to start later this year is helping faculty to answer some of these questions and conduct some scholarship on teaching and learning, which means what are the questions that they have and how can they go about critically evaluating what it means to use AI and its impact on learning? So part of our efforts is teaching faculty to ask those right questions and figure out the methodology to answer them and to really fill the gap in the literature that exists when it comes to understanding AI’s impact on learning. Because when you look at AI research to date, it’s not long-term learning. So we know more about short-term performance than we know about long-term learning. They’re often quiz scores and assignment scores, but it’s not retention over weeks or months later.
I’m just not finding them. Many of the research on these days focuses on perceptions and people’s opinions rather than on learning. So that’s why filling the gap in the literature was so important. And most studies to date don’t really isolate the cause and the effect, the generative AI to the learning that’s taking place. And so we don’t know whether it’s the fact that AI is creating better feedback or more practice opportunities, or is it more time on the task? Some of those questions and psychological science we ask when it comes to what is leading to the connection between using a certain type of learning tool and the learning that’s taking place. And as I said earlier, it’s heavily concentrated in higher ed, so we really need to help and support educators for the younger students to figure out how to really start to assess how AI would impact learning for elementary and secondary schools.
Mills: And, Dr. Watson, what’s ahead for you? You struggling to update your book? You have to do another edition every 6 months.
Watson: About every 18, that’s the rhythm that we’re on. I guess the other thing that I’m really focused on these days is actually larger curricular structures. If we are incorporating AI literacy as a learning outcome, maybe as essential learning for college students, well, what do we actually teach them? And then what would be the compass for that? I mean, certainly what the world of work demands would be a component of that, but then there’s also other moral, ethical, civic responsibilities as well that we would want to incorporate into that definition. But as you look at some of the AI literacy frameworks that have emerged, almost all of them predate agentic AI. And as we think about the world of work, there’s a lot of shifts that are taking place. I was literally just talking to a friend last week who was at, they’re in sales and they were at a sales meeting and they learned that all of the support staff around the core sales team was going to be laid off before the end of the year.
And the expectation was that they would begin using agentic AI to actually do a lot of those discrete tasks that require some level of decision-making that these more entry level positions were doing. So managing agentic AI, managing agents, that’s a different skillset that I haven’t seen in any of the earlier models because really agentic AI really wasn’t present at that point. So there’s this evolution of what is AI literacy. And one thing that we do well in higher ed is curriculum reform. One thing that we don’t do well is curriculum reform fast. And the truth is the target is changing quite quickly these days. So staying on top of that, going through, doing all of the processes that we always do to ensure quality and accuracy for the components of a learning outcome that we would then engender into our curriculum or into our major.
We still need to be doing that work. But I think what’s really needed of higher ed is a new kind of agility. How do we do this work more quickly and recursively? Gen ed reform is maybe the biggest curricular reform effort that a campus can do. And on many campuses, they do gen ed reform every 10 to 20 years because it is such a large—
Schwartz: It takes a year to do, right?
Watson: Right, exactly. And so how do we shorten that timeframe for curriculum reform in service to a learning outcome that is shifting rapidly? You don’t build something into the curriculum and then you don’t change it for 5 years where we see the rate of change around AI is exceptionally fast. So that whole challenge of institutional change, agility, curricular agility, and the evolution of what AI literacy means to the population of students that we have, and that will soon be beyond our campuses. Those are among the key things that I think about these days.
Schwartz: And I’ll just add one more thing. And my role from APA’s perspective or from my own perspective is that we have this foundational learning science, foundational principles that we know leads to strong learning. And we have to keep that in mind when we’re reconsidering the assignments and what we’re having students do because we know what leads to a student understanding, a student remembering, a student moving forward with that information in mind. If we don’t keep that in mind, then we’re just missing out on this important part of the scientific literature from psychology that can really provide a lot of answers.
Mills: Well, Dr. Schwartz, Dr. Watson, I want to thank you both for joining me. I think you’re doing really important work right now.
Schwartz: Thanks for having us.
Mills: You can find previous episodes of Speaking of Psychology on our website at speakingofpsychology.org or on Apple, Spotify, YouTube, or wherever you get your podcasts. And if you like what you've heard, please subscribe and leave a review. If you have comments or ideas for future episodes, you can email us at speakingofpsychology@apa.org. Speaking of Psychology is produced by Lea Winerman.
Thank you for listening. For the American Psychological Association, I’m Kim Mills.