{"slug": "what-are-the-judgements-which-students-are-making-as-they-use-ai", "title": "What are the judgements which students are making as they use AI?", "summary": "A study by Walton et al. published in Assessment & Evaluation in Higher Education identifies six categories of 'judgement events'—time-bound moments when students evaluate AI outputs during assessments—and finds that students' own views of what they learned do not distinguish between cases where generative AI enhanced or hindered learning. The authors argue that educators currently design assessments and policy without understanding how students make judgements with and about GenAI, and they call for assessment design that explicitly sequences desirable judgement events.", "body_md": "I enjoyed [this paper by Walton et al](https://www.tandfonline.com/doi/full/10.1080/02602938.2025.2570328) about the role of *judgement* in how students use AI. There’s currently a startling lack of rich data about the judgements students actually make in their use of chatbots chatbots, as they summarise on pg 2:\n\nThere remains little information beyond decontextualised self-reports about\n\nwhat these judgements might be and how they influence what students learn (or fail to learn) from completing their assessments. Thus, educators and institutions continue to design assessments and set policy to take account of GenAI use without understanding how their choices will affect students and learning. Exploring how students make judgements with—and about—GenAI will therefore provide a much-needed perspective on how students are coming to learn with, rely on, and dissemble with GenAI.\n\nThrough a nicely designed walk through method they identify six categories of what they call judgement events: time bound occurrences where the student where a student evaluates AI and its outputs as they worked on an assessment. What I particularly like about this framing is how it enables us to distinguish between:\n\n- The occurance and sequencing of judgement events.\n- The (epistemically) better or worse judgement events which make up that sequence\n\nIt does what Milan and I describe in *The Platform Learns To Speak *as opening the blackbox of AI use in order to look at the process which underpins it. The obvious lesson to take from the notion of judgement events is to ask three questions of assessment design:\n\n- What is the process? Where and when are judgements called for?\n- What kind of judgement events are desirable for constructive alignment?\n- How does the logic of the design ideally knit together these judgement events?\n- How does the embedding of the assessment support or hinder this ambition?\n\nA crucial point they make in this paper concerns student’s ability to distinguish their own epistemic contribution to the output. I’ve been prone in the last year to saying that* we need to help students understand what it feels like to be learning**. I stand by this but I realise it’s a precarious achievement rather than something we can rely on. This is why I like their two points on pg 13 so much:\n\nThis makes two points: firstly, GenAI use can enhance or hinder learning,\n\ndepending on circumstance. Secondly, students’ own views of what they learnt or how they worked with GenAI use does not distinguish between these cases.\n\n*Thanks to David Meechan for setting me off on this, when he visited us.", "url": "https://wpnews.pro/news/what-are-the-judgements-which-students-are-making-as-they-use-ai", "canonical_source": "https://markcarrigan.net/2026/08/14/what-are-the-judgements-which-students-are-making-as-they-use-ai/", "published_at": "2026-08-14 12:52:04+00:00", "updated_at": "2026-08-14 13:23:13.318738+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-ethics", "ai-policy"], "entities": ["Walton et al.", "Assessment & Evaluation in Higher Education", "David Meechan", "Milan"], "alternates": {"html": "https://wpnews.pro/news/what-are-the-judgements-which-students-are-making-as-they-use-ai", "markdown": "https://wpnews.pro/news/what-are-the-judgements-which-students-are-making-as-they-use-ai.md", "text": "https://wpnews.pro/news/what-are-the-judgements-which-students-are-making-as-they-use-ai.txt", "jsonld": "https://wpnews.pro/news/what-are-the-judgements-which-students-are-making-as-they-use-ai.jsonld"}}