What Does 'AI Literacy' Really Mean and How Do We Know Students Are Gaining It?

To prepare students for the real world, not just the digital one, schools must go beyond teaching how to prompt and embed AI literacy as a key pillar of curriculum, critical thinking & student voice

This post is part of a series exploring how schools can integrate AI meaningfully, ethically and strategically. It offers insights and strategies for educators across all curricula and contexts — from Dubai to Dublin, Delhi to Durban and everywhere in between.

Subscribers get exclusive access to CPD audit tools, training slide decks, and a starter set of discussion prompts to help schools launch their own AI professional development journey.

---

Key Components of AI Literacy

AI literacy is not just about knowing how to use ChatGPT or generate an image. It’s a broader set of critical knowledge, behaviours and dispositions that help students navigate and evaluate AI-rich environments. Before diving into classroom practice, it’s important to set a clear foundation for what we mean by AI literacy and why it matters.

Globally, frameworks like those from the ISTE and OECD stress that AI literacy is about thinking, questioning, and adapting, not just using. These components are not fixed; they should evolve as AI systems become more embedded in daily life. Schools that are serious about readiness are now building AI literacy into their core teaching goals.

Key components include:

1. Conceptual understanding – Students grasp what AI is and isn’t, including terms like algorithms, models and training data.

2. Critical evaluation – They can question AI output, spot bias, and understand AI’s limitations.

3. Ethical awareness – They reflect on AI’s impact on society, fairness, privacy and sustainability.

4. Safe and responsible use – They understand how to use AI tools safely and manage digital identity and data.

5. Creative application – They explore how to use AI to enhance writing, problem-solving, revision or design.

These principles should be visible in curriculum plans, language used in lessons, and learning outcomes. Importantly, AI literacy is a living concept, schools must regularly revisit what it means as technology advances.

---

How Do We Know Students Are Gaining It?

Developing AI literacy doesn’t end with teaching, schools need ways to track progress and identify next steps. It’s easy to measure prompt outcomes, but harder (and more valuable) to assess thinking and judgment. That’s why thoughtful indicators are key.

Schools are building indicators across key stages that help students and teachers reflect on learning over time. These indicators often align with digital citizenship, media literacy and critical thinking goals, particularly for students learning to evaluate source reliability, voice, and intent. They can also support retrieval practices, formative questioning and pupil self-assessment.

Emerging indicators include:

• Can the student explain how an AI system works (even in simple terms)?

• Can they identify bias or inaccuracy in AI output?

• Do they ask critical questions before accepting AI-generated answers?

• Can they explain the difference between human voice and AI tone?

• Are they confident knowing when not to use AI (e.g. exams, personal voice)?

• Can they reflect on the ethical implications of AI in a topic they’re studying?

These should be integrated into everyday learning, not a separate AI test, allowing teachers to assess through projects, discussion, annotation, and analysis. Some schools also track changes in student attitudes toward AI use over time as a way to measure depth and maturity of understanding.

---

In Practice: Building AI Literacy in Real Classrooms

In practice, building AI literacy means integrating these skills naturally into subject learning, not treating them as a bolt-on. Great teaching uses retrieval, modelling, scaffolding and dual coding and these apply just as well to AI education. Across subjects and phases, AI literacy is developing organically when teachers are empowered to experiment and adapt.

It also supports existing curriculum goals, including source analysis, mathematical reasoning, and extended writing, rather than replacing them. For example, AI can provide a tool for comparison, but not a substitute for thought. Schools are increasingly encouraging students to test, reflect on, and even challenge AI tools rather than passively accept them.

Here’s what’s working in classrooms:

• English – Students compare human-written and AI-written texts to spot tone, authorial voice and persuasive techniques.

• Science – Students evaluate AI-generated hypotheses and cross-check them with experiments or known models. Teachers use AI to test students' ability to falsify or improve explanations.

• Maths – Learners test AI explanations of concepts like percentages or ratios and rate their clarity. They also reflect on where the tool confused them.

• Primary – Pupils use AI to generate story prompts, then reflect on how to make their own voice stronger. They also discuss when it's better to use their own imagination.

• Humanities – Students critique AI-written historical summaries, asking: what’s missing? Whose voice is left out? Is the tone neutral or persuasive?

Across all of these, schools are embedding structured critique, encouraging learners to edit, question and challenge AI output rather than accept it at face value. Some teachers even use multiple AI outputs side-by-side, asking students to choose which is most accurate, a great way to surface higher-order thinking.

---

Next Steps for Leaders

School leaders can drive AI literacy with a clear vision and structured implementation plan. But it starts with recognising that AI literacy isn’t an ICT add-on, it’s a whole-school imperative that touches values, safeguarding, digital citizenship and curriculum integrity.

Leadership teams should avoid the temptation to silo AI literacy into a single department or digital lead. Instead, it needs to be owned across the curriculum, from pastoral teams discussing digital behaviour to subject leads embedding AI critique in unit plans.

To build staff and student confidence in AI literacy, here’s what many leaders are now doing:

• Define what AI literacy means – Create a school-wide definition that links to your curriculum and values.

• Audit the curriculum – Where are students already using AI? Where could these skills be embedded?

• Avoid ICT siloing – AI literacy should be developed across all subjects, not just by tech leads.

• Link to safeguarding – Align AI literacy with your digital safety, well-being and privacy frameworks.

• Develop teacher confidence – Use CPD, peer collaboration and coaching to support staff.

• Include student voice – Ask students how they use AI, what they need support with, and where school guidance helps.

• Share clear examples – Use subject-specific scenarios and exemplars to make AI literacy visible.

Schools that build AI literacy well tend to embed it across strategy documents, PD calendars and curriculum maps, not as a one-off initiative but as a sustained approach.

---

Useful Links

1. Why AI Literacy Is Now a Core Competency in Education – World Economic Forum
   A global perspective on why AI literacy is essential for future-ready learners — and how education systems are responding.

2. New OECD AI Literacy Framework to Equip Youth – OECD Education and Skills Today
   The OECD’s new framework outlines what young people need to thrive in AI-rich environments.

---

Reflective Questions

• Are we building student ability to question AI, not just use it?

• How will we know if students are developing true understanding of how AI works?

• What misconceptions about AI might students already have?

• Are we giving staff the tools and space to model ethical and reflective AI use?

---

📚 AI in Education Blog Series – Full List

This 4-week series explores how schools can embed AI meaningfully, ethically and strategically across curriculum, CPD, leadership and inclusion. New posts are published four times a week throughout June and July 2025.

Week 1: Orientation – Understanding the Shift

1. Why AI in Schools Is a Pedagogical Shift, Not a Tech Trend

2. How to Talk to Students About AI (Even When You’re Not an Expert)

3. Bridging the Gap: What Parents and Teachers Need to Understand About AI

4. How Ready Is Your School for AI? A Leadership Reflection

Week 2: Teaching, Equity and Ethics
5. Planning with AI Without Losing Professional Judgement
6. Can We Really Teach Ethics in AI? Yes, Here’s How
7. What Inclusive AI Use Looks Like in EAL and SEND Contexts
8. Keeping Students Safe: The New Rules of AI and Safeguarding

Week 3: Teaching Across Subjects
9. Reimagining Reading and Writing: AI in English and Language of Instruction
10. AI in Math and Science: From Calculation to Simulation
11. What Happens to Critical Thinking When AI Can Summarise?
12. Creativity and Authenticity in the Age of AI

Week 4: Strategy, Assessment and Future Readiness
13. What Every School Needs Before Saying “We Use AI”
14. Why CPD on AI Should Start with Questions, Not Tools
15. (You are here) What Does “AI Literacy” Really Mean, and How Do We Know Students Are Gaining It?
16. Coming Soon: From Pilot to Policy — Embedding AI in the School Development Plan