Navigating Bias, Equity and Data Privacy

There’s no escaping from artificial intelligence (AI). In most sectors, AI tools are now commonplace and are being used to improve efficiency, automate workflows, enhance consumer experiences, analyze data, and much more. However, in education, AI adoption is still in the early stages.

In our recent survey of 1,800 international educators conducted this summer, only 11% reported feeling that their school was “very prepared to use AI tools effectively”.

How prepared is your school to use AI tools effectively?

• 5.7% said ‘Not at all prepared’
• 24.2% said ‘Not very prepared’
• 59.2 said ‘Somewhat prepared’
• 10.8% said ‘Very prepared’

Despite this, we are indeed witnessing a growing trend of students using it – a survey by the UK’s National Literacy Trust found the proportion of 13- to 18-year-olds using generative AI has risen from 37% in 2023 to 77% in 2024.

Why must school leaders use AI responsibly?

At Faria, we believe that AI should not replace the unique connection between teacher and student, but can be effective when used properly. That’s why school leaders must understand how to use AI responsibly, so that it enhances learning rather than causing harm.

School leaders must ensure that the power of human teaching and critical thinking is never lost, monitoring for fairness and engaging parents and students in conversations about the ethical use of technology. Responsible use requires prioritizing data privacy, avoiding the use of inaccurate information, and ensuring equal access to AI technology for all students.

Do you need a few pointers on how to ensure AI is used correctly? Check out our handy checklist below.

The challenges of using AI in education

From our research, we’ve identified several key concerns:

• Over-reliance and dependency: If learners start to depend too much on AI, it could negatively impact their ability to think critically and solve problems. It may also have a damaging influence on the teacher-student relationship, limiting the effectiveness of human teaching methods. AI must support learning, not replace it.
• Ethical use and decision-making: Schools need to maintain trust and transparency. Teachers, students, and parents need to understand how AI is being used and for what purpose. Therefore, school leaders must engage parents and students in conversations about the use of AI systems and technology, clearly explaining the decisions made regarding their use. Download our Governance Checklist here.
• Data privacy and protection: AI systems often process sensitive student data, which means irresponsible use could lead to serious data leaks. All school leaders must ensure compliance with privacy laws and utilize secure AI tools.
• Align with educational values: Education is about growth, inclusion, and human development, not just efficiency or automation. Any successful use of AI relies on not losing sight of traditional school values. Learning should never be completely dehumanized.
• Effective training: When AI tools are used, everybody who needs to use them must understand how. Teachers, students, and parents should all receive adequate training. 
• Biased information: AI is trained on data, which could include biases that would discriminate against certain groups or ways of thinking. This might undermine the principle of fairness in education. In some cases, AI can also be incorrect, which is why it’s essential to critically evaluate AI-generated content and data.

 How to use AI correctly: Checklist

Here’s a practical checklist that school leaders can use as a guideline to ensure AI is used responsibly and avoid the challenges listed above.

Policy and governance

• Develop a clear AI policy aligned with school values and national regulations.
• Form an AI ethics committee that includes teachers, IT staff, parents, and select students.
• Regularly review and update AI-related policies as technology evolves.

Data privacy

• Ensure AI tools comply with data protection laws, particularly those that focus on protecting children.
• Verify that student data is encrypted, anonymized, and stored securely.
• Limit access to sensitive data, so only authorized personnel can handle it.
• Obtain informed consent from parents or students before using data-driven tools.

Fairness and transparency

• Evaluate AI systems for bias or discriminatory outcomes.
• Choose AI tool providers that are transparent about their algorithms and data sources.
• Monitor AI performance regularly to ensure equitable treatment for all learners.
• Provide alternatives for students affected by digital or accessibility barriers.
• Clearly explain how and why AI tools are being used in your school.
• Share AI-related decisions with teachers, students, and families.
• Require software suppliers to provide clear documentation of how their AI works.
• Encourage feedback and open dialogue about the impact of AI.

Human oversight

• Ensure that AI supports, not replaces, teachers’ professional judgment.
• Require that all major AI-driven decisions (e.g., grading, discipline) include human review.
• Train staff to interpret and question AI outputs.

Professional learning

• Offer AI literacy training for teachers and administrators.
• Include ethical and practical AI use in ongoing PD programs.
• Create a safe environment for educators to experiment and learn about AI tools.

Student learning

• Teach students about AI ethics, digital citizenship, and critical thinking.
• Encourage responsible and creative use of AI in learning projects.
• Ensure AI use promotes inclusivity, creativity, and collaboration.

Monitoring and development

• Regularly assess the impact of AI tools on teaching, learning, and wellbeing.
• Gather feedback from teachers, students, and parents.
• Be ready to pause or discontinue any AI tool that proves harmful or ineffective.

For AI to be successful in education, all stakeholders need to be engaged in the process with clear rules and policies to ensure safety, equity, and effective implementation. 

AI Professional Development Training

Through FariaLearn’s AI Academy, Powered by Eblana Learning, we are offering a range of on-demand courses and facilitated professional learning, as well as an articulated AI Curriculum to support schools in successfully and safely navigating AI in education.