Safety & Design
Human in the loop
Keeping a person, such as a parent, teacher, or reviewer, able to see, stop, or approve what an AI system does before the result is final.
- Educators and school leaders
- Businesses
What parents should know
A human in the loop is a person who can see the AI's work and change the outcome. For kids, that person is usually a parent or a teacher, not a distant reviewer you will never meet. If nobody can open the chat, there is no loop. There is only the model.
On this page
What is a human in the loop?
The phrase comes from systems where a person checks a machine before a high-stakes step: a doctor over a scan, an editor over a draft, a moderator over a flag. In a family product the loop is closer. A parent reads the transcript, sets a limit, or refuses a public link. In a school, a teacher sees the session and decides what may be turned in.
A loop that only exists after harm is a thin one. The stronger version can interrupt: tool off, link revoked, topic blocked, assignment redone by the student. A dashboard nobody opens is a loop on paper.
Why a human in the loop matters
AI is fluent. Fluency makes adults skip the check. Homework that the student cannot explain, and an image that leaves the account with no approval, are what you get when the loop is missing. The EU AI Act treats human oversight as part of high-risk duties. You do not need that law to want an adult on a child's account.
Students should be in the loop on their own work too. A tutor that asks them to try the step keeps the student as the person responsible for the answer. A bot that writes the paragraph removes both the student and the teacher.
How it shows up in practice
- A parent approves a public project link after reading the page.
- A teacher looks at the prompt before deciding whether the homework help was allowed.
- A reviewer is the only one who can publish a flagged reply, and the school knows their name.
- A child explains the math step without the tab open.
How HeyOtto helps
The humans in HeyOtto's loop are the parent and, at school, the teacher or advisor. Parents read transcripts, set per-child topic limits and tool permissions, and approve public shares. Homework help asks the student to do the step, so the student stays in the loop. Otto does not auto-contact emergency services. A distress alert tells an adult. It does not replace one.
- School dashboards show how the student used the tool.
- A public link can be revoked after it is approved.
- The model is not the teacher of record and not the parent.
For schools
Request a demoFAQs
Is a content filter a human in the loop?
No. A filter is automatic. A human in the loop can look at a particular case and decide. You want both. HeyOtto uses content limits and also gives parents and teachers the transcript.
Does the EU require this?
Human oversight is part of the EU AI Act's high-risk duties. Those Annex III duties apply from December 2, 2027. A family product can put a parent in the loop now without waiting on that date. This is general information, not legal advice.
What if I never open the dashboard?
Then the loop is unused. Alerts exist so you do not have to read every line. They are not a reason to never read any line. Open a transcript when an alert fires, and sometimes when it does not.
Can the student be the human?
For ordinary homework, yes. The student should be able to explain the work. For safety, publishing, and distress, the human needs to be an adult. Those are different loops.
Sources
Last reviewed September 26, 2026. This entry is reviewed twice a year.