Homework 1
The hardest task in your field
Due before class on Wednesday, October 7, 2026
What is the hardest thing in your field that a top expert can do on a computer, with an answer that can be checked, and that today's best AI agents can't? Design that task, and package it so an AI agent can attempt it on its own, in a sealed container, graded automatically. After you submit, we run frontier AI agents on every task.
An AI coding agent does the engineering with you; you bring the science. Students, auditors and faculty are all welcome to submit.
How the agent is doing
Claude Opus 5.5 is attempting every submitted task. Live.
Start
- Open an AI coding agent (Claude Code, Codex, Cursor, GitHub Copilot, …) in a folder under your home directory.
-
Give it this:
Read https://class.xhelio.ai/week-1/homework.md and help me with my homework. - Follow along. It sets things up with you, helps you find the hardest problem you can still verify, builds the task with you, and opens your pull request.
Coming back later? Open your agent in your clone of the class repository and give it the same line. It picks up where you left off.
You'll need
- A GitHub account (sign up), plus uv. Your agent helps you install it. Mac, Linux or Windows; no Docker needed.
- An AI coding agent. No subscription? Codex works with a free ChatGPT account, and GitHub Copilot is free for verified students.
- A problem you know how to solve, ideally from your own work, with data you may share (under 20 MB) or a script that makes it.
Over the quarter
- AmbitiousThe hardest task you can think of, valid in Harbor format. This week.
- HonestYou read agents' full attempts and fixed everything they exposed.
- Proven hardFrontier agents fail, repeatedly, on the science itself.
- Benchmark-readyGood enough to propose to Terminal-Bench-Science.