Homework 1

The hardest task in your field

Due before class on Wednesday, October 7, 2026

What is the hardest thing in your field that a top expert can do on a computer, with an answer that can be checked, and that today's best AI agents can't? Design that task, and package it so an AI agent can attempt it on its own, in a sealed container, graded automatically. After you submit, we run frontier AI agents on every task.

An AI coding agent does the engineering with you; you bring the science. Students, auditors and faculty are all welcome to submit.

How the agent is doing

Claude Opus 5.5 is attempting every submitted task. Live.

    Start

    1. Open an AI coding agent (Claude Code, Codex, Cursor, GitHub Copilot, …) in a folder under your home directory.
    2. Give it this:
      Read https://class.xhelio.ai/week-1/homework.md and help me with my homework.
    3. Follow along. It sets things up with you, helps you find the hardest problem you can still verify, builds the task with you, and opens your pull request.

    Coming back later? Open your agent in your clone of the class repository and give it the same line. It picks up where you left off.

    You'll need

    Over the quarter

    1. AmbitiousThe hardest task you can think of, valid in Harbor format. This week.
    2. HonestYou read agents' full attempts and fixed everything they exposed.
    3. Proven hardFrontier agents fail, repeatedly, on the science itself.
    4. Benchmark-readyGood enough to propose to Terminal-Bench-Science.