GPT-6 Astra edited a small AI and lifted its math to 48%

MIT CSAIL researchers had GPT-6 Astra read and edit another model's raw weights with no training. One targeted fix to 0.016% of Qwen3.5-0.8B's weights took its MATH-500 score from 7.9% to 48.1%. Early research, with full logs public.

Adam · News editor, Dear my…

· 3 min read

On this page

Short answer: Four MIT CSAIL researchers showed that OpenAI's GPT-6 Astra can read the raw numbers inside a neural network and edit them directly, with no training run. In their biggest test, Astra found what made the small open model Qwen3.5-0.8B get stuck in thinking loops, changed about 0.016% of its weights, and its MATH-500 score rose from 7.9% to 48.1%. It's an early research result, not a product you can switch on.

What happened

On November 2, 2026, Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab published a research post called "Sparks of Weight-Space Programming." Weights are the millions of numbers that decide how an AI model behaves. Normally they are set by training, a slow process that needs lots of data and computing power. Here, a general-purpose chatbot model was simply asked to reason about those numbers in plain language and change them.

The researchers report several experiments:

  • Reading: given only the weights of small game-playing networks, Astra named the game each one was trained on, without being told the options.
  • Fixing: a network that kept driving a car straight into a ramp got a one-shot edit to 3.5% of its weights and went from 0% to 100% success.
  • Writing from scratch: Astra wrote a 1.5-million-weight network that plays Go on a 9×9 board. With 50 test runs allowed, it beat an equal-sized network trained on 20 million games, according to the authors.
  • Improving a real language model: in Qwen3.5-0.8B, Astra traced the thinking loops that Qwen's own model card warns about to one direction in two layers and removed it. Per the researchers, GSM8K went from 13.8% to 67.1% and instruction following (IFEval) from 21.0% to 62.3%.

The authors are also clear about limits. The edit removed an obstacle rather than teaching new math, and on Gemma 3 270M, which rarely loops, the gains were about a point. From weights alone, Astra couldn't tell which of two models had been trained to flatter users. The team published full logs of every experiment, and the edited Qwen model is on Hugging Face.

Why people are talking about it

The post was the top story on Hacker News's front page for November 2, with about 2,390 points, and it made Techmeme's front page. VentureBeat's headline called it "like gene editing for neural networks," and India Today covered it the next day.

What it means if you use AI

  • Smaller models could get better faster. If targeted edits work more widely, fixing a known bug in a model might take hours instead of a new training run.
  • Easier checks on what's inside a model. The researchers hope AI could one day spot hidden problems by reading weights, before a model is released.
  • Keep it in proportion. These are first results on small models, not yet independently reproduced, and nothing changes in the apps you use today.

Quick checklist

  • Read the original post for the charts and examples.
  • Curious developers can browse the public logs and try the edited Qwen model on Hugging Face.
  • Treat benchmark jumps as the authors' own measurements until others repeat them.

Sources

  • MIT CSAIL researchers: "Sparks of Weight-Space Programming" (read November 3, 2026)
  • VentureBeat, November 2, 2026: MIT researchers used GPT-6 Astra to edit Qwen's open weights directly
  • India Today, November 3, 2026: Can AI fix another AI's brain?
  • Hacker News discussion: "Astra can read and write weights to improve Qwen"

Related reading:

Cover image: Ray and Maria Stata Center, MIT, Cambridge, home of MIT CSAIL. Photo: Tony Webster, Wikimedia Commons, CC BY 2.0.

Sources

  1. MIT CSAIL researchers: Sparks of Weight-Space Programming (primary source, Nov 2, 2026)
  2. VentureBeat (Nov 2, 2026): MIT researchers used GPT-6 Astra to edit Qwen's open weights directly
  3. India Today (Nov 3, 2026): Can AI fix another AI's brain?
  4. Hacker News: Astra can read and write weights to improve Qwen
  5. Cover image: Ray and Maria Stata Center - MIT, Cambridge, by Tony Webster, Wikimedia Commons, CC BY 2.0

Written by our editorial team with the help of AI tools. Spotted a mistake? Tell us in the discussion.

Was this article helpful?

Discussion0 comments

Join the discussion

Log in or create a free account to comment. Only your nickname is shown.

No comments yet. Start the conversation.