NeuroAI NEUROAINEUROAI.SITE
ESC

Ant Group Open-Sourced a 124-Billion-Parameter Multimodal Model — and Taught It to Check Its Own Work

Ling-3.0-flash-VL activates only 5.5B of 124B parameters, reads 256,000 tokens at once, and runs an observe–act–verify–correct loop. Open weights are not charity; they are a land grab.

2026-09-10 · 658 words · NeuroAI
Ant Group Open-Sourced a 124-Billion-Parameter Multimodal Model — and Taught It to Check Its Own Work

You have probably had this moment: you hand an AI a blurry screenshot, ask what it says, and it confidently merges line three with line five.

It is not that the model is lazy. It is that it looked the wrong way — and, until now, never looked twice.

On 9 September 2026, Ant Group released the first natively multimodal model in its Ling series, with weights publicly downloadable.

Key takeaways

  • Model: Ling-3.0-flash-VL, 124 billion total parameters, 5.5 billion activated per query — a mixture-of-experts design.
  • Context: 256,000 tokens, roughly a full book-length document in one pass.
  • What is new: an observe → act → verify → correct loop. The model re-inspects its own first answer and revises it.
  • Counter-intuitive finding: joint training on images, text and video improved the model's text performance rather than diluting it.
  • Licence posture: weights open for download, free.

How a 124B model stays cheap

The two numbers to read are total and active parameters. The analogy the release invites: a company of 1,240 people where only the 55 relevant ones are woken up for any given job.

That is the standard architecture behind every "cheap large model" now — a big library, a small reading list per query. It does not make the model run on your phone. It does cut server cost, and that eventually shows up in the subscription you pay.

The context window is the part with immediate practical effect. At 256,000 tokens you can hand over an entire project's documentation at once instead of feeding it chapter by chapter.

The self-correction loop is the real story

Earlier models were one-shot: they looked, answered, apologised when wrong, and then answered wrong again. Anyone who has asked an AI to count people in a photograph knows the feeling — it names a number, you correct it, it changes the number, and it is still wrong, because there was never a re-check step.

Adding one is the difference between "usable" and "good."

There is also a finding worth flagging because it contradicts intuition: training jointly on images, text and video raised text capability instead of costing it. The usual assumption is that learning one modality degrades another. Biology suggests otherwise — the brain region that blind people use to read Braille is the region normally reserved for vision.

Why give away something this expensive

Open-sourcing stopped being philanthropy some time ago.

The more developers use a model and the more enterprises deploy it, the more its way of representing the world becomes the working default. Once a default forms, the tooling, plug-ins, training material and cloud services all follow that path.

Open weights are not a gift. They are a claim on territory.

The cadence of Chinese releases makes the strategy legible: Zhipu made its models publicly downloadable; Alibaba pushed inference cost to roughly a third of peers; ModelBest built a 2-billion-parameter model that ranks first at its size; and now Ant has opened the multimodal line.

For an ordinary user, the practical conclusion is simple: the harder this fight gets, the cheaper and more capable the tools in your hands become.

What to do with it

Do not renew early for "more powerful." Open-sourced models typically take one to three months to reach application vendors. The annual plan you buy today may be obsolete next quarter.

Retry document and image work you gave up on. Receipts, handwritten notes, spreadsheet screenshots, product pages — cost is down and capability is up. Many tasks that failed once now succeed.

If you run a small business, isolate the "reading" step in your costs. The lists, dockets and screenshots someone checks by eye every day are usually the first cost line these models can replace — and the first place the return is measurable.

Models keep getting larger and cheaper. The only thing that reliably rises is what you expect from them.

Details as announced by Ant Group on 9 September 2026.

More in “Foundation Models” → · Back to home · Markdown version