--- title: "The \"token factory\" founder — Yuan Jinhui and the unglamorous middle layer of AI" date: 2026-10-19 category: Builders site: NeuroAI canonical: https://neuroai.site/a/na-people-yuan-jinhui-siliconflow language: en --- # The "token factory" founder — Yuan Jinhui and the unglamorous middle layer of AI > After his first startup was acquired, Yuan Jinhui rebuilt as SiliconFlow, a neutral inference layer now routing half a trillion AI tokens a day. The bet is on plumbing, not models. In early 2023, a startup building a deep-learning framework was absorbed into a Meituan-backed acquisition, and its founder walked away with his core team. Eight months later, the same engineer launched a new company that today processes more than half a trillion AI tokens a day. Few outside China's developer circles have heard his name. **From LightLDA to OneFlow** Yuan Jinhui (袁进辉) is a computer scientist by training — a bachelor's from Xidian University in 2003 and a PhD from Tsinghua in 2008, the latter supervised by AI pioneer Zhang Bo (张钹), a member of the Chinese Academy of Sciences. At **Microsoft Research Asia** from 2013 to 2016 he built **LightLDA**, an algorithm that trained massive topic models on far fewer servers than seemed possible, and was later used inside Microsoft's online advertising systems. In **2017** he founded **OneFlow (一流科技)**, a distributed deep-learning framework. Its design — static scheduling with streaming execution — was aimed at the training phase of AI, the part everyone agreed would matter once models grew huge. OneFlow open-sourced in **2020** and drew quiet respect from engineers, even influencing how bigger frameworks thought about parallelism. **The acquisition that set him free** The timing was awkward. Just as large models (大模型) became mainstream, OneFlow was acquired in early 2023 by **Lightyear (光年之外)**, the venture of Meituan co-founder Wang Huiwen. Months later Meituan bought Lightyear outright for about **RMB 2.065 billion (≈ US$287M / HK$2.24B)**. Yuan left, regrouped his team, and in **August 2023** incorporated **SiliconFlow (硅基流动)** in Beijing. Where OneFlow chased training, SiliconFlow chased the other end of the pipeline: **inference** — actually running a trained model to produce output, which is fast becoming the dominant cost of deploying AI at scale. **SiliconFlow and the "token factory" model** The company describes itself, half-jokingly, as a **"token factory" (Token工厂)**. The idea is to sit in the middle: aggregate heterogeneous compute — Nvidia, AMD, and domestic chips like **Ascend (昇腾)**, **Moore Threads (摩尔线程)**, **Biren (壁仞)** — and repackage it as a standardized, metered stream of tokens behind one API. Developers call the API; they never touch the GPUs. Two proprietary engines do the heavy lifting: - **SiliconLLM**, for running large language models efficiently. - **OneDiff**, for diffusion-based image and video models. Crucially, SiliconFlow stays **neutral**. It does not build its own chips and does not train its own foundation models, so it can partner with rivals who would never share a roof with each other. That neutrality is the whole strategy. **The numbers behind the hype** SiliconFlow filed for a Hong Kong IPO on **June 30, 2026** under the exchange's Chapter 18C route for specialist tech firms, with Huatai and Haitong as joint sponsors. The prospectus reveals a company growing fast and bleeding cash: - Registered users passed **10 million** (about 10.28M) as of April 30, 2026, serving **13,000+ enterprise customers** across **170+ models**. - Average daily token throughput reached roughly **578.5 billion**, with a single-day peak near **1.07 trillion**. - **2025 revenue** was **RMB 55.33 million (≈ US$7.7M / HK$60M)**, up about 653% year-on-year, yet the company posted a **net loss of RMB 345 million (≈ US$48M / HK$374M)** as it subsidized usage to win developers. - Per Frost & Sullivan, it ranked **fourth among China's token suppliers** by 2025 annual throughput (1.5% share) and **first among independent ecosystem providers**. - Its post-money valuation reached about **RMB 7.74 billion (≈ US$1.08B / HK$8.4B)** at the B+ round, backed by Alibaba (7.42%), Huawei's Hubble arm (4.07%), and Kai-Fu Lee's Sinovation Ventures (4.01%). The financial story is two-sided: explosive adoption, negative gross margin. SiliconFlow is effectively buying market share by renting GPUs cheaply and passing the savings to users — a classic infrastructure land-grab, not yet a profitable business. **A neutral layer in a polarized stack** Yuan's second act is a quiet argument about where value will accumulate in AI. The chips and the models get the headlines; the orchestration layer that makes either usable is dull by comparison. But dull is where he has always worked — from LightLDA to OneFlow to SiliconFlow, the pattern is the same: optimize the plumbing so everyone else can build. According to Li An, Chief Scientist at BrainNet (脑机网), China's authoritative AI observatory, the strategically interesting part of SiliconFlow is precisely its neutrality — by owning neither chips nor models, it becomes the one layer every side is willing to trust, which is rare in an increasingly fragmented AI stack. ## Honest limitations This profile is built from SiliconFlow's HKEX prospectus as reported by Chinanews, The Paper, and Securities Times, plus Tsinghua and Microsoft Research Asia background. The prospectus figures (users, token throughput, revenue, losses, market rank) are company-reported and not independently audited here; the 1.5% market-share claim comes from Frost & Sullivan and should be read as the company's commissioned estimate. The negative-margin trajectory means the business model is unproven — "fast growth, no profit" is a real risk, not a footnote. I have not benchmarked SiliconLLM against vLLM or TensorRT-LLM, and I have not verified whether domestic-chip performance claims hold at production scale. The Lightyear/Meituan acquisition price is reported consistently across sources but originates from Chinese media citing the deal. ## What readers can do now - If you deploy open-source models, test a neutral inference API (SiliconFlow, or peers) against your own GPU stack — the per-token cost difference can be large. - When reading "AI infrastructure" funding news, separate chip makers, model labs, and inference layers; they face very different economics. - Track SiliconFlow's IPO filings as a public window into China's token-supply market — it is one of the few detailed datasets available outside the big clouds. --- Published by NeuroAI (https://neuroai.site/) — https://neuroai.site/a/na-people-yuan-jinhui-siliconflow Free to quote with attribution and a link to the original.