LLM Post-Training & Agentic AI Research 大模型后训练与 Agentic AI 研究
Zhihui Chen 陈致晖
Ph.D. Student in Artificial Intelligence, National University of Singapore
新加坡国立大学人工智能博士生

Post-training for large multimodal models — reward design, preference alignment (DPO/RLHF/RLVR), verifier-in-the-loop evaluation — plus agent systems built end to end. Open to LLM research internship opportunities. 多模态大模型后训练——奖励设计、偏好对齐(DPO/RLHF/RLVR)、验证器闭环评测——并端到端构建 Agent 系统。欢迎大模型研发实习机会。

Post-Training & Alignment 后训练与对齐研究 Multimodal Agents · Clinical AI 多模态 Agent · 临床 AI
Agentic Post-Training @ ByteDance — Farsight, first-author ICLR 2026 under review 字节跳动 · Agentic 后训练 —— Farsight,一作 ICLR 2026 在投
Speech Foundation Model @ StepFun — StepAudio2.5 pre-training data governance 阶跃星辰 · 语音基座模型 —— StepAudio2.5 预训练数据治理
Portrait

PhD student in Artificial Intelligence at the National University of Singapore, supervised by Prof. Mengling Feng.

I work on post-training for large (multimodal) language models and on agent harnesses that hold up outside the lab. Healthcare is my primary application domain, not the boundary of my research.

新加坡国立大学人工智能博士生,导师为 冯梦凌教授

研究聚焦(多模态)大模型后训练,以及能在真实场景落地的 Agent 工程。医疗是我的主要应用场景,而非研究边界。

Curriculum Vitae 个人简历
At a Glance 数据一览
ByteDance · StepFun · Tencent字节 · 阶跃 · 腾讯
research internships & elite talent programs 研发实习与顶尖人才计划
Agentic Post-Training (ByteDance) · StepAudio2.5 (StepFun) · Qingyun Program & Quant Infra Grant (Tencent) Agentic 后训练(字节)· 语音基座模型 StepAudio2.5(阶跃)· 腾讯青云计划与量化基础设施资助
33
top-tier NLP main conference papers 篇顶级 NLP 主会议论文
ACL 2026, EMNLP 2026 & EMNLP 2025 Main · ICLR 2026 first-author under review ACL 2026、EMNLP 2026 与 EMNLP 2025 主会议 · ICLR 2026 一作在投
88K+88K+
agentic editing trajectories with preference labels 带偏好标注的 Agent 编辑轨迹
Med-Banana (EMNLP 2026 Main): DPO-ready signal from success & failure trajectories · 100K+ HF downloads Med-Banana(EMNLP 2026 主会议):从成败轨迹构建可直接用于 DPO 的信号 · HF 100K+ 下载
53★53★
GitHub stars — open-source office agent GitHub 星标 — 开源办公 Agent
OfficeBuddy: Vision-in-the-Loop open-source Word/Excel agent OfficeBuddy:Vision-in-the-Loop 开源 Word/Excel Agent
Selected Papers 精选论文 (view all ) (查看全部
Med-Banana: Learning Agentic Quality-Controlled Medical Image Editing from Success-and-Failure Trajectories
Med-Banana: Learning Agentic Quality-Controlled Medical Image Editing from Success-and-Failure Trajectories 🔗

Zhihui Chen, Qingyuan Lei, Mengling Feng

Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted · Main Conference

Text-guided medical image editing must deliver the requested pathology while preserving anatomy, modality-specific appearance, and clinical plausibility. Existing datasets supervise editors only with accepted final edits and discard the failed attempts produced during generation. We argue that failures are indispensable supervision for agentic post-training: they specify what should be rejected, why an edit is medically or visually invalid, and how the instruction should be revised. We present Med-Banana, a trajectory-supervised framework that jointly trains an editor, a verifier, and a refiner for an edit-verify-refine inference loop, together with Med-Banana-80K, a large-scale resource of success-and-failure editing trajectories comprising candidate images, verification outcomes, rejection reasons, and prompt refinements (50,635 accepted + 37,822 rejected trajectories). Experiments with MLLM judges, blind expert assessment, and separability probes show consistent gains over open medical image editors. Code and data are publicly available.

Med-Banana: Learning Agentic Quality-Controlled Medical Image Editing from Success-and-Failure Trajectories 🔗

Zhihui Chen, Qingyuan Lei, Mengling Feng

Conference on Empirical Methods in Natural Language Processing (EMNLP) 2026 Accepted · Main Conference

Text-guided medical image editing must deliver the requested pathology while preserving anatomy, modality-specific appearance, and clinical plausibility. Existing datasets supervise editors only with accepted final edits and discard the failed attempts produced during generation. We argue that failures are indispensable supervision for agentic post-training: they specify what should be rejected, why an edit is medically or visually invalid, and how the instruction should be revised. We present Med-Banana, a trajectory-supervised framework that jointly trains an editor, a verifier, and a refiner for an edit-verify-refine inference loop, together with Med-Banana-80K, a large-scale resource of success-and-failure editing trajectories comprising candidate images, verification outcomes, rejection reasons, and prompt refinements (50,635 accepted + 37,822 rejected trajectories). Experiments with MLLM judges, blind expert assessment, and separability probes show consistent gains over open medical image editors. Code and data are publicly available.

Looking Ahead to Stay Grounded: Future-Discounted Visual Credit Assignment for VLM Reinforcement Learning

Zhihui Chen, Yike Yun, et al.

ICLR 2026 submission Under Review First Author

Farsight targets a core failure mode of RLVR post-training for vision-language models: token-level credit assignment that only rewards instant visual dependence, which lets models drift into ungrounded reasoning over long horizons. We extend credit assignment to future-discounted visual grounding — a token earns visual credit not only for the evidence it uses now, but for how that evidence supports discounted future reasoning steps — encouraging policies that stay anchored to the image across multi-step chains of thought. Developed during my Agentic Post-Training research internship at ByteDance (Singapore).

Looking Ahead to Stay Grounded: Future-Discounted Visual Credit Assignment for VLM Reinforcement Learning

Zhihui Chen, Yike Yun, et al.

ICLR 2026 submission Under Review First Author

Farsight targets a core failure mode of RLVR post-training for vision-language models: token-level credit assignment that only rewards instant visual dependence, which lets models drift into ungrounded reasoning over long horizons. We extend credit assignment to future-discounted visual grounding — a token earns visual credit not only for the evidence it uses now, but for how that evidence supports discounted future reasoning steps — encouraging policies that stay anchored to the image across multi-step chains of thought. Developed during my Agentic Post-Training research internship at ByteDance (Singapore).

MedForge: Interpretable Medical Deepfake Detection via Forgery-aware Reasoning
MedForge: Interpretable Medical Deepfake Detection via Forgery-aware Reasoning 🔗

Zhihui Chen, Kai He, Qingyuan Lei, Bin Pu, Jian Zhang, Yuling Xu, Mengling Feng# (# corresponding author 通讯作者)

Annual Meeting of the Association for Computational Linguistics (ACL) 2026 Main Conference

As generative models improve, medical deepfakes that implant or remove lesions while staying visually plausible pose growing risks to clinical safety and the integrity of medical evidence. Most prior work reduces detection to binary real-vs-fake scoring with little insight into where manipulation occurs or why. We present MedForge, an interpretable framework that introduces MedForge-90K—the first large-scale explainable medical deepfake dataset spanning CT, MRI, and X-ray, covering 19 lesion types with forgeries from 10 state-of-the-art deepfake models, each paired with expert-guided localization and clinical-grade explanations—and MedForge-Reasoner, a detector trained with a Localize-then-Analyze chain-of-thought paradigm and Forgery-aware GSPO reinforcement learning. MedForge-Reasoner achieves state-of-the-art detection while producing localized, verifiable medical rationales.

MedForge: Interpretable Medical Deepfake Detection via Forgery-aware Reasoning 🔗

Zhihui Chen, Kai He, Qingyuan Lei, Bin Pu, Jian Zhang, Yuling Xu, Mengling Feng# (# corresponding author 通讯作者)

Annual Meeting of the Association for Computational Linguistics (ACL) 2026 Main Conference

As generative models improve, medical deepfakes that implant or remove lesions while staying visually plausible pose growing risks to clinical safety and the integrity of medical evidence. Most prior work reduces detection to binary real-vs-fake scoring with little insight into where manipulation occurs or why. We present MedForge, an interpretable framework that introduces MedForge-90K—the first large-scale explainable medical deepfake dataset spanning CT, MRI, and X-ray, covering 19 lesion types with forgeries from 10 state-of-the-art deepfake models, each paired with expert-guided localization and clinical-grade explanations—and MedForge-Reasoner, a detector trained with a Localize-then-Analyze chain-of-thought paradigm and Forgery-aware GSPO reinforcement learning. MedForge-Reasoner achieves state-of-the-art detection while producing localized, verifiable medical rationales.

DivScore: Zero-Shot Detection of LLM-Generated Text in Specialized Domains
DivScore: Zero-Shot Detection of LLM-Generated Text in Specialized Domains 🔗

Zhihui Chen, Kai He, Yucheng Huang, Yunxiao Zhu, Mengling Feng

Conference on Empirical Methods in Natural Language Processing (EMNLP) 2025 Main Conference

Detecting LLM-generated text in specialized and high-stakes domains like medicine and law is crucial for combating misinformation and ensuring authenticity. We propose DivScore, a zero-shot detection framework using normalized entropy-based scoring and domain knowledge distillation to robustly identify LLM-generated text in specialized domains. Experiments show that DivScore consistently outperforms state-of-the-art detectors, with 14.4% higher AUROC and 64.0% higher recall at 0.1% false positive rate threshold.

DivScore: Zero-Shot Detection of LLM-Generated Text in Specialized Domains 🔗

Zhihui Chen, Kai He, Yucheng Huang, Yunxiao Zhu, Mengling Feng

Conference on Empirical Methods in Natural Language Processing (EMNLP) 2025 Main Conference

Detecting LLM-generated text in specialized and high-stakes domains like medicine and law is crucial for combating misinformation and ensuring authenticity. We propose DivScore, a zero-shot detection framework using normalized entropy-based scoring and domain knowledge distillation to robustly identify LLM-generated text in specialized domains. Experiments show that DivScore consistently outperforms state-of-the-art detectors, with 14.4% higher AUROC and 64.0% higher recall at 0.1% false positive rate threshold.

All publications 全部论文
Research Value 研究价值
Post-Training & Alignment 后训练与对齐

Reward design and RL loops for multimodal LLMs 多模态大模型的奖励设计与 RL 闭环

Farsight extends RLVR credit assignment from instant visual dependence to future-discounted visual grounding; Med-Banana turns success-and-failure trajectories into DPO-ready post-training signal. Farsight 将 RLVR 信用分配从「即时视觉依赖」扩展到「未来折扣视觉锚定」;Med-Banana 将成败轨迹转化为可直接用于 DPO 的后训练信号。

ACL 2026 Main · EMNLP 2026 Main · Farsight (ICLR 2026 sub) ACL 2026 主会议 · EMNLP 2026 主会议 · Farsight(ICLR 2026 在投)
Verifier & Eval Design 验证器与评测设计

Evidence-grounded evaluation under domain shift 领域偏移下的证据驱动评测

DivScore is a zero-shot verifier: a normalized-entropy scorer with theoretical guarantees that generalizes across medical and legal domains without domain-specific labels. DivScore 是一个零样本验证器:带理论保证的归一化熵评分器,无需领域特定标注即可泛化至医疗与法律领域。

EMNLP 2025 Main · +14.4% AUROC · +64.0% recall EMNLP 2025 主会议 · +14.4% AUROC · +64.0% 召回
Agents & Systems Agent 与系统

Agent harnesses with vision in the loop Vision-in-the-Loop 的 Agent 框架

OfficeBuddy puts vision in the loop: plan → act → real Word/Excel render → independent visual verifier → targeted repair, with budgeted retries and prompt-injection defense. OfficeBuddy 将视觉引入编辑闭环:计划 → 执行 → 真实 Word/Excel 渲染 → 独立视觉验证器 → 定向修复,内置预算化重试与提示注入防御。

53★ on GitHub · Vision-in-the-Loop GitHub 53★ · Vision-in-the-Loop
MedForge
Interpretable medical deepfake detection 可解释医学深度伪造检测

MedForge MedForge

Detects medically plausible image forgeries through localized evidence, expert-aligned reasoning, and a Localize-then-Analyze detector. 通过定位证据、专家对齐推理与先定位再分析检测器,识别医学上看似合理的影像伪造。

ACL 2026 Main ACL 2026 主会议 19 lesion types 19 类病灶 10 deepfake models 10 种伪造模型
Tencent Cloud Quant Infrastructure Grant
Low-latency APAC trading backbone 低延迟亚太交易骨干网

Tencent Cloud Quant Infrastructure Grant 腾讯云量化基础设施资助

Low-latency Hong Kong / Singapore nodes interconnected over Tencent's CCN private backbone instead of the public internet — for latency-sensitive trading and agent workloads. 香港 / 新加坡低延迟节点,经腾讯 CCN 私有骨干网而非公网互联——支撑延迟敏感的交易与 Agent 工作负载。

Tencent Cloud International 腾讯云国际 USD 1,000 cloud credits 1000 美金云算力额度 Low-Latency APAC · CCN Backbone 低延迟亚太 · CCN 骨干网
MiniMax Cowork Team Fellowship
Medical foundation model development and clinically verifiable Agent workflows 医疗大模型开发与临床可验证 Agent 工作流

MiniMax Cowork Team Fellowship MiniMax Cowork Team Fellowship

A compute-supported project connecting long-context, multimodal, and Agent capabilities with medical foundation model development and verifiable decision paths. 将长上下文、多模态与 Agent 能力连接到医疗大模型开发与可验证决策路径的算力支持项目。

MiniMax Cowork Team MiniMax Cowork Team USD 4,500 compute grant 4500 美金算力支持 Medical Foundation Models 医疗大模型开发
OfficeBuddy
Vision-in-the-Loop open-source office agent Vision-in-the-Loop 开源办公 Agent

OfficeBuddy OfficeBuddy

Open-source Word/Excel agent (53★): every edit is re-rendered through real Microsoft Office and audited by an independent visual verifier before the loop moves on. 开源 Word/Excel Agent(53★):每步编辑经真实 Microsoft Office 重新渲染,并由独立视觉验证器审查后才继续。

53★ open source · GitHub GitHub 53★ 开源项目 Vision-in-the-Loop Vision-in-the-Loop Model-agnostic (Kimi-K2 / MiniMax-M3) 模型无关(Kimi-K2 / MiniMax-M3)
Background 教育与经历
Education 教育经历
  • National University of Singapore
    National University of Singapore
    Multimodal LLM post-training · medical AI · trustworthy AI
    Ph.D. in Artificial Intelligence
    Jan. 2025 - present
  • The University of Hong Kong
    The University of Hong Kong
    M.Sc. in Artificial Intelligence
    Sep. 2022 - Jul. 2024
  • The Chinese University of Hong Kong, Shenzhen
    The Chinese University of Hong Kong, Shenzhen
    B.Sc. in Statistics, Data Science Stream
    Sep. 2018 - May. 2022
  • 新加坡国立大学
    新加坡国立大学
    多模态大模型后训练 · 医疗 AI · 可信 AI
    人工智能博士
    2025年1月 - 至今
  • 香港大学
    香港大学
    人工智能理学硕士
    2022年9月 - 2024年7月
  • 香港中文大学(深圳)
    香港中文大学(深圳)
    统计学理学学士(数据科学方向)
    2018年9月 - 2022年5月
Experience 经历
  • ByteDance (Singapore)
    ByteDance (Singapore)
    Farsight — future-discounted visual credit assignment for RLVR · trajectory & preference data
    Agentic Post-Training Research Intern
    Jun. 2026 - Nov. 2026
  • Tencent · LightSpeed Studios (Photon, 光子)
    Elite research talent track · game-AI × LLM agent research
    Qingyun Program (青云计划) — Elite Research Talent, selected
    2026
  • StepFun (阶跃星辰)
    StepFun (阶跃星辰)
    StepAudio2.5 foundation model — pre-training data governance · ASR/TTS metadata schema
    Speech-LLM Research Intern
    Mar. 2025 - Jul. 2025
  • AQUMON (Hong Kong)
    LangChain orchestration over Futu OpenAPI real-time data & execution
    Quant Trading Agent Intern
    Jan. 2025 - Mar. 2025
  • NUS Business School
    NUS Business School
    Curriculum design · tutorials on pre-training, SFT and RLHF
    Teaching Assistant — "Generative AI and LLM"
    Feb. 2024 - Apr. 2024
  • 字节跳动(新加坡)
    字节跳动(新加坡)
    Farsight —— 面向 RLVR 的未来折扣视觉信用分配 · 轨迹与偏好数据体系
    Agentic 后训练 研发实习生
    2026年6月 - 2026年11月
  • 腾讯 · 光子工作室群
    精英科研人才计划 · 游戏 AI × 大模型 Agent 方向
    「青云计划」精英科研人才 入选
    2026
  • 阶跃星辰(StepFun)
    阶跃星辰(StepFun)
    StepAudio2.5 语音基座 —— 预训练数据治理 · ASR/TTS 元数据 schema
    语音大模型 研发实习生
    2025年3月 - 2025年7月
  • AQUMON(香港)
    LangChain Agent 编排 · 对接 Futu OpenAPI 实时行情与自动下单
    量化交易 Agent 研发实习生
    2025年1月 - 2025年3月
  • NUS 商学院
    NUS 商学院
    课程设计 · 预训练、SFT 与 RLHF 教学
    教学助理 —《Generative AI and LLM》
    2024年2月 - 2024年4月
Honors & Awards 荣誉与奖励
  • Qingyun Program (青云计划) — Tencent LightSpeed Studios, elite research talent
    2026
  • Tencent Cloud Quant Infrastructure Grant — USD 1,000 cloud credits
    2026
  • MiniMax Cowork Team Fellowship, USD 4,500 compute grant
    2026
  • Full Ph.D. Scholarship, National University of Singapore
    2025
  • Outstanding College Graduate (Top 5%), CUHK-Shenzhen
    2022
  • Undergraduate Research Excellence Award, CUHK-Shenzhen
    2021
  • 腾讯光子「青云计划」精英科研人才 入选
    2026
  • 腾讯云量化基础设施资助 —— 1000 美金云算力额度
    2026
  • MiniMax Cowork Team Fellowship,4500 美金算力支持
    2026
  • 新加坡国立大学全额博士奖学金
    2025
  • 香港中文大学(深圳)优秀毕业生(前 5%)
    2022
  • 香港中文大学(深圳)本科生科研卓越奖
    2021
Skills & Tech Stack 技术栈
Post-Training & Alignment
  • RLHF / RLVR pipeline design · DPO & reward modeling
  • Preference & trajectory data, data flywheels
  • Verifier and eval-loop design · SFT curriculum
Agents & Orchestration
  • ReAct agent harness · LangChain orchestration & tool-calling
  • Vision-in-the-Loop verification, budgeted retries & failure attribution
  • Kimi-K2 / MiniMax-M3 / Qwen3-VL / GPT integration
Serving & Foundations
  • vLLM / SGLang · llama.cpp GGUF quantization · Docker / FastAPI
  • Python · PyTorch · HuggingFace Transformers · Linux · Git
  • English (TOEFL 106, GRE 320) · Mandarin · Cantonese
后训练与对齐
  • RLHF / RLVR 流程设计 · DPO 与奖励建模
  • 偏好与轨迹数据、数据飞轮
  • 验证器与评测闭环设计 · SFT 课程
Agent 与编排
  • ReAct Agent 框架 · LangChain 编排与工具调用
  • Vision-in-the-Loop 视觉验证、预算化重试与失败归因
  • Kimi-K2 / MiniMax-M3 / Qwen3-VL / GPT 接入
推理服务与基础工具链
  • vLLM / SGLang · llama.cpp GGUF 量化 · Docker / FastAPI
  • Python · PyTorch · HuggingFace Transformers · Linux · Git
  • 英语(TOEFL 106, GRE 320)· 普通话 · 粤语
Academic Service 学术服务
  • 40+ reviews — ACL · NeurIPS · IJCAI · IEEE TAFFC · ACM TIST
    2024 - 2026
  • Program Committee, LASS 2026 Workshop @ ACM CIKM 2026 (Rome)
    2026
  • Session Chair, ACL 2026 Main
    2026
  • 累计 40+ 篇审稿 —— ACL · NeurIPS · IJCAI · IEEE TAFFC · ACM TIST
    2024 - 2026
  • ACM CIKM 2026 · LASS 2026 研讨会 程序委员会(PC)委员(罗马)
    2026
  • ACL 2026 主会议 Session Chair
    2026
Recent Updates 近期动态
News动态
2026
[Tencent Cloud] Awarded the Tencent Cloud Quant Infrastructure Grant (USD 1,000 cloud credits) — low-latency APAC nodes and CCN private-backbone interconnect for quantitative trading and agent workloads.
Aug 18
[EMNLP 2026] Med-Banana is accepted to the EMNLP 2026 Main Conference — agentic post-training for quality-controlled medical image editing from success-and-failure trajectories.
Aug 16
[Tencent] Selected for the Qingyun Program (青云计划) — Tencent LightSpeed Studios (Photon)'s elite research talent track, for game-AI × LLM agent research.
Aug 16
[ACM CIKM 2026] Invited to the Program Committee of LASS 2026 — the 2nd International Workshop on LLM Agents for Social Simulation, co-located with ACM CIKM 2026 in Rome (Nov 8), reviewing submissions on agentic social simulation, evaluation and safety.
Aug 04
[ICLR 2026] Submitted Farsight as first author — future-discounted visual credit assignment for VLM reinforcement learning, developed during my ByteDance internship.
Jul 05