arXiv 2026
01About
Shuai is a PhD student at MMLab@NTU, supervised by Prof. Ziwei Liu.
Prior to this, I was a Founding Team Member at Synvo AI, advised by Prof. Chen Change Loy. I obtained my MEng (by Research) degree at MMLab@NTU, where I was fortunate to be advised by Prof. Ziwei Liu and to have received kind and valuable guidance from Jingkang Yang and Bo Li. I obtained my bachelor's degree in Artificial Intelligence from BUPT in 2024.
Additionally, I had a wonderful time as an intern at the Shanghai AI Laboratory under the mentorship of Prof. Ziwei Liu.
My research lies in Multimodality, Egocentric AI, and Agent.
Feel free to reach out for collaborations, questions, or just to chat!
02News
▌
2026
- Aug 02 Demo-ICL is accepted by ACL 2026 Findings.
- Aug 02 EgoTools: Tool-Centric Reasoning in Real-World Egocentric Videos is accepted by ACL 2026.
- Jul 29 HumanCLAW is released — can VLMs truly act through a body, or do they lose track of themselves in the physical world?
- Jun 18 HippoCamp is accepted by ECCV 2026.
- Apr 07 FileGram is out — what if your OS agent could learn who you are just by watching how you work with files?
- Apr 01 Habitus is now in beta — your Mac gets a memory. It remembers how you work so you don't have to repeat yourself.
- Mar 08 HippoCamp is out — we collected 3 real people's entire digital lives to build the first file-system memory dataset.
- Feb 11 Released Engram Teams — upgraded version with team-based AI workflow support.
- Feb 09 Demo-ICL is released — in-context learning for procedural video knowledge acquisition.
- Feb 02 Released Engram — a privacy-first AI memory layer.
- Jan 31 Graduated from NTU with MEng (by Research). Thesis: Egocentric Perception and Memory.
- Jan 01 New blog post at Synvo AI: The Digital Avalanche: Building the Memory Layer for Next-Gen Corporation AI Agents.
2025
- Apr 29 Aero-1-Audio: Our first generation of lightweight audio models, outperforming Whisper and Qwen-2-Audio.
- Mar 01 EgoLife is accepted by CVPR 2025.
- Jan 23 LMMs-Eval is accepted by NAACL 2025 Findings.
- Jan 01 Joined Synvo AI as a Founding Team Member.
2024
- Aug 13 Joined MMLab@NTU as a master student.
- Jul 17 Released LMMs-Eval, a comprehensive benchmark for evaluating Large Multimodal Models.
- Jul 01 Octopus is accepted by ECCV 2024.
- Jun 12 Released lmms-eval/v0.2.0 to support video evaluations.
2023
- Oct 12 Introduced Octopus, an embodied vision-language programmer that plays GTA-V.
- Aug 20 PSG4D is accepted as NeurIPS 2023 Spotlight.
04Projects
Habitus
A proactive AI agent built on FileGram's behavioral trace and content delta philosophy. Turns the proactive agent setting from research into a real product.
Engram Suite
Privacy-first AI memory layer — "Signal for AI Memory." End-to-end encrypted memory system for AI assistants with zero-knowledge sync.
Cocoa Suite
A local AI assistant that transforms files into actionable memory through semantic understanding. Fully private, on-device, zero cloud dependency.