Zuchen Li

I'm Zuchen Li. My research is about making technology better at helping people stay healthy and happy and enjoy their lives. I'm an undergraduate at the University of Michigan, triple majoring in Computer Science, Data Science, and Statistics, with minors in History and Meteorology.

My research spans a broad range. I started in high-dimensional statistics for wearable sensor data, advised by Prof. Kerby Shedden, then joined the Human Centered Computing Lab, where I'm advised by Profs. Ke Sun and Anhong Guo and have also worked with Profs. Junyi Zhu, Xu Wang, Alanson Sample, and Kang G. Shin.

I've played the guzheng and guqin since I was a child, and that love of music led me to work with Prof. Herman Dong on SuperConductor, where gestures steer a real-time music model and the MagicBaton is to become the conductor's instrument, and on Strokes of Sonic Tradition, AI that reads jianzipu guqin tablature and aligns it with living performance.

I'm applying to PhD programs in HCI and mobile AI for Fall 2027.

Research

* equal contribution

arXiv preprintCHI 2027 under review Context-aware systems

Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks

Muzhe Wu*, Zuchen Li*, Xu Wang, Anhong Guo

Live, contextualized visual instructions generated from the learner's own workspace, on a mixed-reality headset.

Projects

5 projects · 34 clips

Inside the baton: two MPU-6050s 15 cm apart and an ESP32 in a 39.78 cm printed body.
The build: the open shell with the ESP32 and both IMUs wired, and the finished baton.
Why two IMUs: arm motion cancels in the difference, the baton's own turn remains.
From gesture to sound: baton, BLE, laptop, WebSocket, browser, three musical channels.
Each recognised gesture gets its own visual: idle, shake, spin, beat.
The IMU difference signal feeds a CNN, an RNN, an SVM and a random forest.
About 99% when users are mixed; 70.6% on a person the model has never seen.
CNN confusion for mixed users vs a held-out user: beat and slash blur together.

EECS 498: Machine Learning for Computational Sensors in Mobile/IoT Systems · 2026 winter · Project lead

MagicBaton

Gesture-based human–AI music interaction — a dual-IMU smart conducting baton driving real-time generation.

Work
Hardware prototyping · Embedded firmware · Dataset collection · Model training and evaluation · Real-time interaction · Generative music
Used
ESP32 · I²C and BLE · MPU-6050 IMUs · Rigid-body kinematics · Onshape CAD · 3D printing · PyTorch · 1-D CNN and BiGRU · SVM and random forest · Leave-one-person-out CV · Jerk-based onset detection · WebSocket · Tone.js · Magenta MusicRNN

News

Oct 2026
Strokes of Sonic Tradition, a guqin and AI project I work on with Prof. Herman Dong, received $343K from Schmidt Sciences' Humanities and AI Virtual Institute.
Sep 2026
Generative Tutorial is out on arXiv.
2026
MoiréDeform is a demo at ACM MobiCom 2026 in Austin, TX.
2026
Received the UROP Summer Engineering Fellowship at the University of Michigan.
Sep 2025
Joined the Human Centered Computing Lab at the University of Michigan.
Jun 2025
Spent the summer at Waseda University in Tokyo, researching postwar Japanese literature and history.

Experience

Sep 2025 – now

Human Centered Computing Lab, University of Michigan

Undergraduate Research Assistant

  • Generative Tutorial (co-first author; with Profs. Anhong Guo and Xu Wang) — co-developed a conceptual framework and AR system for live contextualized visual instruction that grounds physical-task goals in users' workspaces and proactively generates workspace-specific goal images and demonstration videos by propagating observed and predicted visual states across task dependencies; co-led a formative evaluation of 176 generated artifacts across 15 tasks and a 24-participant comparative study, showing improved task quality, perceived workspace correspondence, and shorter step-confirmation intervals over pre-authored guidance.
  • MoiréDeform (co-first author, ACM MobiCom '26 Demo; with Profs. Alanson Sample and Ke Sun) — developed a low-cost camera-based sensing approach that exploits naturally occurring woven textures as virtual moiré layers to amplify subtle surface deformation, enabling continuous body-lean interaction and respiratory waveform/rate sensing on an unmodified mesh chair without instrumenting the user or surface; reduced respiratory-rate MAE from 2.07 to 0.71 breaths/min relative to physical-marker tracking.
  • RespiraFrame (with Prof. Junyi Zhu) — contributed to the experimental design and evaluation of an eyeglass-based multimodal respiratory sensing system combining bone-conduction acoustics and electrical impedance tomography (EIT); designed evaluation protocols spanning respiratory behaviors, motion and environmental interference, a three-day semi-wild study, and repeated wear over a four-week longitudinal study.
  • VeilLens (co-first author; with Prof. Ke Sun) — developed an agentic visual privacy framework that autonomously discovers, localizes, and selectively edits weak compositional cues exploited by VLMs, supporting granular user control and iterative verification of residual privacy leakage across identity, geolocation, affiliation, and social-relationship risks.
Sep 2025 – now

Generative AI for Music and Audio, University of Michigan

Research Assistant, advised by Prof. Herman Dong

Investigating real-time human–GenAI co-creation for controllable music generation, focusing on interaction mechanisms that preserve user agency, expressive control, and iterative creative feedback; prototyping gesture-driven interaction techniques that connect embodied user input to real-time musical control and generative model behavior.

Jan – May 2025

Energy Distance Dimension Reduction, University of Michigan

Selected Researcher, Undergraduate Research Program in Statistics (URPS), advised by Prof. Kerby Shedden

Developed engression and sufficient dimension reduction methods for multilevel, dyadic, and longitudinal wearable data from bone marrow transplant patients, addressing non-i.i.d. structure not handled by existing methodology; implemented SDR algorithms in JAX with GPU acceleration, achieving approximately 7,000× speedup over the original method for U-statistic computation on large sensor data series.

May – Aug 2024

Lab of Atmospheric and Earth System Sciences, Nanjing University

Summer Research Intern, advised by Prof. Minghuai Wang

Studied statistical machine learning methodologies for integrating real-world sensor observations with simulated atmospheric data, enabling inference and prediction of aerosol–cloud interactions across larger spatial and temporal scales.

Aug 2023 – May 2024

E2-E Lab, University of Illinois Urbana-Champaign

Undergraduate Research Assistant

Conducted airflow experiments and processed PIV/camera data using Python, OpenCV, and OpenPIV for flow-field reconstruction and particle tracking; performed CFD simulations in ANSYS Fluent to analyze particle–airflow interactions in complex 3D geometries.

Honors & awards

2026
UROP Summer Engineering Fellowship, University of Michigan
2024 – 2026
University Honors, University of Michigan
2022
Outstanding Research Paper Award, IMMC Greater China Round — top 1.875% of 800+ teams
2022
Finalist Research Paper Award, IMMC International Round — top 8.75% internationally

Beyond research

Jun – Aug 2025

Waseda University, Tokyo

Summer Intern

Researched postwar Japanese literature and history, analyzing literary works in relation to historical memory, identity, and social transformation in postwar Japan.

Zuchen with arms spread on the rim of Mount Fuji's summit crater, July 2025
Aug 2025 – Jul 2026

The Michigan Daily

Student Reporter, Photographer & Videographer

Produced campus and local news coverage through interviews, field reporting, photography, and video. Some frames end up in the photo gallery.

Front page of the print edition of The Michigan Daily, Wednesday, January 29, 2025
Member

Kendo Club at the University of Michigan

Regular practice in footwork, striking technique, partner drills, and traditional Japanese swordsmanship.

Two club members in kendo armor facing each other with bamboo swords raised
Student Forecaster

Illinois Student Organization of Meteorology (ISTORM)

Student chapter of the American Meteorological Society, focused on severe and hazardous weather forecasting.

A supercell thunderstorm wheeling over a farmhouse on the Kansas plains