Hi, I am Diyu Zhou

Related Courses: Physical Interaction, Python Coding, Design Thinking, Parametric Design, Additive and Subtractive Manufacturing

Honors: Outstanding Student (2021-2023), Dangui Scholarships (2021-2023), Outstanding Graduate, Outstanding Graduate, Central China Normal University (2024)

Related Courses: New Media, Interactive Design, Art Coding and Game Engine, Digital Imaging

Adaptive Patience: Learning When Proactive AI Should Offer Help in Spatial Search Tasks

• Developed multiple VR agents in Unreal Engine 5, integrating GPT-based language models and natural language recognition systems to support proactive and reactive interactions for wayfinding and task assistance.

• Conducted pilot usability studies and optimized inverse kinematics, agent triggering mechanisms, and interaction strategies based on user feedback.

• Recorded and analyzed head movements, hand gestures, and interaction data from 78 participants to inform AI behavior modeling and training using state machines and behavior trees.

• Conducted a comparative user study with 20 participants to evaluate AI agent interaction strategies and provide design insights for proactive human-AI interaction in VR.

HSOI Dataset Construction and the Impact of Environment Articulation on Interaction and Motion Generation

• Developed a 3.5 × 3.5 m OptiTrack-based capture environment with synchronized tracking of articulated objects and human interactions for HSOI data collection.

• Captured high-fidelity full-body motion and active finger articulation by combining optical motion capture with IMU-based data gloves.

• Processed motion capture data in Blender through skeletal retargeting and character rigging to produce animation-ready sequences.

• Developing a large-scale Human-Scene Object Interaction (HSOI) dataset integrating human motion, articulated object states, and interaction annotations to support research on environment articulation and motion generation.

ProActive-RehabVR: Design and Evaluation of an IMU-Driven VR Serious Game for Postoperative ACL Rehabilitation

• Developed an IMU-based motion capture system for real-time tracking of human movement and collection of range-of-motion (ROM) and foot progression angle (FPA) from rehabilitation patients.

• Integrated motion data with conventional rehabilitation exercises to support early-stage functional recovery after surgery and enhance training precision.

• Implemented multi-view visualization and immersive VR game mechanisms to improve patients' proprioception, motivation, and engagement during rehabilitation.

• Collaborated with rehabilitation medicine specialists and human-centered design experts through multiple interviews, refining interaction design and system usability based on expert feedback.

• Evaluated the effectiveness of a VR-based rehabilitation system through a 60-participant randomized controlled trial, comparing functional recovery and user experience with conventional rehabilitation using ROM, FPA, gait trajectory, SUS, and IMI.

NavSense: Studying the Timing and Presentation of AR Wayfinding Guidance

• Developed a state-aware AR wayfinding system on Meta Quest 3, integrating visual positioning, route tracking, and real-time navigation-state detection to adapt when and how guidance is presented.

• Contributed to constructing the State-Aware Egocentric Navigation (SAEN) dataset with 44 participants, integrating egocentric RGB video, 6-DoF head pose, and continuous wayfinding-state annotations for cross-user state detection.

• Developed and evaluated decision-point and backtracking detectors using egocentric vision and head-pose trajectories, enabling real-time guidance triggered by observable navigation states.

• Conducted an in-situ study with 20 participants comparing always-on versus state-aware guidance and egocentric arrow versus allocentric map representations, analyzing usability, workload, trust, navigation behavior, and qualitative experience.

Immersive and Disability Arts Exhibitions, Museums and Galleries

• Collaborated with PhD researchers to develop an immersive experiential installation exploring human perceptions of time through spatial storytelling and interactive media.

• Designed and created three immersive environments representing natural temporal changes, the evolution of an aging house, and the life journey of an individual, and presented the work in a public exhibition.

The Valley of Ashes: Archaeology of the American Psyche

• Processed and optimized high-resolution 3D scans through mesh cleanup, decimation, and UV remapping for efficient real-time AR visualization.

• Applied digital sculpting and restoration techniques to reconstruct obscured surface features, revealing historical graffiti and architectural markings.

• Supported the deployment of reconstructed cultural heritage assets in AR environments for interactive visualization and interpretation.

From Scaffold to Autonomy: How Mixed Reality Visualization Modalities Shape Psychomotor Skill Learning

• Assisted in developing an AR-based knee arthroscopy training system using Unreal Engine 5 and Meta Quest 3 to support simulation-based surgical education.

• Designed dual XR guidance modes, including in-situ and ex-situ visual cues, to assist trainees in identifying and practicing accurate puncture points during arthroscopic procedures.

• Implemented a data acquisition module to record puncture trajectories and hand movement patterns for evaluating the usability and efficiency of different guidance strategies.

• Collaborated with surgical experts to refine system interaction design, aiming to enhance the realism and pedagogical value of preoperative training.

• Contributed to an ACL surgical navigation system integrating optical tracking and coordinate transformation, deployed on HoloLens using Unity.

• Developed multimodal visual, haptic, and auditory guidance for orthopedic bone-drilling tasks and supported comparative system evaluation.

Effects of Daylight Intensity on Emotion Regulation in a Virtual Healing Space

• Co-designed a VR healing environment in Unreal Engine 4 with dynamic daylight conditions to investigate the effects of light intensity on emotional regulation.

• Conducted semi-structured interviews with 30 participants to evaluate how daylight intensity influenced emotional responses and perceived relaxation.

• Conducted user research and market analysis to define target personas and guide the design direction of multiple medical products.

• Collaborated with cross-functional teams to develop innovative, user-friendly medical solutions that align with clinical needs and regulatory standards.

• Designed intuitive product interfaces and streamlined design workflows to enhance usability, compliance, and development efficiency.