HAI Lab

Health and Affective Intelligent

Zhaojie Luo

Dr. Zhaojie Luo

Deputy Director, Department of Brain and Learning Science, School of Biological Science and Medical Engineering; Huawei Zijin Young Scholar

Biography

Dr. Luo received his M.S. and Ph.D. degrees from Kobe University, Japan. After graduation, he served as a Research Associate at the National University of Singapore and Osaka University (2019–2020), a Specially Appointed Assistant Professor (2020–2022), and was exceptionally promoted to Tenure-Track Assistant Professor at Osaka University (2022–2024). He has published over 30 papers in top-tier journals and conferences in the fields of speech and multimedia, including IEEE/ACM TASLP (2023 Hot Paper), IEEE TMM, IEEE TETCI, IEEE TCSVT, INTERSPEECH, and has won honors such as the Best Paper Award at the Japanese AI Conference. He served as Session Chair of APSIPA 2023, Guest Editor of *Electronics*, and Special Session Organizer of IEEE ICIT 2024. He is a formal member of Sigma Xi, The Scientific Research Honor Society. In technology transfer, he has been awarded 8 innovation & entrepreneurship grants (3 local, 5 national). Since 2019, he has served as a startup mentor for the Western Japan region, invited by the Chinese Consulate in Osaka, advising students from over 30 universities.

Admissions

Students with backgrounds in Computer Science, Electronic Information, Automation, or Biomedical Engineering (electrical-related fields) are warmly welcome to contact me (around 3 positions available). Outstanding candidates may be recommended for short-term research visits (3–6 months) or Ph.D. studies at Takiguchi Lab (Kobe University), Ishiguro Lab (Osaka University, a world-renowned robotics lab), or Prof. Haizhou Li’s Lab (IEEE Fellow, National University of Singapore). In addition, there are 2–3 openings each year for joint Ph.D. programs between Southeast University and Tokyo University of Science (formerly Tokyo Tech, ranked top 5 in Japan) or Tokyo University of Agriculture and Technology (Ph.D. degree awarded by Tokyo University of Science with 6–9 months/year research stay at SEU).

Research Interests

  • Multimodal Signal Processing (speech, image, EEG, text, gait signals)
  • Speech Signal Processing (emotional speech synthesis, multilingual ASR, voice conversion)
  • Human-Computer Interaction (dialogue systems, multimodal interaction, real-time emotional voice conversion)

Professional Experience

  • Apr. 2024 – Present: Southeast University, Associate Professor, Multimodal Signal Processing
  • Apr. 2022 – Mar. 2024: Osaka University, Tenure-Track Assistant Professor, Multimodal Emotional HCI
  • Apr. 2020 – Mar. 2022: Osaka University, Specially Appointed Assistant Professor, Emotional Speech HCI
  • Oct. 2019 – Mar. 2020: National University of Singapore, Research Associate, Speech Recognition Systems
  • May 2013 – Sept. 2014: Hitachi Ltd., System Engineer, In-Vehicle Navigation Systems

Representative Publications

Research Projects

  • Dec. 2024 – Jun. 2025: National Key Laboratory for Digital Medical Engineering – Young Talent Project (PI)
  • Apr. 2024 – Apr. 2025: Research on the Influence of AI on Students’ Deep Learning Strategies (PI)
  • Apr. 2024 – Dec. 2024: Japan JSPS Young Scientist Fund (PI; project suspended due to return to China)
  • Apr. 2020 – Mar. 2024: Japan Cabinet Office “Symbiotic Society Development” 2-billion-yen project (Participant)
  • Apr. 2019 – Mar. 2020: Japan Tateisi Science and Technology Foundation Project (PI)
  • Apr. 2017 – Mar. 2020: Senjukai Foundation Project, Japan (PI)

Competitions & Awards

  • May 2025: First Prize, Jiangsu Biomedical Engineering Competition (Dysarthric Speech Conversion)
  • May 2025: Third Prize, Jiangsu Biomedical Engineering Competition (Smart Shoes Based on 9-Axis Inertial Sensing)
  • Oct. 2024: Second Prize, Huawei Ascend AI Competition (Jiangsu Division)
  • Dec. 2023: National Bronze Prize, China International College Students Innovation & Entrepreneurship Competition (First Advisor)
  • Dec. 2022: National Bronze Prize, “Internet+” Innovation & Entrepreneurship Competition (First Advisor)
  • 2020–2022: “Startup Mentor Contribution Award” by Osaka Consulate, awarded for 3 consecutive years
  • May 2019: First Prize, “Haike Cup” Global Chinese Innovation & Entrepreneurship Competition (Asia-Pacific Region)
  • Apr. 2019: Contribution Award, Japan Tateisi Science and Technology Foundation (Infant Care System Based on Emotion Recognition)
  • Mar. 2019: First Prize, Electronics Category, Shenzhen Innovation & Entrepreneurship Competition – Japan Division
  • Oct. 2018: Excellence Award, Chunhui Cup Competition (Emotion Recognition Infant Care System, First Participant)

Patents & Software Copyrights

  • Apr. 2025: “Real-Time Dysarthric Speech Conversion System Based on LLM Three-Stage Architecture V1.0” – Software Copyright, 2025SR0666050 (First Inventor)
  • Apr. 2025: “Personalized Dysarthric Speech Recognition Software Based on Incremental Fine-Tuning” – Software Copyright, 2025SR0666050 (First Inventor)
  • Nov. 2020: Japanese Patent No. 6788264, “Facial Expression Recognition Method”, etc. (Co-Inventor)

Contact

Email: luozhaojie[AT]seu[DOT]edu[DOT]cn
Office: Room 314, Biomedical Building, Jiulonghu Campus
Homepage: https://researchmap.jp/zhaojieluo