About Me
Hi! I’m Haibin Wu. I am currently a fourth-year Ph.D. student at the college of Electrical Engineering and Computer Science (EECS) at National Taiwan University (NTU). I am a member of the Speech Processing Lab, working with Prof. Hung-yi Lee and Prof. Lin-shan Lee in the area of machine learning and speech processing. My expertise lies in speech foundation models, prompt engineer, speech LLMs, speech enhancement, and speaker verification, audio event classification, multimodal learning and model compression. By the way. I was fortunate enough to be funded by a Google PhD Fellowship. I’m a main contributor for S3PRL v0.4.0 with 2000+ GitHub stars. I have a keen interest in photography, and you can find my portfolio on my homepage.
I am now looking for full-time research scientist positions in the fields of speech processing and machine learning. I would greatly appreciate your assistance if you have any opportunities or recommendations in these areas.
Selected Publications
EMO-SUPERB: An In-depth Look at Speech Emotion Recognition
Haibin Wu, Huang-Cheng Chou, Kai-Wei Chang, Lucas Goncalves, Jiawei Du, Jyh-Shing Roger Jang, Chi-Chun Lee, Hung-Yi Lee
Preprint
[ pdf | Webpage | Github]Codec-SUPERB: An In-Depth Analysis of Sound Codec Models
Haibin Wu, Ho-Lam Chung, Yi-Cheng Lin, Yuan-Kuei Wu, Xuanjun Chen, Yu-Chi Pai, Hsiu-Hsuan Wang, Kai-Wei Chang, Alexander H. Liu, Hung-yi Lee
Preprint
[ pdf | Github | Leaderboard | Huggingface]Towards audio language modeling - an overview
Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-wei Chang, Ho-Lam Chung, Alexander H. Liu, Hung-yi Lee
Preprint
[ pdf]SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts
Haibin Wu, Kai-Wei Chang, Yuan-Kuei Wu, Hung-yi Lee
Preprint
[ pdf]The defender’s perspective on automatic speaker verification: An overview
Haibin Wu, Jiawen Kang, Lingwei Meng, Helen Meng, Hung-yi Lee
IJCAI DADA workshop 2023
[ pdf]Rethinking complex-valued deep neural networks for monaural speech enhancement
Haibin Wu, Ke Tan, Buye Xu, Anurag Kumar, Daniel Wong
Interspeech 2023
[ pdf]MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification
Yang Zhang, Zhiqiang Lv, Haibin Wu, etc.
Interspeech 2022
[ pdf]Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion
Haibin Wu, Jiawen Kang, Lingwei Meng, etc.
Odyssey 2022
[ pdf]Partially Fake Audio Detection by Self-Attention-Based Fake Span Discovery
Haibin Wu, Heng-Cheng Kuo, Naijun Zheng, Kuo-Hsuan Hung, Hung-Yi Lee, Yu Tsao, Hsin-Min Wang, Helen Meng
ICASSP 2022
[ pdf | video]Adversarial Sample Detection for Speaker Verification by Neural Vocoders
Haibin Wu, Po-chun Hsu, Ji Gao, Shanshan Zhang, Shen Huang, Jian Kang, Zhiyong Wu, Helen Meng, Hung-yi Lee
ICASSP 2022
[ pdf | Github | video]Characterizing the adversarial vulnerability of speech self-supervised learning
Haibin Wu, Bo Zheng, Xu Li, Xixin Wu, Hung-yi Lee, Helen Meng
ICASSP 2022
[ pdf | video]Voting for the right answer: Adversarial defense for speaker verification
Haibin Wu, Yang Zhang, Zhiyong Wu, Dong Wang, Hung-yi Lee
Interspeech 2021
[ pdf | Github]Adversarial defense for automatic speaker verification by cascaded self-supervised learning models
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-yi Lee
ICASSP 2021
[ pdf ]Defense for Black-box Attacks on Anti-spoofing Models by Self-Supervised Learning
Haibin Wu, AT Liu, H Lee
Interspeech 2020
[ pdf | video ]Adversarial attacks on spoofing countermeasures of automatic speaker verification
S Liu, H Wu, H Lee, H Meng
ASRU 2019
[ pdf ]Multiview Learning for Subsurface Defect Detection in Composite Products: A Challenge on Thermographic Data Analysis
Haibin Wu, K Zheng, S Sfarra, Y Liu, Y Yao
IEEE Transactions on Industrial Informatics
[ pdf ]
For the complete list, please visit google scholar.
Research Experience
Research scientist intern at Microsoft Feb 2024 - Present
Research scientist intern at Meta May 2023 - Sep 2023
Applied scientist intern at Amazon Sep 2022 - Dec 2022
Research scientist intern at Meta May 2022 - Aug 2022
Visiting Student at the Chinese University of Hong Kong May 2021 - April 2022
Visiting Student at SIGS of Tsinghua University Aug. 2020 - May 2021
Intern at Tencent Jan. 2021 - May 2021
Challenge
Honers
Google studnet travel grant Google 2024
ICASSP travel grant ICASSP 2024
Interspeech travel grant Interspeech 2022
Appier Scholarship Appier 2022
Google PHD Fellowship Google 2021
Advanced Speech Technologies Scholarship NTU EECS 2020
Academic Achievement Award NCTU EECS 2019
Academic Achievement Award NCTU EECS 2018
National Scholarship Chinese Ministry of Education 2014
Teaching
TA of Machine Learning NTU EECS, Spring 2021