Penghui Yang 杨鹏辉

Email: phyang [dot] cs [at] gmail [dot] com

Penghui Yang is currently a PhD candidate at the College of Computing and Data Science, Nanyang Technological University, supervised by Prof. Bo An. He received his B.Sc. degree in Computer Science from Nanjing University of Aeronautics and Astronautics in 2023, advised by Prof. Sheng-Jun Huang. Previously, he collaborated closely with Dr. Ming-Kun Xie and Prof. Lei Feng. He also spent a cherished year and a half at Sea AI Lab, working under the mentorship of Dr. Cunxiao Du.

Google Scholar | DBLP | Semantic Scholar | CV

News

[May 2025] One paper was accepted by KDD'25.
[Jul 2023] One paper was accepted by ICCV'23.

Research Highlights

My research focuses on efficient, scalable methods for accelerating and compressing AI models. My work spans from knowledge distillation for computer vision to my current focus on speculative decoding for LLM inference, aiming to make AI more practical and widely accessible.

I also explore AI for Science by developing software-in-the-loop frameworks. By integrating physics-based simulators (like CALPHAD and DFT) with AI decision loops, I aim to build autonomous systems that are both efficient and scientifically reliable, bridging the gap between neural heuristics and trustworthy discovery.

If you are interested in collaboration, feel free to get in touch with me.

Publications ( show selected / show all by date / show all by topic )

Topics: Efficient ML / AI for Science / Others
*: co-first author, †: corresponding author

Penghui Yang 杨鹏辉

News

Research Highlights

Publications ( show selected / show all by date / show all by topic )

Anatomy of a Hybrid Mind: Deconstructing Hybrid Reasoning in Large Language Models

Penghui Yang^, Fengzhuo Zhang^, Yunlong Hou, Tianyu Pang, Chao Du, Bo An, Cunxiao Du^†

MATAI: A Generalist Machine Learning Framework for Property Prediction and Inverse Design of Advanced Alloys

Yanchen Deng^, Chendong Zhao^, Yixuan Li^*, Bijun Tang^†, Xinrun Wang^†, Zhonghan Zhang, Yuhao Lu, Penghui Yang, Jianguo Huang, Yushan Xiao, Cuntai Guan^†, Zheng Liu^†, Bo An^†

AutoMAT: A Hierarchical Framework for Autonomous Alloy Discovery

Penghui Yang^, Chendong Zhao^, Bijun Tang^†, Zhonghan Zhang, Xinrun Wang^†, Yanchen Deng, Yuhao Lu, Cuntai Guan, Zheng Liu^†, Bo An^†

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Penghui Yang^†, Cunxiao Du^†, Fengzhuo Zhang^†, Haonan Wang, Tianyu Pang, Chao Du, Bo An

Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

Sailor2 Team

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head

Penghui Yang, Chen-Chen Zong, Sheng-Jun Huang, Lei Feng^†, Bo An

FedDLAD: A Federated Learning Dual-Layer Anomaly Detection Framework for Enhancing Resilience Against Backdoor Attacks

Binbin Ding, Penghui Yang, Sheng-Jun Huang^†

A Unified Open Adapter for Open-World Noisy Label Learning: Data-Centric and Learning-Based Insights

Chen-Chen Zong, Peng-Hui Yang, Ming-Kun Xie, Sheng-Jun Huang^†

Multi-Label Knowledge Distillation

Penghui Yang^, Ming-Kun Xie^, Chen-Chen Zong, Lei Feng, Gang Niu, Masashi Sugiyama, Sheng-Jun Huang^†

Penghui Yang 杨鹏辉

News

Research Highlights

Publications ( show selected / show all by date / show all by topic )

Anatomy of a Hybrid Mind: Deconstructing Hybrid Reasoning in Large Language Models

Penghui Yang*, Fengzhuo Zhang*, Yunlong Hou, Tianyu Pang, Chao Du, Bo An, Cunxiao Du†

MATAI: A Generalist Machine Learning Framework for Property Prediction and Inverse Design of Advanced Alloys

Yanchen Deng*, Chendong Zhao*, Yixuan Li*, Bijun Tang†, Xinrun Wang†, Zhonghan Zhang, Yuhao Lu, Penghui Yang, Jianguo Huang, Yushan Xiao, Cuntai Guan†, Zheng Liu†, Bo An†

AutoMAT: A Hierarchical Framework for Autonomous Alloy Discovery

Penghui Yang*, Chendong Zhao*, Bijun Tang†, Zhonghan Zhang, Xinrun Wang†, Yanchen Deng, Yuhao Lu, Cuntai Guan, Zheng Liu†, Bo An†

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Penghui Yang*†, Cunxiao Du*†, Fengzhuo Zhang†, Haonan Wang, Tianyu Pang, Chao Du, Bo An

Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

Sailor2 Team

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head

Penghui Yang, Chen-Chen Zong, Sheng-Jun Huang, Lei Feng†, Bo An

FedDLAD: A Federated Learning Dual-Layer Anomaly Detection Framework for Enhancing Resilience Against Backdoor Attacks

Binbin Ding, Penghui Yang, Sheng-Jun Huang†

A Unified Open Adapter for Open-World Noisy Label Learning: Data-Centric and Learning-Based Insights

Chen-Chen Zong, Peng-Hui Yang, Ming-Kun Xie, Sheng-Jun Huang†

Multi-Label Knowledge Distillation

Penghui Yang*, Ming-Kun Xie*, Chen-Chen Zong, Lei Feng, Gang Niu, Masashi Sugiyama, Sheng-Jun Huang†

Penghui Yang^, Fengzhuo Zhang^, Yunlong Hou, Tianyu Pang, Chao Du, Bo An, Cunxiao Du^†

Yanchen Deng^, Chendong Zhao^, Yixuan Li^*, Bijun Tang^†, Xinrun Wang^†, Zhonghan Zhang, Yuhao Lu, Penghui Yang, Jianguo Huang, Yushan Xiao, Cuntai Guan^†, Zheng Liu^†, Bo An^†

Penghui Yang^, Chendong Zhao^, Bijun Tang^†, Zhonghan Zhang, Xinrun Wang^†, Yanchen Deng, Yuhao Lu, Cuntai Guan, Zheng Liu^†, Bo An^†

Penghui Yang^†, Cunxiao Du^†, Fengzhuo Zhang^†, Haonan Wang, Tianyu Pang, Chao Du, Bo An

Penghui Yang, Chen-Chen Zong, Sheng-Jun Huang, Lei Feng^†, Bo An

Binbin Ding, Penghui Yang, Sheng-Jun Huang^†

Chen-Chen Zong, Peng-Hui Yang, Ming-Kun Xie, Sheng-Jun Huang^†

Penghui Yang^, Ming-Kun Xie^, Chen-Chen Zong, Lei Feng, Gang Niu, Masashi Sugiyama, Sheng-Jun Huang^†