Untitled

Pronouns: he/him

My name in Chinese: 刘翔

English name: Dominic

Email: [email protected]

<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/399a9bc8-7048-4efb-b614-a235e66ea4f8/f30b1dd3-7384-4ae2-b912-11f36f7e174f/Picture2.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/399a9bc8-7048-4efb-b614-a235e66ea4f8/f30b1dd3-7384-4ae2-b912-11f36f7e174f/Picture2.png" width="40px" /> Google Scholar

</aside>

<aside> <img src="/icons/close_gray.svg" alt="/icons/close_gray.svg" width="40px" /> X

</aside>

<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/399a9bc8-7048-4efb-b614-a235e66ea4f8/cd361d2a-9856-49d3-bfa3-abc0d900c2fa/25231.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/399a9bc8-7048-4efb-b614-a235e66ea4f8/cd361d2a-9856-49d3-bfa3-abc0d900c2fa/25231.png" width="40px" /> Github

</aside>

<aside> <img src="notion://custom_emoji/399a9bc8-7048-4efb-b614-a235e66ea4f8/144768d9-5d13-807a-9cd0-007a28875119" alt="notion://custom_emoji/399a9bc8-7048-4efb-b614-a235e66ea4f8/144768d9-5d13-807a-9cd0-007a28875119" width="40px" /> QR Code

</aside>

<aside> <img src="https://www.kaggle.com/static/images/site-logo.svg" alt="https://www.kaggle.com/static/images/site-logo.svg" width="40px" /> Kaggle

</aside>

Untitled

Untitled

Untitled

Untitled

Untitled

Untitled

https://embed.notionlytics.com/wt/ZXlKM2IzSnJjM0JoWTJWVWNtRmphMlZ5U1dRaU9pSlZRVFpRUmpGUVltYzBWRWhqVTJ3eGJXWnhlaUlzSW5CaFoyVkpaQ0k2SW1SaVptUXdZek15WVdNMk16UXdOalk1T1RKaE1qQmlOekUzT1RJMVpXSTVJbjA9

👋 Hi!

I am a PhD student in Data Science and Analytics (DSA) Thrust at the Hong Kong University of Science and Technology (Guangzhou) advised by  Prof. Xiaowen Chu and Prof.Xuming HU. I have been a research intern at HKUST, working with Prof. Tong Zhang. Prior to HKUST(GZ), I graduated from HKU with an M.S. in Computer Science and GMU with B.S. in Computer science. I am happy to mentor undergraduate or master students interested in research.

🌋 Research Interests

My main research focuses on natural language processing and machine learning. I am particularly interested in efficient LLMs and Agent. My goal is to build LLMs that can be a daily human assistant.

<aside> 🌱 What’s NEW

🎉 [2024.11]  I’m selected as the Top Reviewer of NeurIPS 2024 for both main and D&B tracks (Link).

🚀 Three papers are accepted by NeurIPS 2024 !

🚀 Two papers are accepted by EMNLP 2024 !!

🚀 Selected for OpenAI’s Researcher Access Program $3000 USD.

🚀 Two CoT papers are accepted by ACL 2024 !!

</aside>

📜 Selected Publications

Please see my Google Scholar profiles for the full list.

(*: equal contribution)


LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

Rui Pan*, Xiang Liu*, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang

NeurIPS. 2024. [paper] [code(🌟 8K on GitHub)][blog]

Should We Really Edit Language Models? On the Evaluation of Edited Language Models

Qi Li*, Xiang Liu*, Zhenheng Tang, Peijie Dong, Zeyu Li, Xinglin Pan, Xiaowen Chu

NeurIPS. 2024. [paper] [code]

Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models

Lujun Li*, Peijie Dong*, Zhenheng Tang, Xiang Liu, Qiang Wang, Wenhan Luo, Wei Xue, Qifeng Liu, Xiaowen Chu, Yike Guo

NeurIPS. 2024.

LongGenBench: Long-context Generation Benchmark

Xiang Liu, Peijie Dong, Xuming Hu, Xiaowen Chu

EMNLP Findings. 2024. [paper] [code]

LPZero: Language Model Zero-cost Proxy Search from Zero

Peijie Dong*, Lujun Li*, Xiang Liu, Zhenheng Tang, Xuebo Liu, Qiang Wang, Xiaowen Chu

EMNLP Findings. 2024. [paper]

3D Question Answering for City Scene Understanding

Penglei Sun*, Yaoxian Song*, Xiang Liu, Xiaofei Yang, Qiang Wang, Tiefeng Li, Yang YANG, Xiaowen Chu

ACM MM. 2024. [paper][code]

Active prompting with chain-of-thought for large language models

Shizhe Diao*, Pengcheng Wang*, Yong Lin, Rui Pan, Xiang Liu, Tong Zhang

ACL. 2024. [paper][code]

Plum: Prompt Learning using Metaheuristic

Rui Pan*, Shuo Xing*, Shizhe Diao, Wenhe Sun, Xiang Liu, Kashun Shum, Renjie Pi, Jipeng Zhang, Tong Zhang

ACL Findings. 2024. [paper] [code]

Pruner-Zero: Evolving Symbolic Pruning Metric From Scratch for Large Language Models

Peijie Dong*, Lujun Li*, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu

ICML. **2024. [paper][code]

ParZC: Parametric Zero-Cost Proxies for Efficient NAS

Peijie Dong*, Lujun Li*, Xinglin Pan, Zimian Wei, Xiang Liu, Qiang Wang, Xiaowen Chu

arXiv preprint. 2024. [paper]

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

Longteng Zhang*, Xiang Liu*, Zeyu Li, Xinglin Pan, Peijie Dong, Ruibo Fan, Rui Guo, Xin Wang, Qiong Luo, Shaohuai Shi, Xiaowen Chu

arXiv preprint. 2023. [paper]

🔬 Research Experience

HKUST(GZ), 09/2023–Present

Ph.D. student, supervised by   Prof. Xiaowen Chu and Prof.Xuming HU

HKUST, 12/2022–08/2023

Research Intern, supervised by  Prof. Tong Zhang

Baidu Research Cognitive Computing Lab, 12/2021–06/2022

Research Intern, supervised by  Mingming Sun

💬  Academic Service

🤗  Miscellaneous Interests