ZHU LEI (祝磊)

I am a PhD candiate at City University of Hong Kong under the supervision of Prof. Rynson W.H. Lau. Previously, I received my bachelor degree in Computer Science and Engineering from Dalian University of Technology (rank 1/102).

I am on the job market. If you have any openings related to large (vision-)language models or hardware-aware/efficient neural network design & deployment, I would like to get in contact!

News

Sep 26, 2024	One first-author paper on vision backbone is accepted by NeurIPS 2024. Now all three chapters of my PhD thesis are accepted by top-tier conferences.
Jul 02, 2024	I passed my oral defense and became a Dr.
Jul 02, 2024	One co-authored paper (Analytic-Splatting) is accepted by ECCV 2024.
May 16, 2024	RelayAttention got accepted by ACL 2024 main conference.
Feb 29, 2024	One co-authored paper on inverse rendering (NeP) is accepted by CVPR 2024.

Selected Publications

ACL

RelayAttention for Efficient Large Language Model Serving with Long System Prompts

Lei Zhu, Xinjiang Wang, Wayne Zhang, and 1 more author

In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2024

arXiv Bib Code

@inproceedings{zhu2023relayattention,
  title = {RelayAttention for Efficient Large Language Model Serving with Long System Prompts},
  author = {Zhu, Lei and Wang, Xinjiang and Zhang, Wayne and Lau, Rynson WH},
  booktitle = {Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2024},
}

CVPR

BiFormer: Vision Transformer with Bi-Level Routing Attention

Lei Zhu, Xinjiang Wang, Zhanghan Ke, and 2 more authors

In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023

arXiv Bib Code Poster

@inproceedings{zhu2023biformer,
  title = {BiFormer: Vision Transformer with Bi-Level Routing Attention},
  author = {Zhu, Lei and Wang, Xinjiang and Ke, Zhanghan and Zhang, Wayne and Lau, Rynson WH},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages = {10323--10333},
  year = {2023},
  google_scholar_id = {d1gkVwhDpl0C},
}