Selected Publications
(Google Scholar Profile) (Full List at DBLP)
Transformers and Foundation Models
PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design
Wenqi Jiang, Shuai Zhang, Boran Han, Jie Wang, Bernie Wang, Tim Kraska.
Preprint, 2024.
Discovering Bias in Latent Space: An Unsupervised Debiasing Approach
Dyah Adila, Shuai Zhang, Boran Han, Bernie Wang.
ICML 2024. Forty-first International Conference on Machine Learning.
CaMML: Context-Aware Multimodal Learner for Large Models
Yixin Chen*, Shuai Zhang*, Boran Han, Tong He, Bo Li.
ACL 2024. The 62nd Annual Meeting of the Association for Computational Linguistics. code, website
CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving
Pei (Patrick) Chen,Boran Han, Shuai Zhang (Corresponding Author).
NAACL 2024 Findings. 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics . code
Transferring Knowledge From Large Foundation Models to Small Downstream Models
Shikai Qiu, Boran Han, Danielle C. Maddix, Shuai Zhang, Bernie Wang, Andrew Gordon Wilson .
ICML 2024. Forty-first International Conference on Machine Learning. code
Bridging Sources in Geospatial Sensing with Cross Sensor Pretraining
Boran Han, Shuai Zhang, Xingjian Shi, Markus Reichstein
CVPR 2024. The IEEE / CVF Computer Vision and Pattern Recognition Conference. code
Data Augmentation for Object Detection via Controllable Diffusion Models
Haoyang Fang, Boran Han, Shuai Zhang*, Su Zhou, Cuixiong Hu, Wen-Ming Ye.
WACV 2024 . TIEEE/CVF Winter Conference on Applications of Computer Vision. code
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition
Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun.
NeurIPS 2023 . Thirty-seventh Conference on Neural Information Processing Systems. code
Rethinking Document-Level Relation Extraction: A Reality Check
Jing Li, Yequan Wang, Shuai Zhang, Min Zhang.
ACL 2023 Findings. The 61st Annual Meeting of the Association for Computational Linguistics.
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameters
Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Hui, Jie Fu.
ICLR 2021. The International Conference on Learning Representations. code
Outstanding Paper Award.
On Orthogonality Constraints of Transformers
Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee.
ACL 2021 (Short Paper). The 59th Annual Meeting of the Association for Computational Linguistics.
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
Yi Tay, Aston Zhang, Anh Tuan Luu, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu and Siu Cheung Hui.
ACL 2019. The 57th Annual Meeting of the Association for Computational Linguistics code.
Foundation Models for Recommender Systems: A Survey and New Perspectives
Chengkai Huang, Tong Yu, Kaige Xie, Shuai Zhang, Lina Yao, Julian McAuley.
Preprint.
Lightweight In-Context Tuning for Multimodal Unified Models
Yixin Chen, Shuai Zhang, Boran Han, Jiaya Jia.
Preprint.
Graphs and Sequences Modeling
Data-Informed Geometric Space Selection
Shuai Zhang, Wenqi Jiang.
NeurIPS 2023 . Thirty-seventh Conference on Neural Information Processing Systems.
xFraud: Explainable Fraud Transaction Detection
Susie Xi Rao, Shuai Zhang, Zhichao Han, Zitao Zhang, Wei Min, Zhiyao Chen, Yinan Shan, Yang Zhao, Ce Zhang.
VLDB 2022 . The Proceedings of the VLDB Endowment. code
Neural Methods for Logical Reasoning over Knowledge Graphs
Alfonso Amayuelas, Shuai Zhang, Susie Xi Rao, Ce Zhang.
ICLR 2022 . The International Conference on Learning Representations. code
DeGNN: Improving Graph Neural Networks with Graph Decomposition
Xupeng Miao*, Nezihe Merve Gurel*, Wentao Zhang*, Zhichao Han, Bo Li, Wei Min, Susie Xi Rao, Hansheng Ren, Yinan Shan, Yingxia Shao, Yujie Wang, Fan Wu, Hui Xue, Yaming Yang, Zitao Zhang, Yang Zhao, Shuai Zhang, Yujing Wang, Bin Cui, Ce Zhang.
KDD 2021 (research track). The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.
Self-Instantiated Recurrent Units with Dynamic Soft Recursion
Aston Zhang, Yi Tay, Yikang Shen, Alvin Chan, Shuai Zhang
NeurIPS 2021 . Thirty-fifth Conference on Neural Information Processing Systems. code
Knowledge Router: Learning Disentangled Representations for Knowledge Graphs
Shuai Zhang, Xi Rao, Yi Tay and Ce Zhang.
NAACL 2021. Annual Conference of the North American Chapter of the Association for Computational Linguistics.
Quaternion Knowledge Graph Embeddings
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu.
NeurIPS 2019. Thirty-third Conference on Neural Information Processing Systems code.
Information Retrieval and Recommender Systems
Recommending the “right” Product to the “right” Customer with the “right” Message via Structural Neural Recommender
Shuai Zhang, Lina Yao, Tianying Song, Jake An, Steven Lu
GMC 2023 . Global Marketing Conference.
Best of the Best conference Paper Award.
Co-design Hardware and Algorithm for Vector Search
Wenqi Jiang*, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cedric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso.
SC 2023 . International Conference for High Performance Computing, Networking, Storage, and Analysis.
Recommender Systems, 2023, to appear
Shuai Zhang, Aston Zhang, Lina Yao.
Book Title: Handbook of Machine Learning for Data Science.
the 3rd edition of the the Data Mining and Knowledge Discovery Handbook.
Book Editors: Oded Z. Maimon, Lior Rokach.
Publisher: Springer.
FleetRec: Large-Scale Recommendation Inference on Hybrid GPU-FPGA Clusters
Wenqi Jiang, Zhenhao He, Shuai Zhang, Kai Zeng, Liang Feng, Jiansong Zhang, Tongxuan Liu, Yong Li, Jingren Zhou, Ce Zhang, Gustavo Alonso.
KDD 2021 (applied data science track). The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. code
Learning User Representations with Hypercuboids for Recommender Systems
Shuai Zhang, Huoyu Liu, Aston Zhang, Yue Hu, Ce Zhang, Yumeng Li, Tanchao Zhu, Shaojian He and Wenwu Ou.
WSDM 2021. The 14th ACM International Conference on Web Search and Data Mining.
MicroRec: Accelerating Deep Recommendation Systems to Microseconds by Hardware and Data Structure Solutions
Wenqi Jiang, Zhenhao He, Shuai Zhang, Thomas B. Preußer, Kai Zeng, Liang Feng, Jiansong Zhang, Tongxuan Liu, Yong Li, Jingren Zhou, Ce Zhang, Gustavo Alonso.
MLSys 2021. Fourth Conference on Machine Learning and Systems. code
Deep Learning for Recommender Systems, 2022
Shuai Zhang, Yi Tay, Lina Yao, Aixin Sun, Ce Zhang.
Book Title: the 3rd edition of the recommender systems handbook.
Book Editors: Francesco Ricci, Lior Rokach, Bracha Shapira.
Publisher: Springer.
HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems
Lucas Vinh Tran, Yi Tay, Shuai Zhang, Gao Cong, Xiaoli Li.
WSDM 2020. The 13th ACM International Conference on Web Search and Data Mining.
Best Paper Award Runner-up.
Symmetric Metric Learning with Adaptive Margin for Recommendation
Mingming Li, Shuai Zhang, Fuqing Zhu, Liangjun Zang, Wanhui Qian, Jizhong Han, Songlin Hu.
AAAI 2020. The 34th AAAI Conference on Artificial Intelligence code.
Deep Learning based Recommender System: A Survey and New Perspectives
Shuai Zhang, Lina Yao, Aixin Sun, Yi Tay.
ACM Computing surveys. 2019.
DeepRec: An Open-source Toolkit for Deep Learning based Recommendation (Demo Track)
Shuai Zhang, Yi Tay, Lina Yao, Bin Wu, Aixin Sun.
IJCAI 2019. The 28th International Joint Conference on Artificial Intelligence code.
Quaternion Collaborative Filtering for Recommendation
Shuai Zhang, Lina Yao, Lucas Vinh Tran , Aston Zhang , Yi Tay.
IJCAI 2019. The 28th International Joint Conference on Artificial Intelligence.
Holographic Factorization Machines for Recommendation
Shuai Zhang*, Yi Tay*, Anh Tuan Luu, Siu Cheung Hui, Lina Yao, Lucas Vinh Tran.
AAAI 2019. The 33rd AAAI Conference on Artificial Intelligence code.
Unraveling Metric Vector Spaces with Factorization for Recommendation
Shuai Zhang, Lina Yao, Bin Wu, Xiwei Xu, Xiang Zhang, Liming Zhu.
IEEE Transactions on Industrial Informatics. 2019. code
Thing-of-Interest Recommendation in the Internet of Things: Requirements, Challenges and Directions
Lina Yao, Xianzhi Wang, Quan Z. Sheng, Schahram Dustdar, Shuai Zhang.
IEEE Internet Computing. 2019.
Deep Neural Networks meet Recommender Systems, 2019
Shuai Zhang, Lina Yao, Aixin Sun, Guibing Guo, Xiwei Xu, Liming Zhu.
Book Title: Big Data Recommender Systems: Recent Trends and Advances.
Book Editors: Osman Khalid, Samee U. Khan, Albert Y. Zomaya .
Publisher: Institution of Engineering and Technology.
NeuRec: On Nonlinear Transformation for Personalized Ranking
Shuai Zhang, Lina Yao, Aixin Sun, Sen Wang. Guodong Long. Manqing Dong.
IJCAI 2018. The 27th International Joint Conference on Artificial Intelligence.
AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders
Shuai Zhang, Lina Yao, Xiwei Xu.
SIGIR 2017 . The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval code.
Heterogeneous
Ease.ML: A Lifecycle Management System for Machine Learning
Aguilar, David Dao, Shaoduo Gan, Nezihe Merve Gurel, Nora Hollenstein, Jiawei Jiang, Bojan Karlas, Thomas Lemmin, Tian Li, Yang Li, Susie Rao, Johannes Rausch, Cedric Renggli, Luka Rimanic, Maurice Weber, Shuai Zhang, Zhikuan Zhao, Kevin Schawinski, Wentao Wu, Ce Zhang.
CIDR 2021. The Conference on Innovative Data Systems Research code.
Gradient Boosted Neural Decision Forest
Manqing Dong, Lina Yao, Xianzhi Wang, Boualem Benatallah, Shuai Zhang, Quan Z. Sheng.
IEEE Transactions on Services Computing, 2021
Adaptive Cognitive Activity Recognition with Reinforced Attentive CNN
Xiang Zhang, Lina Yao, Xianzhi Wang, Wenjie Zhang, Shuai Zhang, and Yunhao Liu.
ICDM 2019. The 19th IEEE International Conference on Data Mining.
Prediction via Generative Convolutional Neural Networks based Regression
Xiaodong Ning, Lina Yao, Xianzhi Wang, Boualem Benatallah, Manqing Dong, Shuai Zhang.
Pattern Recognition Letters. 2018.
Internet of Things Meets Brain-Computer Interface: A Unified Deep Learning Framework for Enabling Human-Thing Cognitive Interactivity
Xiang Zhang, Lina Yao, Shuai Zhang, Salil S. Kanhere, Quan Z. Sheng, Yunhao Liu.
IEEE Internet of Things Journal. 2018.
Workshop and Report
Suspicious Massive Registration Detection via Dynamic Heterogeneous Graph Neural Networks
Xi Rao, Shuai Zhang, Zhichao Han, Zitao Zhang, Wei Min, Mo Cheng, Yinan Shan, Yang Zhao, Ce Zhang.
AAAI 2021 Workshop on Deep Learning on Graphs: Methods and Applications. DLG-AAAI’21.
Recommender Systems, 2020
Shuai Zhang, Aston Zhang, Yi Tay.
Book Title: Dive into Deep Learning. code
Book Authors: Aston Zhang, Zack C. Lipton, Mu Li, Alex J. Smola.
Next Item Recommendation with Self-Attentive Metric Learning
Shuai Zhang, Yi Tay, Lina Yao, Aixin Sun, Jake An.
AAAI 2019 Workshop on Recommender Systems and Natural Language Processing. code RecNLP 2019.
[* denotes equal contribution]