Zhongzhu Zhou / Charlie Zhou 

"Let everything happen to you. Beauty and terror. Just keep going. No feeling is final." - Rainer Maria Rilke

I am a Ph.D. student at the School of Computer Science, Faculty of Engineering, The University of Sydney, supervised by Prof. Shuaiwen Song. 

Prior to my current position, I was a research assistant at the School of Computer Science and Engineering, Sun Yat-sen University from 2019 to 2022, under the supervision of Prof. Dan Huang, Yunfei Du, and Yutong Lu. I received my B.E. degree from the School of Computer Science and Engineering, Sun Yat-sen University in 2019. 

My research focuses on multiple aspects of the deep learning algorithm and system stack, including the design of general neural network improvement algorithms, GPU kernel development, and efficient compiler and runtime framework optimization. Specifically, I aim to enhance and bridge the gap between emerging machine learning algorithms & applications and heterogeneous hardware (CPU/GPU) kernel, compiler, and runtime framework in terms of productivity and performance.

Feel free to drop me an email if you have aligned interests.

Currently, I am working on 

1. Diffusion Model Algorithm and Architecture Exploration 

2. Neural Collapse in Reinforcement Learning Exploration

3. Sparse Kernel Design in GPU TensorCore 

4. I/O Framework Support for AI4Science Application in DeepSpeed Framework.

5. DeepSpeed Chat: Easy, Fast, and Affordable RLHF Training of ChatGPT-like Models at All Scales

6. I/O Framework Support for Deep Learning Application

7. HybridShare: Universal Resource Scheduling for Hybrid Jobs 

8. MAEM - Multiple Applications co-Execution time Estimation

9. EmReal: A Digital Twin Framework of Emulated and Real Components for Robots with Reinforcement Learning

Honor and Awards:

• The Jingdong Technology (JD) Co Ltd Research Scholarship in Artificial intelligence, USYD, 2022

Honor and Awards:

• SYSU Overseas Visiting and Collaborative Research Program Funding Plan, SYSU, 2021 

• The Third Class Scholarship, SYSU X 3, 2020, 2021, 2022

• The Second Class Scholarship (Top 15% of the major), SYSU, 2019

Honor and Awards:

• Illinois Computer Science Summer Research Program, UIUC, 2018

Honor and Awards:

• National Scholarship (Top 1 of the major), China, 2016

• Research Honor Degree, SYSU, 2019

• The First Class Scholarship (Top 5% of the major) X 2, SYSU, 2015-2016, 2017-2018 

• The Second Class Scholarship (Top 15% of the major), SYSU, 2016-2017 

• Meritorious Winner, COMAP’s Mathematical Contest in Modeling, United States, 2017 

• The Second Prize, The Chinese Mathematics Competitions, 2016

• The Third Prize, The Chinese Mathematics Competitions, 2017

• The Third Prize, ACM-ICPC, SYSU, 2017

• The Second Prize, Student Innovation Software Development Competition, SYSU, 2017 

• The Third Prize, Microsoft Hackthon, South China, 2018

• Institute of Electrical and Electronics Engineers (IEEE) Member ID: 97841404

• Association for Computing Machinery (ACM) Member ID: 6708618

• China Computer Federation (CCF) Member ID: B8293G

• Reviewer for Conferences

  • NeurIPS 2023(Thirty-seventh Conference on Neural Information Processing Systems)

Book

C Language Programming in Chinese
Xuemao Zhou, Wei Yi, Zhongzhu Zhou

• Tianjin University Press

• ISBN: 9787561847251

• SALE LINK

Conference Paper

JSidentify: A Hybrid Framework for Detecting Plagiarism Among JavaScript Code in Online Mini Games
Qun Xia, Zhongzhu Zhou, Zhihao Li, Bin Xu, Wei Zou, Zishun Chen, Huafeng Ma, Gangqiang Liang, Haochuan Lu, Shiyu Guo, Ting Xiong, Yuetang Deng, Tao Xie

• ICSE (International Conference on Software Engineering) 2020 

• Track: Software Engineering in Practice

• TALK LINK, PAPER LINK

Journal Paper

Binary Neural Network for Automated Visual Surface Defect Detection
Wenzhe Liu, Jiehua Zhang, Zhou Su, Zhongzhu Zhou, Li Liu

• Sensors MDPI (Multidisciplinary Digital Publishing Institute)

• Track: Special Issue Intelligent Sensing and Monitoring for Industrial Process

• PAPER LINK

Patent

KUBERNETES 用户态应用中基于虚拟文件系统的小文件存储优化系统
Liang Du, Guixin Guo, Kangyou Zhong, Yunfei Du, Yutong Lu, Zhongzhu Zhou

• Chinese Patent

• 申请号: CN202010195318.5, 公开号: CN111475469A/B

• CHINESE DOCUMENT LINK 1, CHINESE DOCUMENT LINK 2

• ICSE (International Conference on Software Engineering) 🎥 Jul, 11, 2020

• ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2023) Online Attendance; March 25 - 29, 2023

• International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2022) Online Attendance; November 13 - 18, 2021

• China National Computer Congress (CNCC 2021) Online Attendance; December 16 - 18, 2021

• International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2021) Online Attendance; November 14 - 19, 2021

• ACM International Conference on Supercomputing (ISC 2021) Online Attendance; June 24 - July 02, 2021

• International Symposium on Computer Architecture (ISCA 2021) Online Attendance; June 14 - 19, 2021

• International Conference on High Performance Big Data and Intelligent Systems (HPBC&IS 2020) Online Attendance; May 23 - 23, 2020

• Fall 2023, Tutor, The University of Sydney

• Course Certificate: Sample-based Learning Methods
  • an online non-credit course authorized by University of Alberta, Alberta Machine Intelligence Institute and offered through Coursera; November, 14, 2021
• Course Certificate: Fundamentals of Reinforcement Learning 
  • an online non-credit course authorized by University of Alberta, Alberta Machine Intelligence Institute and offered through Coursera; Aug, 20, 2021
• IELTS Test Scores: Listening: 6.5; Reading: 7.0; Writing: 6.5; Speaking: 6.5; Overall: 6.5
  • October, 08, 2020

• Programming Languages: Pascal (11 yrs), C (11 yrs), C++ (11 yrs), Python (6 yrs), HTML, CSS, JavaScript (6 yrs), Java (6 yrs), SQL (6 yrs), Bash (6 yrs), LaTeX (5 yrs), Matlab (5 yrs), CUDA (5 yrs), R (4 yrs), Go (4 yrs)

• Systems and Infrastructure: MPI/OpenMPI (6 yrs), Linux Kernel (5 yrs), Distributed/Parallel File Systems - e.g., Lustre, HDFS (5 yrs), Kubernetes, Kubernetes Scheduler, Kubernetes SR-IOV (5 yrs), Docker (5 yrs), Hadoop (4 yrs), Spark (4 yrs), YARN (4 yrs), Mesos (4 yrs)

• Machine Learning and AI: TensorFlow (5 yrs), PyTorch (4 yrs), TorchServe (4 yrs), TensorBoard (4 yrs), Ray (4 yrs), JAX (2 yrs), Triton (2 yrs), DeepSpeed (1 yr), HuggingFace (1 yr), Reinforcement Learning (4 yrs), CNN, RNN, ResNet, Attention Block, UNet, Transformer, ViT (5 yrs), Neural Architecture Search (3 yrs), Diffusion Models (1 yr), GPT-2,3,4 (1 yr), Reinforcement learning from human feedback (1 yr)

• Databases and Storage: MySQL (6 yrs), Oracle SQL (6 yrs), MongoDB (6 yrs), PostgreSQL (6 yrs), Redis (4 yrs), Hive SQL (3 yrs)

• Front-end Development: PHP (6 yrs), Vue.js (6 yrs), ReactJS (6 yrs), ASP.NET (6 yrs), jQuery (6 yrs), AngularJS (6 yrs), Apache (6 yrs), MeteorJS (6 yrs)

• Back-end Development: Spring Boot (6 yrs), Django (6 yrs), Flask (6 yrs), Node.js (6 yrs), Express (6 yrs), REST API Design (6 yrs), CI/CD

• Mobile Development: Android Studio (6 yrs, Java, Kotlin), XCode (6 yrs, Swift, Objective-C), React Native (6 yrs, Cross-platform), Flutter (6 yrs, Cross-platform)

• Web Crawling & Testing: Urllib (6 yrs), BeautifulSoup (6 yrs), Scrapy (6 yrs), Requests (6 yrs), JSON (6 yrs), Selenium (6 yrs), Pytest (6 yrs), JUnit (6 yrs)

• Version Control & Build Systems: Git (8 yrs), Gradle (6 yrs, Android, Java), Maven (6 yrs, Java), npm (6 yrs, JavaScript), pip (6 yrs, Python)

• Development Tools & Libraries: Airflow (2 yrs), Kafka (2 yrs), Elasticsearch (2 yrs), OpenCV (5 yrs), Pandas (5 yrs), NumPy (5 yrs), SciPy (5 yrs), NLTK (5 yrs), Matplotlib (5 yrs), Seaborn (5 yrs), Azure Data Factory (2 yrs), AWS (2 yrs), Google Cloud Platform (2 yrs)

• Fitness: Fencing(6 yrs), Jogging (7 yrs), Bodybuilding(6 yrs) (Hongxing Fitness Club Outstanding Students), Table Tennis(11 yrs), Badminton(11 yrs)

• Leisure: Web & Mobile Application Development(5 yrs), Saxophone(9 yrs), Magic (1 yrs), Video Games (more than 500+ PS5 game collections)

• Volunteer:

  • Sun Yat-sen University, School of Computer Science and Engineering, Student Union,Vice President, Jul, 2016 - Jul, 2017

    • Mentored incoming freshmen, helped them acclimate to the university environment, and promoted a sense of belonging through inclusive campus activities and events.

  • Changjun High School Volunteer, Jul, 2013 - Jul, 2014

    • Enhanced the nursing home experience by engaging in meaningful conversations with elderly residents, preparing and serving fresh fruit, and maintaining a clean and sanitary environment for their well-being.