About Ting Cao

Research

Dr. Ting Cao is a Professor at the Institute of AI Industry Research (AIR), Tsinghua University. Her research interest include Edge AI, large foundation model algorithms, AI inference systems, and novel AI accelerators. Her research works have been published in top-tier computer system conferences such as ISCA, ASPLOS, MobiCom, MobiSys, NSDI, OSDI, PLDI, EuroSys, SC, and PPoPP, as well as leading AI algorithm venues including ICCV, ACL, and KDD.

She has numerous awards, such as 2012 ACM Research highlights, 2012 IEEE Micro Top Picks, 2021 ACM SIGMOBILE Research highlights, and PPoPP’24, MobiSys’21, NAS’14 and ICCD’10 Best paper awards.

Dr. Cao’s research has significantly advanced the field of AI on edge devices, making it possible to deploy complex deep neural networks and large language models directly on consumer devices such as smartphones and PCs, greatly lowering Cloud operational costs. Her innovations have been integrated into products used by millions, including Microsoft Office, Windows, Bing, and Huawei HarmonyOS.

Her work has attracted considerable media attention, particularly her contributions to low-bit and table-lookup techniques for LLM inference, large model accelerators utilizing commercial DRAM, the VLM model StreamMind for continuous video understanding, the near real-time GUI agent V-droid, and Cloud for Science paradigm.

Education and Work Experience

Before join Tsinghua University, Dr. Cao worked as a Principal Researcher and Research Manager at Microsoft Research, leading the Edge AI direction. Prior to that, she was with the Compiler and Programing Language lab at Huawei, and the State Key Lab of Computer Architecture at the Institute of Computing Technology, Chinese Academy of Sciences.

She received her PhD from the School of Computing at the Australian National University, where she was honoured to be supervised by Prof. Steve Blackburn and Prof. Kathryn McKinley. Her doctoral research focused on the Software and Hardware co-design for energy efficiency. Turing Award winner Prof. David Patterson wrote a perspective article “For Better or Worse, Benchmarks Shape a Field”, recommending her work on quantitative energy analysis for modern software and hardware for the ACM Research Highlight, and integrated the results into the classic textbook “Computer architecture: A Quatitative Approach”.

Community Serving

Dr. Cao serves as an Associate Editor for the journal IEEE Transactions on Computers . She has also served on the program committees of conferences such as MobiSys, PLDI, OOPSLA, VEE, ChinaSys, and ISMM.Dr. Cao is the associate editor of the “Transactions on Computers”. She has also severd as PCs for conferences including MobiSys, PLDI, OOPSLA, VEE, ChinaSys, and ISMM.