Hao Zhuang, PhD - AI and Compute @ Tesla, Google – Medium

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Pinned

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Play OpenAI Triton MatMul IR Lowering

Nov 23, 2023

Play OpenAI Triton MatMul IR Lowering

Nov 23, 2023

Pinned

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Enhancing Deep Learning Performance with Triton and PyTorch — vector add example with IRs

Generated by my old NVidia GTX 1060 GPU

Nov 22, 2023

Enhancing Deep Learning Performance with Triton and PyTorch — vector add example with IRs

Nov 22, 2023

Pinned

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Exploring torch.compile with nanoGPT with Peffeto trace

whatever

Nov 20, 2023

Exploring torch.compile with nanoGPT with Peffeto trace

Nov 20, 2023

Pinned

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

2022 open source contribution — Sad…

After leaving Google for Tesla, I spent way less time in the open-source community. I just made one PR in GitHub in the second half of…

Jan 20, 2023

2022 open source contribution — Sad…

Jan 20, 2023

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Reading: AI Hardware w/ Jim Keller

ending: “this is the funniest thing you know you start training with complicated things you end training with complicated things and it’s…

Jun 20

Reading: AI Hardware w/ Jim Keller

Jun 20

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Read: Google datacenter Optical Circuit Switching and TPU stuffs

Some readings and collections were taken during my parental leave at home.

Jun 7

Jun 7

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Read: Efficiently Scaling Transformer Inference

https://arxiv.org/pdf/2211.05102

Jun 6

Read: Efficiently Scaling Transformer Inference

Jun 6

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

读：TableGen 入门

Slides…

Jun 4

读：TableGen 入门

Jun 4

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Read: HC2023-K1: Exciting Directions for ML Models and the Implications for Computing Hardware @…

“Keynote 1, Hot Chips 2023, Monday, August 28, 2023 Jeff Dean and Amin Vahdat, Google Jeff & Amin describe how Google is using ML models in…

May 31

Read: HC2023-K1: Exciting Directions for ML Models and the Implications for Computing Hardware @…

May 31

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

MQA/GQA, Reshape, and Compute

May 5

MQA/GQA, Reshape, and Compute

May 5

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Hao Zhuang, PhD - AI and Compute @ Tesla, Google

Love to code. work on Machine Learning Systems and Scaling AI | Tesla AI, Ex-Googler | UCSD PhD | github.com/zhuangh, linkedin.com/in/zhuangh/ | FlameSync

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams