Yunjiang JiangUnderstanding Streaming Multiprocessors (SM), blocks, threads, and warps in CUDA programmingI started reading the excellent book Professional CUDA C Programming in the past few days. The programming part flew by very smoothly. I…Jan 29Jan 29
Yunjiang JiangThe Dystopian Future of Software Engineering: Moore’s Law and the Outsourcing of HumanityMoore’s Law, which states that the number of transistors on a microchip doubles approximately every two years, has long been the driving…Jun 19, 2023Jun 19, 2023
Yunjiang JiangComparing Speed of Torch and NumpyIn one of my recent day jobs, I had to compute the inner products of a small set of embeddings A against a large set of embeddings B. The…Jun 19, 2023Jun 19, 2023