PinnedYun Cheng. HsinTransformer : Attention mechanismI want to write an in-depth, step-by-step tutorial on how a GPT-like transformer works under the hood.Apr 25Apr 25
Yun Cheng. HsinTransformer: Data Loader and Embedding, Chapter 3We have already covered how a single layer of attention works, but without data, it is not going anywhere. To train a decoder-only model…May 10May 10
Yun Cheng. HsinTransformer: Byte pair tokenizer, Chapter 2The heart of a machine learning model is the source data, and the tokenizer is the first layer of it, to transform your text data into…May 2May 2
Yun Cheng. Hsin如何用 BSP 生成地牢?做遊戲的時候, 總不會想要手動調整佈置每一張地圖, 尤其對不熟悉美術的開發者來說更是如此. 自動生成地圖有很多種演算法, Binary Space Partitioning 在其中的特點是 可以生成出有規則性的地圖. 同時實作方法也比 其他同類型的算法要直觀, 容易. 本篇教學…Jul 17, 2018Jul 17, 2018
Yun Cheng. HsinHow to build dialogue tree with Google spreadsheet, Part 1Build dialogue tree that you can decide the script direction, character to talk and actual impact that will be make after each choice…Mar 19, 2018Mar 19, 2018