Jason TC ChuanginaidatatoolsRaspberry PI OS 2024–10–22 benchmark for Ollama (Llama3.2, 3b and 1b)I am interested in whether the evolution of Raspberry PI OS will help increase the throughput (eval rate) for Open-Source LLM…Nov 6Nov 6
Jason TC ChuanginaidatatoolsLLM Sentinel | A project which can make the LLM Chatbot saferI’m excited to introduce LLM Sentinel, my project for the NVIDIA AI Generative AI Agents Developer Contest, hosted by NVIDIA and LangChain…Jun 16Jun 16
Jason TC Chuanginaidatatools2024 COMPUTEX Taipei AI x Data Guided Tour (EN)I was lucky to get the last ticket of the guided tour for AI x Data. It’s so hot when you mention AI + something. I truly believe that when…Jun 7Jun 7
Jason TC ChuanginaidatatoolsFine-Tuning LLM: Apple Studio M2 Ultra 192GB vs.Fine-tuning LLM with NVIDIA GPU or Apple NPU (collaboration between the author, Jason and GPT-4o)May 301May 301
Jason TC ChuanginaidatatoolsOllama-Benchmark helps buyers decide which hardware spec should be boughtNot a Member? Read for FREE here.May 231May 231
Jason TC ChuanginaidatatoolsLocal LLM eval tokens/sec comparison between llama.cpp and llamafile on Raspberry Pi 5 8GB modelResults first: llamafile runs slightly faster than llama.cppApr 15Apr 15
Jason TC ChuanginaidatatoolsOllama v0.1.27 AI BenchmarkOllama first released native Windows Preview version in v0.1.25. However, there were some bugs to let the native version run 8X slower than…Feb 26Feb 26
Jason TC ChuanginaidatatoolsComparing Throughput Performance of Running Local LLMs and VLM on different systemsGet models like llama2, mistral and llava running locally on different systems via Ollama. It’s tested on Raspberry Pi 5,Apple M1 and…Jan 212Jan 212
Jason TC ChuanginaidatatoolsFine Tune GPT-3 model with provided training and validation datasetIn this tutorial, we will build our own fine-tuned GPT-3 model with provided training and validation dataset. It’s doing…Mar 30, 20231Mar 30, 20231
Jason TC ChuanginaidatatoolsPassing Google Cloud Professional Data Engineer Exam in 2023Pass the exam in one shot with 3-month study and improve your technical expertise in Google Cloud Platform (GCP). Feburary 2023.Feb 10, 20231Feb 10, 20231