Getting vLLM v0.9.2 working on CUDA 12.4 on QNAP (Driver 550.76)This is mostly because this has driven me mad for the past day. It seems at some point that vLLM rebased their entire platform to CUDA…Jul 15A response icon1Jul 15A response icon1
Published inTowards AIMoving from Ollama to vLLM: Finding Stability for High-Throughput LLM ServingIf you have read any of my previous articles you will see that more often than not I try and self-host my infrastructure (because as a…Jul 9A response icon11Jul 9A response icon11
Overdue update: The launch of MindLatticeMindLattice — Bridging the gap between data engineering and AI for businesses.Mar 4Mar 4
Published inTowards AIGraphRAG Is the Logical Step From Rag — So Why the Sudden Hype?It seems like everyone is currently talking about GraphRAG as the successor to RAG (Retrieval-Augmented Generation) in the Generative AI /…Jul 17, 2024A response icon2Jul 17, 2024A response icon2
Published inTowards AIRevolutionising Machine Learning: Achieving Top 4% in Kaggle with AutoGluon in Just 7 Lines of CodeDiscover how AutoGluon redefines efficiency in ML, turning complex tasks into streamlined successes.Dec 5, 2023Dec 5, 2023
Published inTDS ArchiveData Engineering: Fast Spatial Joins Across ~2 Billion Rows on a Single Old GPUComparing the performance of ORC and Parquet on spatial joins across 2 Billion rows on an old Nvidia GeForce GTX 1060 GPU on a local…May 30, 2023A response icon1May 30, 2023A response icon1
GPU Data Engineering, CSV to Parquet & ORC using Dask & RAPIDS.aiUp until recently the majority of my data engineering work was around designing and deploying Data pipelines in either AWS or GCP, there…May 15, 2023A response icon1May 15, 2023A response icon1
What is dMRV and how does it relate to Carbon Accounting?dMRV is Digital Measurement, Reporting and VerificationMar 27, 2023A response icon2Mar 27, 2023A response icon2
TYMLEZ Releases 2 Open-Source Guardian Policies in time for COP27As part of our commitment to Open Source and to the Hedera community, TYMLEZ has today released 2 of its core policies to open-source.Oct 27, 2022Oct 27, 2022
TYMLEZ releases AWS & GCP Terraform setup for the Hedera GuardianThe TYMLEZ team have been hard at work over the past 6 months developing out our pilots against our customer requirements.Jul 8, 2022Jul 8, 2022