Machine Learning

Why traditional AI has the reliability advantage over generative AI — In Part 1 of this series, I said something that I’d thought I’d never say: when we’re dealing with typical enterprise-scale AI systems, trust and safety is easy. What?! Blasphemy! Hear me out. Yes, okay, it’s actually pretty hard. But the difficulty pales in comparison to the trust and safety…

Unpacking the data-centric AI concepts used in Segment Anything, the first foundation model for image segmentation — Artificial Intelligence (AI) has made remarkable progress, especially in developing foundation models, which are trained with a large quantity of data and can be adapted to a wide range of downstream tasks. A notable success of the foundation models is Large Language Models (LLMs). These models can perform complex tasks…

Fine-tuning models with billions of parameters is now possible on consumer hardware — Most large language models (LLM) are too big to be fine-tuned on consumer hardware. For instance, to fine-tune a 65 billion parameters model we need more than 780 Gb of GPU memory. This is equivalent to ten A100 80 Gb GPUs. In other words, you would need cloud computing to…

Large model models (LLMS) have progressively grown powerful and competently. These models can be used for a wide array of applications, such as text generation, language translation, and providing answers to queries. What is Langchain? In my previous article, I made an introduction to Langchain and its inner workings. If you check my…

Supervised machine learning is a subfield of machine learning (ML) that deals with building models from labeled data in order to predict the outcomes for unseen data. A labeled data set consists of a set of examples that have been “tagged” or labeled with the correct output. In this regard…

Understand why large companies are embracing data mesh — There are major ‘data earthquakes’ underway at large organisations worldwide. It is the decentralisation of the company’s data lake towards data mesh. At one of Australia’s ‘Big Four’ banks where I’ve worked in the analytics space for half a decade, we are smack middle of a huge transformation journey building…

Organizations are in a race to adopt Large Language Models. Let’s dive into how you can build industry-specific LLMs Through RAG — Companies stand to gain a lot of productivity improvements through LLMs like ChatGPT. But try asking ChatGPT “what is the current inflation in the U.S.” and it gives: I apologize for the confusion, but as an AI language model, I don’t have real-time data or browsing capabilities. My responses are…

Illustrations by Lisa Xu Clover’s data science team is focused on building machine learning (ML) models that are designed to improve the detection and management of chronic diseases. One of the things that makes our platform unique is the feedback loop that allows for rapid iteration and increased model…

…and possible ways to fix it — Don’t get me wrong, bar charts can be a great tool for data visualization, especially when used for displaying counts or proportions. However, using them in the wrong way can lead to unintentional (or even worse, intentional) data misinterpretation. …