Artificial Intelligence

Get started using Falcon-7B, Falcon-40B, and their instruct versions — The Falcon models have drawn a lot of attention since they have been released in May 2023. They are causal large language models (LLM), or so-called “decoder-only” models, very much like GPT. Definition: Causal Language Model Causal language modeling involves predicting the token that follows a sequence of tokens. During…

ChatGPT can help automate the most boring parts of anyone’s job. — ChatGPT is more than your personal assistant. It’s a tool that can make you super productive at work! However, most of us only scratch the surface of what ChatGPT can truly offer. In a recent article, I talked about some hidden gems I found while using ChatGPT on my everyday…

It wasn’t simple, but it was worth it. — Have you ever tried teaching ChatGPT to your dad or even grandpa? I did it. You might be just as curious and skeptical about the outcome as I was when I decided to do it. …

NC, SA, GPL, and other acronyms you don’t want to see in the open source license of the model you are using — A (biased) history of open sourcing AI libraries and models I joined the Google Brain team in 2015 right as TensorFlow was open sourced. Contrary to popular belief, TensorFlow was not the secret sauce behind Google’s success at that point in time. Only a handful of researchers had used it, and it took several years before it transformed Alphabet’s most…

How a wise use of direction when doing message passing on heterophilic graphs can result in very significant gains. — Graph Neural Networks (GNNs) are highly effective at modelling relational data. However, current GNN models frequently assume the input graph to be undirected, overlooking the inherent directionality of many real-world graphs, such as social, transportation, transaction, and citation networks. In this blog post, we explore the impact of edge directionality…

The NYU AI School returned with its fourth iteration this summer, May 31 — June 4, 2023. The free week-long course was launched and generously funded by the NYU ML² Machine Learning for Language Lab and organized by students from the CDS and NYU’s Courant Institute. It includes hands-on labs…

A process of prompt engineering, software engineering, trial and error, and elbow grease — Unlike tabular data, datasets for computer vision tasks are unstructured — think gobs of pixels, heaps of labels, bags of tags, and some sometimes-structured metadata. Nevertheless, those of us working in computer vision still need to…

Changing the game: How Falcon 40B’s is going to disrupt the AI industry — This is huge. Falcon 40B is the most powerful open source language model to date. And it is now available for commercial use, completely royalty-free! Something OpenAI might not like that much, maybe? :) In this post we’ll check out why this is a game-changer for the AI industry, what…

A State-of-the-Art LLM Better than LLaMa for Free — The Falcon models are state-of-the-art LLMs. They even outperform Meta AI’s LlaMa on many tasks. Even though they are smaller than LlaMa, fine-tuning the Falcon models still requires top-notch GPUs with more than 40 GB of VRAM. Well, this was before the introduction of QLoRa. QLoRa quantizes LLMs in 4-bit…