Language Model

The 19th-century British philosopher Thomas Carlyle ascribed human progress to a key historical development: “Man is a tool-using animal. Without tools he is nothing, with tools he is all.” While today’s large language models (LLMs) have demonstrated impressive generative and problem-solving capabilities, recent research suggests they could take a similar…

Let’s delve into the two types of summarization techniques commonly used in Machine Learning: Abstractive summarization and Extractive summarization. We will compare them and provide Python code examples for each. The Need: Why is summarization needed at all? Summarization plays a crucial role in extracting key points or ideas from text. Summaries enhance the information retrieval process by…

Introduction Sentiment classification and it’s importance

With the introduction of ChatGPT, Large Language Models (LLMs) have become without doubt the hottest topic in AI and it doesn’t seem that this is going to change any time soon. Although the underlying iterations of GPT models were just the next step in the process of developing better and…

Some people believe that language is necessary for thinking, but in my case, thinking and language are separate entities. For me, the process of expressing my thoughts in words is like finding words that can contain the linguistic or non-linguistic concepts in my thoughts and sequentially loading them onto a…

LIMA, Quality is More Important Than Quantity — LIMA: Less Is More for Alignment, LIMA, by Meta AI, Carnegie Mellon University, University of Southern California, and Tel Aviv University, 2023 arXiv v1 (Sik-Ho Tsang @ Medium) Language Model 1991 … 2022 [GPT-NeoX-20B] [GPT-3.5, InstructGPT] [GLM] [MT-NLG 530B] [Chinchilla] [PaLM] [AlexaTM] [BLOOM] [AlexaTM 20B] [OPT] [Switch Transformers] [LaMDA] [LoRA] [Galactica]…

ChatGPT: A Conversational AI Model — My friend Laszlo showed me this video, and I’m glad he did. The picture is much clearer. In this video, Andrej Karpathy, the former research scientist of OpenAI, discusses ChatGPT, a conversational AI model developed by OpenAI. ChatGPT is a large language model (LLM) trained on a massive dataset of…

I used Flacon 7B to try and see if it can generate a coherent blog on Apache Camel tech. Here is the result Apache Camel is an open-source integration framework that can be used to integrate applications through its use of a variety of different data routing and transformation techniques…

In recent years, large language models have become increasingly popular in the field of artificial intelligence. These models, such as GPT-3 and BERT, have demonstrated remarkable capabilities in understanding and generating human-like text. However, training these models typically involves two stages: unsupervised pretraining from raw text and large-scale instruction tuning…