Matthew Gunton – Medium

Matthew Gunton

Matthew Gunton
in
Towards Data Science

Understanding You Only Cache Once

This blog post will go in detail on the “You Only Cache Once: Decoder-Decoder Architectures for Language Models” Paper and its findings

2d ago

Understanding You Only Cache Once

2d ago

Matthew Gunton
in
Towards Data Science

Understanding Low Rank Adaptation (LoRA) in Fine Tuning LLMs

How LoRA works to fine-tune LLMs, following the methodology set out in the “LoRA: Low-Rank Adaptation of Large Language Models” paper

May 24

Understanding Low Rank Adaptation (LoRA) in Fine Tuning LLMs

May 24

Matthew Gunton
in
Towards Data Science

Understanding Long RoPE in LLMs

This blog post will go in detail about the new Long RoPE Methodology used to expand the context lengths LLMs can support without…

May 15

Understanding Long RoPE in LLMs

May 15

Matthew Gunton
in
Towards Data Science

Phi-3 and the Beginning of Highly Performant iPhone Models

This blog post will go into the findings of the Phi-3 paper, as well as some of the implications of models like Phi-3 being released

May 9

Phi-3 and the Beginning of Highly Performant iPhone Models

May 9

Matthew Gunton
in
Towards Data Science

Tool Use, Agents, and the Voyager Paper

A detailed exploration of the Voyager Paper and its findings on tool usage

May 1

Tool Use, Agents, and the Voyager Paper

May 1

Matthew Gunton
in
Towards Data Science

Multimodal Large Language Models & Apple’s MM1

This blog post will go into the architecture and findings behind Apple’s “MM1: Methods, Analysis & Insights from Multimodal LLM…

Apr 13

Multimodal Large Language Models & Apple’s MM1

Apr 13

Matthew Gunton
in
Towards Data Science

FrugalGPT and Reducing LLM Operating Costs

This blog post will go into detail about a cost-saving architecture for LLM-driven apps as seen in the “FrugalGPT” paper

Mar 27

FrugalGPT and Reducing LLM Operating Costs

Mar 27

Matthew Gunton
in
Towards Data Science

Understanding the Sparse Mixture of Experts (SMoE) Layer in Mixtral

This blog post will explore the findings of the “Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer” paper…

Mar 21

Understanding the Sparse Mixture of Experts (SMoE) Layer in Mixtral

Mar 21

Matthew Gunton
in
Towards Data Science

Understanding Direct Preference Optimization

This blog post will look at the “Direct Preference Optimization: Your Language Model is Secretly a Reward Model” paper and its findings.

Feb 18

Understanding Direct Preference Optimization

Feb 18

Matthew Gunton

Exploring LLM Behavior in Dynamic Competitive Settings

This blog post will explore the “K-Level Reasoning with Large Language Models” paper

Feb 10

Exploring LLM Behavior in Dynamic Competitive Settings

Feb 10

Matthew Gunton

Matthew Gunton

Hi, my name is Matthew Gunton. I like talking about the latest ways technology can be used to improve the world

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams