LLMs can Control the Computer now.

Jay Reddy
Databracket
Published in
4 min readOct 23, 2024

--

Enabling LLM to control your Computer is just an API call away.

Image by Author

Tech with no advancements will inevitably become obsolete.

In this context, I am referring to LLMs. LLMs are like the shiny apples in the basket, which everyone wants to take a bite of.

AI and AI-first startups are investing time and resources to improve LLMs.

It was just a matter of time before the LLMs could grow a tail and start crawling before they could fly.

Yesterday we witnessed a new LLM capability that could change how we work.

Large language models (LLM) can now perform generic and repetitive tasks on your PC through natural prompts.

Do you want to send an email, save a photo, or open YouTube to watch a video using LLM? It’s possible now.

The enhanced version of Claude 3.5 Sonnet (Haiku) offers PC interaction features (computer use).

This is originally published on Databracket’s Substack page. If you don’t have a medium subscription, please check there.

Interaction Flow of Claude 3.5 Haiku

We know that LLMs are brilliant at generating content based on proximity. LLMs will choose the next word based on the closest proximity for text…

--

--

Databracket
Databracket

Published in Databracket

Use-case-specific findings, solutions, and implementation on Data Engineering, MLOps, DevOps, Web, AI, and Robotics.

Jay Reddy
Jay Reddy

Written by Jay Reddy

I write about Data, AI, Startup, and Entrepreneurship. Life without challenges and risks is mediocre. databracket.substack.com youtube.com/@data_bracket

Responses (1)