AI Newsletter August/July 2023 №031502
SUMMARY
Uniqtech is building a massive collection of flash cards for learning AI and data science. Sign up today. In this newsletter : Generative AI gold rush trends, Google I/O talk cheat sheet. ChatGPT, palm models. The next newsletter: langchain, Hugging Face, llama and llamaindex (published on Substack and Medium), linear algebra, fancy developer lifestyle.
Motivation
Subscribe to our newsletter and medium posts. Why should you subscribe? It doesn’t matter who you are if you believe AI is the future, then this will save you time. You are busy, you want to use AI to do things, use our flash cards to save time.
NEW FEATURES
- Message us if you want to modify your Stripe payment plan, card, method. We will provide you with the Stripe link. This feature will be added to the payment page.
- Feedback : 💬Got a moment to provide a quick feedback? 💬 Type a number between 0 and 10 in the chat. 10 = best, you are having a great time. 5 = so-so. 0 = the experience is not good. Please add one sentence describing your reason for choosing the number. Cheers! We respond to all feedback. https://ml.learn-to-code.co/message3.html
IMPORTANT WARNING LEGAL STUFF
We have updated our terms of service (TOC) and legal documents. Please review the changes. By proceeding to read our contents, in any form, across all social, website, tech channels, you agree with these legal documents and agree to be bound by them. WARNING: read all our disclaimers before using the content.
All our contents are written exclusively for our domains. No re-post, re-publishing allowed. All rights reserved. Restrictions also apply to “public” “basic” flash cards that do not require authentication.
A list of disclaimer
Disclaimer overview: Read here.
No partnership: currently we have no new hires, no partnerships. Any representation of us is false. Read more. We will never reach out from other domains, emails. We will never ask for your private info.
Warning, no career advice. Read more.
Disclaimer, warning not career advice https://ml.learn-to-code.co/skillView.html?skill=ZCaXwnT3Wjyy9KRrd6wp
Easter Eggs of the Month
Easter eggs are premium resources available for pro paid members. These are the best ebooks, courses that will save you time — the best resources we found on the internet.
- [Download] [ebook] [PDF] [Free] high quality statistics, data science, programming book [pro] https://ml.learn-to-code.co/skillView.html?skill=rds90hORfTnvjZfQqUhk
- Greylock partner Jerry Chen discusses AI trends, investments and model strategies [all members] https://ml.learn-to-code.co/skillView.html?skill=LP8KA9RAwp6gQgLEpa0w
- Advanced GPT-4 prompt engineering [pro, easter egg resource] — Free high quality ChatGPT, GPT-4 prompt engineering course https://ml.learn-to-code.co/skillView.html?skill=nNF6oeN3ZssmpYTrDpQG
- Easter egg: pro tips, training, and tools for developers https://ml.learn-to-code.co/skillView.html?skill=H3RikhnNqayUuTWGP1q7
- [Pro tip] [Technical Interview] [FANG Company] Simulated annealing (definition) and Quantum Annealing [pro] https://ml.learn-to-code.co/skillView.html?skill=Q27Wy8e1hSqejuKIOs4y
- [Easter Egg] Attention is All You Need (Transformer) Paper Explained (technical, intermediate level) https://ml.learn-to-code.co/skillView.html?skill=l75zTLlIjzNUnSPBdIkN
- State of data science report [easter egg, report, PDF, career https://ml.learn-to-code.co/skillView.html?skill=vbe4WK8bYAIxVNMLiolv
- Uniqtech Guide to Deep Dive on Hugging Face 03 — How to use Hugging Face to build apps [ebook] [pro] [easter egg] https://ml.learn-to-code.co/skillView.html?skill=DCTwUZJnWgUE6Zo9r2JZ
GENERATIVE AI, Natural Language Processing (NLP) and Large Language Models (LLM)
Generative AI in the news:
It is an exciting time for AI — dubbed the GenAI Rush (“Gold Rush”). LLM and image generation models are driving innovations in AI. GPT-4 is now generally available, new developers will have access to GPT-4 models and compute availability (previously limited) has now increased. Here’s an easter egg for paid subscribers, best GPT-4 course (how to use GPT-4 to build applications). Advanced GPT-4 prompt engineering [pro, easter egg resource] — Free high quality ChatGPT, GPT-4 prompt engineering course https://ml.learn-to-code.co/skillView.html?skill=nNF6oeN3ZssmpYTrDpQG
ChatGPT has already had its (apple) App Store moment: earlier 2023, it rolled out 70+ third party plugins including the ability for ChatGPT to browse live web and access information after September 2021 (the training, model cutoff date for previous models). All ChatGPT plus users have access to this advanced feature. Personally, I find the browsing feature very experimental and has yet to yield productive results for me. The feature does have extraordinary potential — Bing AI already demonstrated smart AI enabled search, greatly improve Bing search relevance and result quality.
How many times can you say AI?
Supposedly Google CEO Sundar Pichai mentioned “AI“ 150+ times during the two hour keynote at Google I/O 2023. If you are bored, watch this tiktok video — how many times can Google CEO say AI
[easter egg time saver] Product Hunt published this thread about everything announced at Google I/O https://twitter.com/ProductHunt/status/1656588706919383045
During the Google I/O 2023, Google discussed an updated large language model (LLM) called PaLM 2, which powers “I/O’s most competitive announcements, including the addition of conversational generative AI answers to Google search result (AI snapshots)” (Source: product hunt). Bard is powered by PaLM 2.
On twitter @OpenAI July 2023 : “Code Interpreter will be available to all ChatGPT Plus users over the next week. It lets ChatGPT run code, optionally with access to files you’ve uploaded. You can ask ChatGPT to analyze data, create charts, edit files, perform math, etc. Plus users can opt in via settings.”
ChatGPT plugin is the ChatGPT’s Apple App Store moment. Developers can now use skills and functionalities from other smart apps in conjunction with ChatGPT.
ChatGPT is a financial success. OpenAI and Stripe each raised a mega-round in Q1 2023. OpenAI around ~$10B, Stripe ~$6.5B. Within hours of launching, Meta’s twitter grew to millions of users, potentially catapulting on instagram tie-in.
Generative AI Flash Cards:
- Effectively reading AI research paper [Easter Egg, High Quality, Pro Tip] [pro] https://ml.learn-to-code.co/skillView.html?skill=D0nbJzMXDz94uXeBlNF4
- [Easter Egg] Attention is All You Need (Transformer) Paper Explained (technical, intermediate level) https://ml.learn-to-code.co/skillView.html?skill=l75zTLlIjzNUnSPBdIkN
- What is prompt engineering? Prompt Engineering (formal definition) https://ml.learn-to-code.co/skillView.html?skill=0hUUwRJJ5AcBwcOBr9m4 Prompt engineering is trending. It is a new programming interface that allows developers to create texts, writing, art, images without coding (no-coding movement). It is fast and its results are stunning.
- Easter Egg : Best tutorial on prompt engineering and technical details [pro] https://ml.learn-to-code.co/skillView.html?skill=V6OoHW9lvZ7qOeyVwDCc
- Word embedding 101 word representation https://ml.learn-to-code.co/skillView.html?skill=LtJBTshDj4OPgXBpfxpM
- Advanced GPT-4 prompt engineering [pro, easter egg resource] — Free high quality ChatGPT, GPT-4 prompt engineering course https://ml.learn-to-code.co/skillView.html?skill=nNF6oeN3ZssmpYTrDpQG
- Langchain What is Langchain? (definition) [pro] https://ml.learn-to-code.co/skillView.html?skill=7gZTpYetUjvb8eCsDCz8
- Pinecone Vector Database https://ml.learn-to-code.co/skillView.html?skill=tS3e5GKu549onkJRFF81
- Vector Embedding storage https://ml.learn-to-code.co/skillView.html?skill=Tflkt6kabm67To8bykED
- Easter egg — comprehensive AI course form Udacity and Google Cloud [public] https://ml.learn-to-code.co/skillView.html?skill=oomESHfb3JE9ANp6oAnI
- Open Source Alternatives to GPT-3, ChatGPT [public, easter egg, pro tip] https://ml.learn-to-code.co/skillView.html?skill=KSdGxvVRvUkXs3FRicyK
- Greylock partner Jerry Chen discusses AI trends, investments and model strategies https://ml.learn-to-code.co/skillView.html?skill=LP8KA9RAwp6gQgLEpa0w
- GPT-3 ChatGPT max_token and token length discussion https://ml.learn-to-code.co/skillView.html?skill=Q46Xbivc3qzn2bpN2XcB
- Read our special, bonus llama and llamaindex newsletter here : on Substack , on Medium
- Pro tip : convert number of tokens into English word count. https://ml.learn-to-code.co/skillView.html?skill=JG9tFdd54enXWE8xJrle
- Generative AI unicorn companies developers should know https://ml.learn-to-code.co/skillView.html?skill=x8IoQF6mkvPqBaX7zeDN
- Build AI Apps : What is Langchain? (definition) [pro] https://ml.learn-to-code.co/skillView.html?skill=7gZTpYetUjvb8eCsDCz8
- Generative AI unicorn companies developers should know https://ml.learn-to-code.co/skillView.html?skill=x8IoQF6mkvPqBaX7zeDN
- Generative AI companies developers should know https://ml.learn-to-code.co/skillView.html?skill=lusqpANizBl1LYnITRlu
- History of GPT, GPT-3, ChatGPT, GPT-4 models [pro] https://ml.learn-to-code.co/skillView.html?skill=VqCpbGVHXUROUsBWVt2F
General AI news
- Hardware: NVIDIA has become a super compute company, emerging as a chip company worthy approximately 25 billion dollars (market cap fluctuates). NVIDIA GPUs are now essential for AI training. Though some argue that reliance on GPU is limited because the inference phase of AI does not require nearly as much compute as the training phase.
- Hardware: NVIDIA defends 8GB of VRAM in recently launched GPU RTX 4060 Ti in context of gaming, AI GPU compute: “Remember the frame buffer is not the memory of the computer — it is a cache. And how you manage the cache is a big deal. It is like any other cache. And yes, the bigger the cache is, the better. However, you’re trading off against so many things… and it’s releasing an RTX 4060 Ti variation with 16GB of VRAM in July. It’s the same GPU with the same performance, just with more VRAM and priced $100 higher than the base model.” Read more (warning 3rd party, external website, not affiliated). NVIDIA is also augmenting in-game conversations with AI — ChatGPT. Read more (warning 3rd party, external website, not affiliated).
- Did you know Elon Musk is a co-founder of OpenAI? Did you know that he is founding another AI company? Read here on Fast Company
NEW FLASH CARDS for well rounded developers
General development skills
- Developer humor : How to get a dev job? There’s a function for that: get_dev_job() How to get a dev job (meme) https://ml.learn-to-code.co/skillView.html?skill=vtI8sCubfyiduASr8CSh #techjob #developer #meme
- Keep track of the Great Layoff learn about the latest layoff news from big techs. Tech layoff tracker. The great layoff | the disastrous layoff https://ml.learn-to-code.co/skillView.html?skill=utK5Wyd6HjhniTLVAGcG
- Forbes reported on the latest Google employee rating system GRAD. Its full name : 新绩效评估系统 Google Reviews and Development (GRAD).
- Developer Tools
- Common Git Commands https://ml.learn-to-code.co/skillView.html?skill=0DAnmxDnYALrbX6DsRCM
- Git Essential use cases of version control https://ml.learn-to-code.co/skillView.html?skill=5F238Dgge0U4R2nwSArI
- .env file, setting up a dotenv file and environment variables https://ml.learn-to-code.co/skillView.html?skill=6HR1GWNxYBUm0Ve5vIma
- OOP: Steve Jobs explains object oriented programming in the 1994 The Rolling Stone Interview https://ml.learn-to-code.co/skillView.html?skill=f7AgxJbNocX5JajO9AZA
- Google Cloud function basics https://ml.learn-to-code.co/skillView.html?skill=jQySlJfKVPhzkp9dxfJF
- What’s a LiDAR? (definition) https://ml.learn-to-code.co/skillView.html?skill=WzdCxcXUn1WoekZm7BzX
- Foundry (definition) paradigm’s guide to foundry https://ml.learn-to-code.co/skillView.html?skill=630aJE8LPUF8QvS91Kb4
- Data products developers should know https://ml.learn-to-code.co/skillView.html?skill=3XUTRVJoA0AJky0X87zw
Career, Technical Interview
Disclaimer, warning not career advice https://ml.learn-to-code.co/skillView.html?skill=ZCaXwnT3Wjyy9KRrd6wp
- Computational Thinking https://ml.learn-to-code.co/skillView.html?skill=uuVRBwx8fM53DXLj68e1
- [Pro tip] [Technical Interview] [FANG Company] Simulated annealing (definition) and Quantum Annealing [pro] https://ml.learn-to-code.co/skillView.html?skill=Q27Wy8e1hSqejuKIOs4y
General Data Science
- Pro tip: Understand SQL Joins [easter egg, pro tip] [pro] — Data Visualization for SQL Joins https://ml.learn-to-code.co/skillView.html?skill=qRCRHE7TO4YKTmz9LBO3
- Data science, data warehouse tools developers should know https://ml.learn-to-code.co/skillView.html?skill=eTbddZvb3VpwtFT5QjOh
Data science notebooks: Jupyter, Google Colab and alternatives https://ml.learn-to-code.co/skillView.html?skill=z4mwyGEYh82yJTmdH30W - State of data science report [easter egg, report, PDF, career https://ml.learn-to-code.co/skillView.html?skill=vbe4WK8bYAIxVNMLiolv
General deep learning
- Uniqtech Guide to Activation Functions https://ml.learn-to-code.co/skillView.html?skill=dDux03JbpiiW14yV5i98
- Activation functions pro tip https://ml.learn-to-code.co/skillView.html?skill=u4WfjPKeZwxzeFvDFaRm
- Loss function cross entropy (definition) https://ml.learn-to-code.co/skillView.html?skill=HJBi27PhYuHAwALOuXIq
- Hugging Face (great news there will be a newsletter dedicated to Hugging Face):
- Uniqtech Guide to Deep Dive on Hugging Face Part 01 https://ml.learn-to-code.co/skillView.html?skill=7nxypHNkHZaN88UktRpm
- Uniqtech Guide to Deep Dive on Hugging Face 02 [pro] [paid members] https://ml.learn-to-code.co/skillView.html?skill=ZOWtgGa3vMoliRjf5lEG
- Uniqtech Guide to Deep Dive on Hugging Face 03 — How to use Hugging Face to build apps [ebook] [pro] [easter egg] https://ml.learn-to-code.co/skillView.html?skill=DCTwUZJnWgUE6Zo9r2JZ
- What is Hugging Face? Getting started with Hugging Face state of art NLP models, transformers [pro] https://ml.learn-to-code.co/skillView.html?skill=0KAxS5PW1JQEtH8xCZ19
General #100DaysOfPython Skills
- Google Cloud function basics https://ml.learn-to-code.co/skillView.html?skill=jQySlJfKVPhzkp9dxfJF