This is an email from Machine Learning Bytes, a newsletter by Data Science Bootcamp.

Hello 2022 Year of AI and Blockchain Data, Year of Analytics!

A big UIUX re-design is coming soon to our site, the new course panel format will make the content much easier to navigate and consume. This is another long newsletter. Don’t be overwhelmed by the number of flash cards. They will be organized into easily consumable smart tutorials. We will have opportunities to see how the concepts are useful in various different contexts. They will make appearances in projects (coming soon 2022).

Today’s newsletter covers the training loop and training step of machine learning. It’s an important topic! We also cover blockchain web3 recruiting and basics. What is avalanche, polygon, alchemy?? And finally we sprinkle the newsletter with a few technical interview tips including Google’s guide to python, Steve Jobs explaining OOP in plain English. Have you made learn-to-code, learn machine learning your goal for 2022? There’s still time to make that your new year resolution!

  • [pro] = flashcards for pro, paid members only.
  • [pub] = flashcards temporarily available for all to view

More payments and tipping options are now available. Become a paid member today! Check out the pricing payment page. https://ml.learn-to-code.co/payments.html

Mini projects, lessons, technical interview lessons and developer NFT launching 2022. Wow how come we only charge $5/month?! Like all startups, we want to be so good that many of you will subscribe, so we end up charging very little per person. And plus, we are investing in software + tech > overhead, so we continue to be a lean startup. These projects will be beginner friendly. We aim to have projects that take only a few lines of code but can demonstrate big concepts. You don’t have to worry about another certificate that you can’t finish. We have been there, we understand!

Substitute this meme with any other course platforms: Udacity, Coursera, …. even our founder has unfinished business in them all!

VOTE

Vote for any flash cards you like by clicking the vote button at the bottom of each skill card.

Your votes help our algorithms understand what to recommend.

EASTER EGGS

The best value of our newsletters is the high quality freebies (easter eggs) we find on the internet, such as high expensive ebooks and courses available for free for a limited amount of time. [pro]

https://ml.learn-to-code.co/skillView.html?skill=hTiwEpqKvay7XABGP2pv

[Value Proposition]: If there are great courses, by top professors for free, then why do you still need us? We take copious notes of deep learning concepts, transcribe important talks, collect jobs data, make flash cards. We then compile them into meaningful, cohesive courses, and smart tutorials. We also cover current events, hiring trends, tech trends, webinars and talks. We also provide insights on the recruiting, technical interview process, and the tech stacks and layers of your dream companies. We also link to more freebies and events. Don’t see something you need? Message us on the message tab, and or email hi@uniqtech.co to request content.

MACHINE LEARNING TRAINING LOOPS

In this newsletter, we want to start tackling two complex topics in deep learning : training, autograd. These two topics open doors to a myriad of related topics: auto differentiation, gradient descent, gradient tape, training loop, back propagation etc. All these concepts are related, yet there are plenty of differentials. No pun intended.

Training dataset is used for training.

Cross validation dataset is used for evaluating the model, fine tuning the model parameters. The third dataset, aka the test dataset is for final model selection. Testing the model’s performance on unseen dataset (mimicking real world data), testing its ability to generalize.

Introduction to Machine Learning Training

https://ml.learn-to-code.co/skillView.html?skill=wXEUn4D0lXLnrkFSil3v

Train test split (a review)

Training in Pytorch requires us to write a more custom detailed training loop. In scikit-learn, in tensorflow, training can be calling a simple high level API .fit(). Though each model has different architecture under the hood, the high level API has been abstracted to be .fit(). Here’s a fully annotated version of pytorch training loop. We will make a youtube video about it as well. https://ml.learn-to-code.co/skillView.html?skill=KGym1tBatUk11ldPM4nM

Train test split prevents overfitting

https://ml.learn-to-code.co/skillView.html?skill=TcUiRCxmrpN0WHHcLBQQ

Shuffle

https://ml.learn-to-code.co/skillView.html?skill=q6Fspg2rDN2p7cuHhAVO

Train test split basics

https://ml.learn-to-code.co/skillView.html?skill=lsLQbgznFxtv8XyG8QN5

train test split explained 02

https://ml.learn-to-code.co/skillView.html?skill=gzWvNB2BD4tBUl4CZYCc

Annotated training loop, pytorch source code [pro, IMPORTANT, high quality]

https://ml.learn-to-code.co/skillView.html?skill=AOUkVyCzxd3shMR2YbY7

What is model.eval() [pytorch, pro]

https://ml.learn-to-code.co/skillView.html?skill=2L2kvayrTQKiImAENMmP

Summary of Prof. Yann LeCun’s insights on deep learning training, optimization from the introductory deep learning class.

https://ml.learn-to-code.co/skillView.html?skill=5Of23iNQfoaSN96Lvvaq

What is back propagation: calculate gradient of the loss function with respect to (w.r.t) parameters (weight parameters) of the neural network.

How is back propagation related to neural networks, weights, loss function, gradient descent, stochastic gradient descent, chain rule. [pub]

https://ml.learn-to-code.co/skillView.html?skill=eGAWuyG2ZOg2lI4YQjXW

Common types of optimizers [pub]

https://ml.learn-to-code.co/skillView.html?skill=oGUC4XtdHs6W3kxZz0sU

A helpful analogy for understanding gradient descent [pro]

Understand the intuition behind gradient descent, and why it is challenging

https://ml.learn-to-code.co/skillView.html?skill=zzZsgttiIZCF61hrmZzp

Training step explained in details, gradient descent update function

https://ml.learn-to-code.co/skillView.html?skill=SbwHGas0sKegYrbB8XiD

Prevent overfitting in Machine Learning Deep Learning Models [pub, high quality]

https://ml.learn-to-code.co/skillView.html?skill=aD5eMJd1cRoChHNTA5SV

MACHINE LEARNING — BASICS

[Joke, humor] Have you seen XKCD’s great comic about what machine learning is? check it out [pub, not affiliated]

https://xkcd.com/1838/

Basic building block of a neural network, a basic neuron [previous newsletter]

https://ml.learn-to-code.co/skillView.html?skill=r7MwqkKw6ehTk4vUvkSC

What does this model do? [pro, high quality, cheat sheet]

https://ml.learn-to-code.co/skillView.html?skill=vRHs96wuuUqybPD14Dx4

Tensor definition 04 [pro, analogy, linear algebra] In the previous newsletter, we covered 3 definitions. Don’t worry you will see these in smart tutorials again.

https://ml.learn-to-code.co/skillView.html?skill=ipaDTPgvrgrIJA16nhBq

Definition of Epoch [pub]

https://ml.learn-to-code.co/skillView.html?skill=QsCq74Zf5YaeSYL0vnMv

Set data type dtype in numpy

https://ml.learn-to-code.co/skillView.html?skill=eRxrn80E2JnA8k9mVhOi

MACHINE LEARNING EXTRACURRICULAR

Machine Learning conferences you should know [pub]

https://ml.learn-to-code.co/skillView.html?skill=VMvpxl21uzXK9X1oKNNP

Recurrent Neural Network (RNN) insights [pro]

https://ml.learn-to-code.co/skillView.html?skill=lFPWfk69PCgWeWhHWcwM

Self driving car hardware, chips

https://ml.learn-to-code.co/skillView.html?skill=NJfTGU69fBRx0uJNJMph

Mini deep learning quiz, computer vision

https://ml.learn-to-code.co/skillView.html?skill=urU8xKjZEUvtdd5I5oY2

Onnx model format defined. What is Onnx and why should you care?

https://ml.learn-to-code.co/skillView.html?skill=6MWshEa2Q9hHYaiQe6L1

Using GPU with CUDA in Pytorch [pub]

https://ml.learn-to-code.co/skillView.html?skill=5mFD35V10gSpqsAITFFN

BLOCKCHAIN, WEB3, CRYPTO, NFT

CRYPTO WEB3 DEVELOPER JOBS, CAREER

Web3 explained using a tweet

For general blockchain, crypto, web3 info, book mark our landing page (glossary vocab page) [log in to view, free, pub]

https://ml.learn-to-code.co/p_smart_tutorial_blockchain_NFT_crypto_glossary.html

Previously we talked about the Work at Startup Expo at Y Combinator. Presenters including OpenSea and Coinbase. Check our previous newsletter for details and notes.

2022 just started and NFT market OpenSea already made many records! Why is OpenSea so hot? What is the tech stacks at OpenSea? Coinbase co-presented at the event. What is coinbase’s engineering goals? What are the problems most interesting to coinbase?

OpenSea recent funding (news)

https://ml.learn-to-code.co/skillView.html?skill=1cmeYEo3jy60ttGgk0VE

Some even speculate that OpenSea is aiming for an IPO after hiring Lyft IPO CFO.

https://www.bloomberg.com/news/articles/2021-12-06/former-lyft-cfo-roberts-joins-crypto-startup-opensea

Coinbase basics:

How big is coinbase right now? Visit the link below to see its ecosystem size and composition.

https://ml.learn-to-code.co/skillView.html?skill=JyUixCAzYHGuA29DlQjS

​​https://ml.learn-to-code.co/skillView.html?skill=DLtbt3IEaiRawm7PVSXU

Coinbase career site links:

https://ml.learn-to-code.co/skillView.html?skill=vnqABHwMCYVmR8LNzffs

Coinbase Engineering Lead on why it is not too late to get started with crypto, blockchain, and what kind of engineering problem coinbase wants to solve. [pro]

https://ml.learn-to-code.co/skillView.html?skill=MB8S4oFgKiS5tolAjpBP

Coinbase Engineering lead on exciting technical challenges for coinbase https://ml.learn-to-code.co/skillView.html?skill=jvvORo1aN3JqAOoCwpp9

OpenSea: OpenSea software engineering job and tech stack, what qualifications do you need to have to work at OpenSea, the biggest, hottest NFT market space [pro] Carefully inspect and understand opensea’s tech stack at the end of the software engineer qualification section.

https://ml.learn-to-code.co/skillView.html?skill=KS5FFY0en4GuuaaSZSTe

For more info on OpenSea, check out previous newsletter. Paid pro members just message or email us.

BLOCKCHAIN, WEB3, CRYPTO, NFT — General

What is metamask? Metamask is a crypto wallet, the gateway to the blockchain, metaverse, NFT world, and many decentralized apps (dapps). Its logo is a 3rd fox.

[Project, web dev, crypto] How to inspect Tesla payment page to know what kind of payment options and crypto payment options it offers? How to check that Tesla may offer dogecoin payment for its car. [pub, project, mini project, important]

🏅 We aim to have more mini projects like this. Like it? Vote for it. Let us know

https://ml.learn-to-code.co/skillView.html?skill=7U6j9dc52K3RNKipCiDX

Important features of a dapp, decentralized app [pro]

https://ml.learn-to-code.co/skillView.html?skill=jDWJDz6LZGv6nyF3JK79

What is alchemy, alchemy.io

https://ml.learn-to-code.co/skillView.html?skill=CZ3KEykjtOzUm0CVqF8B

What’s Avalanche (blockchain)?

https://ml.learn-to-code.co/skillView.html?skill=qtuIuysELZ4dqs0pBhyj

What is polygon (blockchain)? flash card [pro]

https://ml.learn-to-code.co/skillView.html?skill=eknsglpIWRlp0axk8CIk

Polygon + Alchemy.io [pub]

https://ml.learn-to-code.co/skillView.html?skill=lFl4YejoPf4piXCCj0jG

What is IPFS? Define IPFS [pub] It’s likely that the NFT you or your friend purchased is hosted on IPFS.

https://ml.learn-to-code.co/skillView.html?skill=BBul0e3L1e6McpAFpA4a

What is ENS .eth?

If you see people using names such as .eth, they are using ENS service. Example Yourname.eth. Read more trivia like this on our blockchain landing page. You bet one of our staff has a .eth name. It’s hyped right now. ENS is “Decentralised naming for wallets, websites, & more.” If you see people using names such as .eth, they are using ENS service. Example Yourname.eth.

TECHNICAL INTERVIEW BASICS

Did you know Google offers a free online tutorial for python? [pub]

https://ml.learn-to-code.co/skillView.html?skill=zbBfCvD5dEVdRG1Z7YP9

Think about interviewing with Google using Python? You need this tool. [pro]

https://ml.learn-to-code.co/skillView.html?skill=r5oAP7RnPgUkelvEXi9u

Getting started with python [pub]

https://ml.learn-to-code.co/skillView.html?skill=DEIMNbsgKJs74pnNIkIV

Platforms for displaying your data science portfolio [pro]

​​https://ml.learn-to-code.co/skillView.html?skill=3zmAUhBq51hHQIqjOQeK

Have you heard of Steve Jobs explaining the programming concept OOP? [pub]

https://ml.learn-to-code.co/skillView.html?skill=x2gmQCcp3fjtybpysC54

Heap — FAAANG company’s favorite interview questions

https://ml.learn-to-code.co/skillView.html?skill=NNz5sDfD5iJ2f88EL9jN

Tree traversal, recursion with illustration [new and improved, pro, illustrated]

https://ml.learn-to-code.co/skillView.html?skill=0jSSRxVCK2WQMuu9xlZW

In-order Tree traversal, pseudo code and detailed explanation [pro, high quality, pro tip]

https://ml.learn-to-code.co/skillView.html?skill=7N71VLYc8ZwrukoymVBM

FUTURE NEWSLETTER AND PROJECTS

Next Newsletter we will start to cover the next step of machine learning workflow, while still adding info about training (because training is huge)! We will want to get started with two big fields computer vision and Generative Adversarial Networks (GAN). Both have interesting real world projects and applications. On the blockchain web3 side, let’s discuss how to use crypto wallets as login, online identity and basic wallet. That is a very useful part of web3 that is easy for web2 developers to start. There will also be useful mini projects in deep learning and data science in the 2022 newsletters. We will learn to build small useful projects. Also in our newsletter pipeline : Tesla AI Day transcript and notes. We will need to spend more time diving into the math behind gradient descent, including a review of chain rule and a recap of Andrew Ng’s formula for gradient descent.

We are beefing up our technical interview sections like tree based interview questions. https://ml.learn-to-code.co/topic_tree_interview_questions_uniqtech_guide.html What makes our interview prep a bit different from question bank sites like Leetcode and Hacker Rank is that we give you information to solve types of interview questions in groups instead of solving them one by one. There are too many questions, too many variations, we need to learn the patterns to be effective. Example: previous flashcard on how to solve matrix interview questions. https://ml.learn-to-code.co/skillView.html?skill=sCmmsF1eZGGfXry78HFX

What’s amazing is that this framework works well for Uber Engineering and Google Cloud ML. Check out their ML workflow charts here. Machine learning workflow variations at Google and Uber Engineering.

https://ml.learn-to-code.co/skillView.html?skill=q7JpxnKvRKDsxoHCc1TM [uber]

https://ml.learn-to-code.co/skillView.html?skill=F6zIHZXF7f3ldnghe0zJ [google]

You can also find the link on our workflow landing page. ​​

https://ml.learn-to-code.co/topic_machine_learning_workflow.html

Developer NFT designs coming soon

“Hmm something brewing: we may have NFTs available for learners to grab in 2022. The more you learn the cooler NFTs you get. What kind of developer NFTs will you get ;-) Paid members and donors get priorities. “

Everyone learning to code, learning machine learning is like Harry when he first heard about Hogwarts. It will be a magical journey from here. We will take some inspiration from this series to our developer NFT.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store