With the growing integration of AI/ML into applications and business processes, production-grade ML models require more scalable infrastructure and compute power for training and deployment.
Modern ML algorithms train on large volumes of data and require billions of iterations to minimize their cost functions. Vertical scaling of such models involves OS-level bottlenecks — including the number of CPUs, GPUs, and storage that can be provisioned — and has proven to be inefficient for such models. …
By IOD Expert, Samuel James
Microservice architecture and systems have become the new model for building modern-day applications. While decoupled services are easy to scale and manage, increasing interactions between those services have created a new set of problems. It’s no surprise that debugging was listed as a major challenge in the annual state of microservices report.
When your systems are distributed, various things can go wrong. Even if you’ve written the perfect code, a node may fail, a connection may timeout, or participant servers may act arbitrarily. The bottom line is that things will break. And when they do…
By IOD Expert Samuel James
If you’re a person working in DevOps or on a software development team, you’ve probably heard the expression “You build it, you run it,” coined by Werner Vogels, the CTO of Amazon, in 2016. This attitude dominates the DevOps approach.
Modern applications serve millions of requests from users across different geographical regions around the world. It’s a must that teams find an efficient way of distributing workloads across servers to maximize speed and capacity utilization.
In this post, you’ll learn how load balancing works in the cloud, specifically on Google Cloud Platform, and which load…
By IOD Expert Raphael Do Vale
Searches for Kubernetes have increased steadily over the years, with more and more people trying to understand exactly what K8s is, and better yet, how they can take advantage of this technology.
So, what is Kubernetes?
Simply put, K8s is a container orchestrator platform capable of running different workloads in different environments with great flexibility. It allows an operator to set a minimum and a maximum number of machines for each application and how the app should upgrade. It allows easy deployment with zero downtime and quick recovery.
By IOD Expert Matt Billock
AWS Lambda is a powerful tool for developing serverless applications and on-demand workflows. However, this power comes at a cost in terms of flexibility and ease of deployment, as the manual deployment process that AWS Lambda recommends can be error-prone and hard to scale.
CloudFormation revolutionizes this process, replacing copied zip files with dependable and repeatable template-based deployment schemes. With CloudFormation, your Lambda functions will be easier to maintain, easier for your developers to understand, and easier to scale as your application grows.
AWS Lambda function deployments are based around file handling — namely, by…
By Ofir Nachmani, CEO, IOD
When the U.S. Department of Defense (DoD) announced late last year that Microsoft had won the contract for its Joint Enterprise Defense Infrastructure (JEDI) project (worth up to $10 billion), it rocked the IT world.
All of the leading contenders — Amazon, IBM, Oracle, and Google — were in the running, though smaller players were eliminated early on. But the ultimate choice of Microsoft came as a shock.
Azure beat out Amazon’s AWS in a surprise decision that, as of the writing of this article in 2020, Amazon continues to contest — so the final…
By Joao Cardoso, IOD Expert
When Amazon introduced Lambda in 2014, it was an absolute game changer. While it wasn’t the first serverless compute service or even the first Function as a Service (FaaS) product, Lambda quickly and undoubtedly became the most well-known product in these areas. And for good reasons: It made running code possible without thinking about servers, and its pricing model was the cherry on top. …
By IOD Expert Daniel D’Agostino
Graph databases are a category of NoSQL storage engines that make it easy to represent and query highly connected data. While SQL databases can certainly be used to represent relationships, their performance is unable to keep up with that of graph databases at scale for large amounts of data with intricate relationships. Graph databases are also a lot more flexible in terms of schema and can answer questions about patterns in data relationships almost instantly.
Although many of us are used to using SQL databases for everything as a matter of habit, the applicability of…
By IOD Expert Yitzi Ginzberg
For the past few hours, I’ve been working on training a neural network to translate cat speech into English. I’ve carefully optimized my parameters and tested different network depths, batch sizes, number of epochs, and optimization algorithms. I’m pretty happy with the 92% accuracy rating that I’m getting now, and, with a few more tweaks, I’m confident that I can get to 95% accuracy.
Okay… none of that is true.
In reality, I’ve spent the past few hours playing while True: learn(), a computer game where you take on the persona of a software developer…
By IOD Expert Artem Arkhipov
Nowadays, different processes are supported by various chat bots. Some are designed to guide users through the multiple steps of a complex process flow, but there are also a lot of small bots created to help users with trivial routine tasks — or even just for fun. In this post, I’m going to show you how to build a Telegram bot that will work as a URL shortener using serverless.
First of all, let’s discuss what serverless actually is. Martin Fowler defines it like this:
“Serverless architectures are application designs that incorporate third-party ‘Backend as…