Software developers constantly optimize their infrastructure in order to gain high(er) throughput and low(er) latency. Application architecture and databases are crucial areas to continually optimize. In a previous post, we discussed the master-slave strategy to scale a database using horizontal partitioning. As the name suggests, it partitions the table…

In mid-2019, I published a blog on Transformers which was more of summary of the high-level architecture. As I discussed this with my colleagues at Delvify, we decided I should write a blog to delve into more detail about this exciting technology. …

Database scaling and elasticity is vitally important to the successful operation of any software application. A failure to scale adequately can result in business impairment because applications are running slowly or are not available. Databases must be kept online and operational to protect businesses. …

The three most popular yet underrated algorithms in computer science are Heap Sort, Merge Sort, and QuickSort. It seems quite contradictory, how could something be popular yet underrated? That’s exactly what will be explained. Almost all CS students have studied and learned these three algorithms with Sudo code but only…

Many of our readers may have heard about BERT, the acronym for a Bidirectional Encoder Representation Transformer. Some might have used the pre-trained model from BERT for fine-tuning on their own tasks using their own datasets. …

The types of videos served by YouTube’s video recommendations have been in the news recently due to some controversial content recommendations. Some viewers are delighted to watch fun video after fun video neglecting other important tasks to dive down a rabbit hole, but there is a concern than some videos…

In 2014 a group at Baidu labs, including my friend, Awni Hannun who is currently working at Facebook AI Research., published an interesting and influential paper entitled DeepSpeech: Scaling up end-to-end Speech Recognition. Primarily concerned with the mechanics of taking audio as an input and converting it to a textual…

The concept of serverless computing is not new. It came into existence about the same time as Kubernetes in 2014, but only recently has its popularity markedly increased as the demand for dynamic scalability and the desire to avoid infrastructure tasks has increased. Each provider calls the concept of serverless…

BERT, (Bidirectional Encoder Representations from Transformers) the revolutionary new method for improving results in various NLP (Natural Language Processing) tasks, has been for more than a year. There is great excitement in using attention networks and it seems there are new uses for the BERT model on NLP tasks being…