Krishna GollainSnowflake·1 day agoPower BI — Snowflake Performance Enhancements with Horizontal FusionMany times customers say that their Power BI report performance gets slower when their reports are running against their Snowflake instance especially while using the Direct Query mode. Often, the recommendation is to use the Import mode but that’s not always possible given the dataset sizes or data freshness requirements…Azure7 min read
John Thuma·11 hours agoSnowflake Massive Scale Testing — Part 1WARNING… READ AT YOUR OWN RISK! USE AT YOUR OWN RISK!! I DOUBLE DOG DARE YOU! IT CANT BE DONE! SNOWFLAKE CANT DO IT! YOU CANT HANDLE THE TRUTH! (Jack’s best movie) So how many times in my life have I been challenged? It can’t be done. The product won’t…Azure12 min read
Suman Srivastava·1 day agoArgocd with AKS is funArgocd is gaining popularity, since this has changed the way of deployment specifically the pull method. Seting up your Argocd is quick easy and simple to manage. In this demo we are going to setup Argocd on AKS cluster with terraform. Table of contents Setting up your environment Build your storage account for…Azure3 min read
Bryant Jimin Son·1 day agoMember-onlyHow to connect to Microsoft Azure or AWS virtual machines and to install softwares through Ansible playbook scriptIn this blog, I will explain how you can leverage a popular configuration management tool called Ansible to copy files from your local computer to a remote Windows Virtual Machine then to download software and to install softwares through chocolatey. …Azure4 min read
John Thuma·13 hours agoSnowflake Data Profiler ScriptData profiling seems pretty simple and for the most part it is. It helps us determine the shape of the data in my tables. There are plenty of tools that do data profiling, many of them are free. Talend has many tools for data profiling and I do recommend them…Azure10 min read
Edward KuoinEK.Technology Learn·19 hours agoPowerShell 設定與查詢 Azure App 存取限制在Azure上，如果你是用Web App或Azure Function建立服務，而這些服務並非是廣泛被公開可以存取的話，通常我們都會設定存取限制，讓被允許的Azure服務或是IP位置才可以存取相關的服務。不過，當在Azure服務眾多時候，也無法一個服務一個服務檢查是否都有設定相關的存取限制限制條件。因此，這邊可以透過Power Shell再搭配a …Azure5 min read
John Thuma·12 hours agoSnowflake Stale Tables — Prevent the Data SwampHow do I prevent the Data SWAMP? I have so many databases, schemas, tables, and users. I allow some people to have a sandbox where they can upload their own data. Is there a way I can see if people are using the tables? Is there a way I can…Azure11 min read
All about Data Engineering·1 day agoAzure SQL database Vs Azure Synapse SQL Dedicated PoolIf you have ever encountered a situation on whether Azure SQL database or Azure Synapse dedicated pool is the best fit for your data storage needs, then this is the article for you. Azure SQL DB and Azure Synapse Dedicated SQL pool are similar in that they are PaaS options…Azure4 min read
Genny Allcroft·1 day agoAzure Hub-spoke Network TopologyToday I have some time to learn about hub-spoke network topology in Azure. I previously did some reading up on Azure architecture — you can see my article on that here so I am aware of the basics. I’ve also done a bit of reading on network traffic routing —…Azure4 min read
Nitin Gaurav·1 day agoAdministering Databricks — Getting started (2), accessing Azure Databricks workspace using databricks Personal access tokenThis is the second article in the series on Administering databricks. And more will follow of course. We will try to see how we create databricks access tokens and where can we use databricks tokens.This article will mainly focus you how to create PAT and best practices around it. What…Azure3 min read
