Ahmad Nayyar HassanSchedule Queries in Redshift using Redshift ServiceWe can now use the query editor with Redshift service to not only run, view, save, but also schedule SQL queries based on a specified time…Aug 30Aug 30
Ahmad Nayyar HassanConnect to AWS Public Services from AWS Services with a VPC with no Internet AccessMe and my team recently experienced a scenario where we were trying to connect to an AWS public service called AWS Transfer Family from a…Aug 14Aug 14
Ahmad Nayyar HassanCreate a SFTP Server and connect to it using a SFTP connector using AWS Transfer FamilyCreate S3 Backed SFTP ServerAug 13Aug 13
Ahmad Nayyar HassanSnowFlake Features and ArchitectureWhat is SnowFlake? a. Cloud Native b. SaaS (Software as a Service) c. Data Platform (SQL Warehouse, Data Analytics and Machine Learning…Aug 13Aug 13
Ahmad Nayyar HassanSnowflake Storage LayerMicro-partitions: a. Partition size : 50–500 MB of Un compressed data b. Columnar Storage c. Partition Metadata (contains MIN and MAX…Aug 11Aug 11
Ahmad Nayyar HassanSnowFlake FunctionsGeneral Functions: a. Scalar Functions — Example: UUID_STRING() b. Aggregate Functions — Example: MAX() c. Window Functions — Example…Aug 11Aug 11
Ahmad Nayyar HassanLambda Layer : Use different dependencies versions than present in Lambda RunTimesMy team and I recently encountered a scenario where we needed a library/package with latest version which was not supported by the given…Aug 10Aug 10
Ahmad Nayyar HassanSnowFlake Data Loading and Un LoadingData Loading: a. Insert into commands b. Snowflake UI c. Copy into commands (Bulk Loading) — keeps load history of 64 days for no…Aug 10Aug 10
Ahmad Nayyar HassanSnowFlake Performance Tuning and Query OptimizationsQuery Monitoring: a. History Tab — Contains 14 days of queries — Shows queries of all users but query results are only available to…Aug 8Aug 8
Ahmad Nayyar HassanSnowflake Compute Infrastructure — Virtual WarehousesVirtual Warehouse : A named abstraction for MPP (Massively Parallel Processing) compute nodesAug 7Aug 7