Pgbouncer a connection pooler application that is widely used in any PostgreSQL environment. It's very lightweight but handles tons of connections. In the SRE world, now observability is playing an important role. This cool pgbouncer has some inbuilt tables(or views) to view the current status and historical stats. But it’s…

GCP CloudSQL has 3 different database software which includes one of the best opensource databases PostgreSQL. The common DBA tasks like Backup, Patching, Auto Failover, and a few other things are managed by GCP. It also provides the inhouse stackdriver monitoring for PostgreSQL. But for a mission-critical databases needs a…

MySQL replication is one of the simplest replication methods that we ever experienced. We have done so many MySQL migrations across multiple Cloud platforms like AWS, GCP, and Azure. In AWS the MySQL migration to RDS is straight forward. We can use our favorite backup tools such as mysqldump, mydumper…

BigQuery is the serverless data warehouse service in GCP. At the time of writing this blog, GCP introduced BigQuery Omni that will bring BigQuey to a multi-cloud platform. At Google Cloud Next’20 many features got introduced. This will definitely attract the customers to play around with the BigQuery, and migrate…

One of our customers, India’s largest broadcast satellite service provider decided to migrate their giant IBM Netezza data warehouse with a huge volume of data(30TB uncompressed) to AWS RedShift. Along with Netezza, it was also decided that all the downstream applications also will be migrated to AWS. Considering how critical…

AWS RedShift is a managed Data warehouse solution that handles petabyte scale data. This blog post helps you to efficiently manage and administrate your AWS RedShift cluster. It is a managed service, but still, we have to take care of a few things to make it better. Even with Zero…

Whether you are managing a single node Redshift cluster or a huge multi-node cluster, for the business users performance is the important thing. In RedShift, performance optimization starts from the basic table design itself. When you run into performance issues on your production cluster, you may reactively search for diagnostic…

AWS RDS PostgreSQL has logical replication enabled from 9.4+ onwards. Generally in a logical replication once the subscriber is enabled, CDC will be captured in the logical replication slots and also it’ll start sync the historical data(initial sync) from the Publisher itself with the COPY process. If you have a…

Oracle databases are great but for analytics, people need some massively scalable warehouse like BigQuery. In this blog, we are going to see how to sync oracle data to BigQuery with the golden gate bigquery adapter with the initial load. Oracle golden gate has a large variety of big data…