Kin LauSpark Cache Table CommandI have been MIA in Medium for months because I didn’t find any good topics to share with others. Last week when I was helping my data…Feb 19Feb 19
Kin LauStand up an Apache Zookeeper cluster on Ubuntu LinuxZookeeper is nothing new to people who have been doing big data development for the past decade because it is an essential component for…Aug 1, 2023Aug 1, 2023
Kin LauEnable SSL on Apache IgniteIn my previous article, I mentioned that I have been working on an Apache Ignite cluster in my lab environment. After setting up a Spark…Mar 3, 2023Mar 3, 2023
Kin LauChatGPT, Apache Spark, and Apache IgniteI have been quiet for a while in Medium because I was busy dealing with some office dramas at work that people put their reputation and ego…Feb 24, 2023Feb 24, 2023
Kin LauEnable Firewall on Apache Spark Part 2Yesterday I published a new article about enabling firewall on my Spark cluster. Last night, I continued the effort and activated the…Jan 3, 2023Jan 3, 2023
Kin LauEnable Firewall for Spark ClusterI haven’t had much time lately to play with my computer because of all the holiday activities. However, there is one important thing on my…Dec 29, 2022Dec 29, 2022
Kin LauUse RabbitMQ and Celery Executor for Apache AirflowIf you accept all defaults during the installation, Apache Airflow would provide the sequential executor as the default executor…Dec 1, 2022Dec 1, 2022
Kin LauInstall Airflow on Redhat Linux with MSSQL IntegrationThis was more challenging than I expected. I published an article regarding installing Airflow on Ubuntu a few weeks ago and expected the…Oct 18, 2022Oct 18, 2022
Kin LauMaven package management and IntelliJThis article is about the frustrations I have encountered with Maven package management when developing in IntelliJ. I wish IntelliJ could…Oct 13, 2022Oct 13, 2022
Kin LauConnect Airflow with Spark clusterThis article is primarily for my own documentation so I won’t forget how to do this in the future. Yes, there are at least a few articles…Oct 8, 20222Oct 8, 20222