Almost all real world applications on SolrCloud would require adding some custom libs, specifically the custom text analyzers, to provide good search experiences. However, Solr has not yet supported adding text analyzers libs dynamically on a live cluster, and thus we figured out a way to install custom libs automatically when deploying SolrCloud with Solr Helm chart.

Image for post
Image for post
Photo by m0851 on Unsplash

Solr Limitations of Adding Custom Libraries Dynamically

In real-world use cases, many people would often need to add custom text-analyzers in their SolrCloud to provide better search results for specific languages.

Though Solr does provide a way to install custom libraries on a live SolrCloud — Solr Blob Store API, it does not work for all types of components you may need to add in your SolrCloud, as you can see from the following description in a Solr issue (https://issues.apache.org/jira/browse/SOLR-9175). …


K8s services itself consume a noticeable amount of resources of the cluster. In this series, we talk about how we set up a K8s SolrCloud that attains minimum availability at low costs. In part 2, we went through the steps to start a K8s cluster with Kops. In this article, we will continue to look at how we reduced the memory footprint of SolrCloud and deployed it on a K8s cluster.

Image for post
Image for post
Source: https://en.wikipedia.org/wiki/Apache_Solr

Prerequisites

The following tools must be ready in your development environment.

Install Helm (v3)

Solr Chart

Helm is the package manager for Kubernetes. A package is called a chart in this ecosystem. …


We had been running a SolrCloud on 3 t2-micro machines on AWS for our service. It provided stable, highly available services at low costs — around $250/year with reserved instance.

Recently, we decided to move the servers on to the containernized world, and started to test out Kubernetes. However, after playing with it for a week, we found that K8s services itself consume a noticeable amount of resources of the cluster, which made it seem impossible to run our current SolrCloud on it without upgrading EC2 machines.

However, with the determination of keeping our costs low, I tested and tweaked K8S and SolrCloud for a few days, and finally pull it off. …


K8s services itself consumes a noticeable amount of resources of the cluster. In this series, we talk about how we set up a K8s SolrCloud on AWS that attains minimum availability at low costs. In part 1, we talked about things to consider to cut down the costs. Now, let’s continue to see how we build the K8s cluster by Kops.

Image for post
Image for post
Photo by Sebastian Herrmann on Unsplash

Prerequisites

Create the K8s Cluster Config

With kops, we can create a cluster config just by running the following command. This will only create a cluster config in your S3 bucket so you can create the config first and then edit it as many times as you like before you really create the cluster on AWS. …

About

John The Traveler

An entrepreneurial software engineer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store