Almost all real world applications on SolrCloud would require adding some custom libs, specifically the custom text analyzers, to provide good search experiences. However, Solr has not yet supported adding text analyzers libs dynamically on a live cluster, and thus we figured out a way to install custom libs automatically when deploying SolrCloud with Solr Helm chart.
In real-world use cases, many people would often need to add custom text-analyzers in their SolrCloud to provide better search results for specific languages.
Though Solr does provide a way to install custom libraries on a live SolrCloud — Solr Blob Store API, it does not work for all types of components you may need to add in your SolrCloud, as you can see from the following description in a Solr issue (https://issues.apache.org/jira/browse/SOLR-9175). …
K8s services itself consume a noticeable amount of resources of the cluster. In this series, we talk about how we set up a K8s SolrCloud that attains minimum availability at low costs. In part 2, we went through the steps to start a K8s cluster with Kops. In this article, we will continue to look at how we reduced the memory footprint of SolrCloud and deployed it on a K8s cluster.
The following tools must be ready in your development environment.
We had been running a SolrCloud on 3 t2-micro machines on AWS for our service. It provided stable, highly available services at low costs — around $250/year with reserved instance.
Recently, we decided to move the servers on to the containernized world, and started to test out Kubernetes. However, after playing with it for a week, we found that K8s services itself consume a noticeable amount of resources of the cluster, which made it seem impossible to run our current SolrCloud on it without upgrading EC2 machines.
However, with the determination of keeping our costs low, I tested and tweaked K8S and SolrCloud for a few days, and finally pull it off. …
K8s services itself consumes a noticeable amount of resources of the cluster. In this series, we talk about how we set up a K8s SolrCloud on AWS that attains minimum availability at low costs. In part 1, we talked about things to consider to cut down the costs. Now, let’s continue to see how we build the K8s cluster by Kops.
With kops, we can create a cluster config just by running the following command. This will only create a cluster config in your S3 bucket so you can create the config first and then edit it as many times as you like before you really create the cluster on AWS. …