Using Geolocation Data in Elasticsearch
Elasticsearch is OP (I know you play a lot of games 😏) in the search-engine development world! I was recently working on a project which had 10Million data points (Entire POIs in South America) and I was asked to build a search function that can walk through these points with the speed of Flash ⚡
This entire project is divided into the following sub-question, some of them may or may not be needed in your use case, but it never hurts to know more 😇
Let’s get started !!
Task 1: Conversion of data
⚠️ If you have data available in .geojson, feel free to skip this task ⚠️
If you visit the website I mentioned from where I got the data ( or you can visit it here ), you’ll see that data is available to download in .osm.pbf format, which is not something you can use directly with Elasticsearch. I decided to convert the data (Point data inside .osm.pbf ) into .geojson. Normally we can use software like QGIS to do the task, but an easier…