OpenTelemetry Launchers: what they solve and why we need them
Exciting times in Otel land! OpenTelemetry is close to GA and v1.0 in a number of languages. We are close to finalizing the specification. Release candidates before the end of the year are looking very likely.
Ever since Ben and I co-founded the OpenTelemetry project by merging our prior project (OpenTracing) with its sibling (OpenCensus), we’ve been pushing hard at Lightstep to help make OpenTelemetry a reality. It has been reaffirming to see the beta take off, and watch OpenTelemetry implementations work their way into production.
Based on beta feedback, we now consider Python, NodeJS, Java and Go to be ready for adoption. I am so happy to announce that Lightstep is officially making OpenTelemetry our recommended choice for getting started in these four languages. OpenTelemetry is real, and you can use it today.
However, there is one issue which still needs to be addressed: a way to encapsulate setup and configuration.
To explain: OpenTelemetry is a framework. It was designed to be modular and extensible, more like a toolkit and a platform for innovation than a one-size-fits-all solution. And while a flexible framework with a clear separation of concerns has many advantages, it does come with a drawback: complexity. Without encapsulation, the modularity can end up looking like a bucket of legos. That’s great if you want to build new observability tools (or create adapters to work with existing ones), less great if you just want to get started with the tools we have already built.
Without encapsulation, OpenTelemetry looks intimidating to set up. The code below represents the minimum configuration needed to get started today with OpenTelemetry and connect it to Lightstep with the correct configuration.
I believe the technical term is 🤮. Well factored, but hardly elegant.
To clean this copypasta up, the OpenTelemetry team here at Lightstep created a clean way to bundle up all of this bootstrapping, without restricting access to any option or extension point. We’re releasing this packaging layer today as the OpenTelemetry Launchers: a Lightstep distribution of OpenTelemetry.
To say the least, this has way more ✨ than using the lower-level APIs directly.
We have made launchers for Python, Java, NodeJS, and Go. We hope to see the launchers (or something like them) baked into OpenTelemetry core. Please try them out and give us feedback.
These launchers can also serve as an example for anyone seeking to build a custom OpenTelemetry distribution. Many existing analysis tools(and future experimental ones) will require specific configuration options and plugins in order to work correctly. Sampling is a good example of a feature where existing tools take wildly different (and incompatible) approaches, and there is still a lot of active development. Another example is which instrumentation libraries to include: some distributions may want to include every library available on the internet, others may want to only include libraries vetted via a security process. Still others may require non-standard plugins which only apply to specific environments.
I see the community developing a healthy ecosystem of OpenTelemetry distributions: easy to discover, simple to swap with each other. Once OpenTelemetry core is complete, this type of packaging is one area where I would like to turn our attention.
In related news, I’ve also started work on a new knowledge base. If you look around opentelemetry.lightstep.com, you will find links to getting started guides in Go, Python, Java, and Javascript. This is only the beginning (the website isn’t even finished, lol). You can expect to see more guides, best practices, and tutorials in the coming months. Keep checking back in, or follow me on twitter if you want to know when new content is published. My goal is to make this the best resource available for learning about OpenTelmetry, distributed tracing, and observability in general. Please check it out, and let me know what kind of content you’d like to see.
It’s been a great adventure so far. First and foremost, open source is about the people. I’d like to thank Kay, Andrew, Mitch, Steven, Alex, Matt, Carlos, Austin and Josh for all the work they have put in as core contributors, OpenTelemetry language maintainers, and Technical Committee members. Special shout out to Eric for making the docs site a reality.
From here to GA, it is going to be a blast.
🚀✨
