Connected Observability Pipelines in the OpenTelemetry Collector

May 01, 2023 27 min Free

Description

The OpenTelemetry Collector is a powerful tool for collecting, processing, and forwarding observability signals. User-defined pipelines control the flow of data through the collector. A new feature has made it possible to link pipelines together, enabling more sophisticated control and processing of observability signals. In this session Dan Jaglowski will introduce connectors, a new type of pipeline component that directly links pipelines to one another. Connectors can replicate or route data between pipelines, reduce data volume with multi-signal logic (e.g. derive summary metrics from logs or spans), even detect and report anomalies. Come broaden your understanding of pipelines and learn how to implement multi-pipeline data flow strategies. If you're not already familiar with pipelines, don't worry. Dan will provide a concise introduction to the OpenTelemetry Collector and its pipeline framework before explaining how connectors extend the architecture.