Fluent-plugin-openlineage-light, a plugin for Fluentd
fluent-plugin-openlineage-light is a Fluentd plugin that verifies if a JSON matches the OpenLineage schema, but doesn't go deeper into the verification. This plugin is ideal for companies that have recently joined the lineage idea but haven't been able to apply all of its feature yet. It is intended to be used together with a Fluentd Application.
Requirements
| fluent-plugin-prometheus | fluentd | ruby |
|---|---|---|
| 1.x.y | >= v1.9.1 | >= 2.4 |
| 1.[0-7].y | >= v0.14.8 | >= 2.1 |
| 0.x.y | >= v0.12.0 | >= 1.9 |
Installation
Add this line to your application's Gemfile:
gem 'fluent-plugin-openlineage-light'
And then execute:
$ bundle
Or install it yourself using one of the following:
$ gem install fluent-plugin-openlineage-light
$ fluent-gem install fluent-plugin-openlineage-light
Usage
fluentd-plugin-openlineage-light include only one plugin.
openlineageparse plugin
For any additional information, you can check out Fluentd official documentation on https://docs.fluentd.org/monitoring-fluentd/monitoring-prometheus#example-prometheus-queries# fluentd-openlineage-parser