Logz.io plugin for Fluentd

With fluent-plugin-logzio-ng you will be able to use Logz.io as output the logs you collect with Fluentd.

Getting Started

• Install Fluentd
• gem install fluent-plugin-logzio-ng
• Make sure you have an account with Logz.io.
• Configure Fluentd as below:
• It's recommended to set flush_interval to 2-3s.
  • because after 5 second logz.io close TCP connection
  • so TCP connections aren't reused - fluentd will open new one
  • so logz.io servers react with TCP resets on a lot of new TCP connection that fluentd will open.

    <match your_match>
      type logzio_buffered
      endpoint_url https://listener.logz.io:8071?token=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx&type=my_type
      output_include_time true
      output_include_tags true
      buffer_type    file
      buffer_path    /path/to/buffer/file
      flush_interval 2s
      buffer_chunk_limit 1m   # Logz.io has bulk limit of 10M. We recommend set this to 1M, to avoid oversized bulks
    </match>

If you absolutly must, use the non-buffered plugin (we really recommend using the buffered)

    <match your_match>
      type logzio
      endpoint_url http://listener.logz.io:8090?token=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
    </match>

Parameters

• endpoint_url the url to Logz.io input where xxx-xxxx... is your Logz.io access token, and my_type is the type of your logs in logz.io
• output_include_time should the appender add a timestamp to your logs on their process time. (recommended)
• output_include_tags should the appender add the fluentd tag to the document, called "fluentd_tag"
• http_idle_timeout timeout in seconds that the http persistent connection will stay open without traffic