Logstash Output DIS
This is a plugin for Logstash. It will send log records to a DIS stream, using the DIS-Kafka-Adapter.
Requirements
To get started using this plugin, you will need three things:
- JDK 1.8 +
- JRuby with the Bundler gem installed, 9.0.0.0 +
- Maven
- Logstash
Installation
0. 修改 RubyGems 镜像地址
gem sources --add https://gems.ruby-china.com/ --remove https://rubygems.org/
1. 安装 JRuby
2. 安装 Bundler gem
gem install bundler
3. 安装依赖
bundle install
rake install_jars
gem build logstash-output-dis.gemspec
4. 编辑 Logstash 的Gemfile，并添加本地插件路径
gem "logstash-output-dis", :path => "/your/local/logstash-output-dis"
5. 安装插件到 Logstash
bin/logstash-plugin install --no-verify
Usage
output
{
dis {
stream => ["YOU_DIS_STREAM_NAME"]
endpoint => "https://dis.cn-north-1.myhuaweicloud.com"
ak => "YOU_ACCESS_KEY_ID"
sk => "YOU_SECRET_KEY_ID"
region => "cn-north-1"
project_id => "YOU_PROJECT_ID"
group_id => "YOU_GROUP_ID"
decorate_events => true
auto_offset_reset => "earliest"
}
}
Configuration
Parameters
| Name | Description | Default |
|---|---|---|
| stream | 指定在DIS服务上创建的通道名称。 | - |
| ak | 用户的Access Key，可从华为云控制台“我的凭证”页获取。 | - |
| sk | 用户的Secret Key，可从华为云控制台“我的凭证”页获取。 | - |
| region | 将数据上传到指定Region的DIS服务。 | cn-north-1 |
| project_id | 用户所属区域的项目ID，可从华为云控制台“我的凭证”页获取。 | - |
| endpoint | DIS对应Region的数据接口地址。 | https://dis.cn-north-1.myhuaweicloud.com |