102      人物

Logstash收集其它日誌__常見日誌格式_用戶指南_日誌服務-阿裏雲

2016-02-25 15:37:01 [main] INFO com.aliyun.sls.test_log4j - single line log
2016-02-25 15:37:11 [main] ERROR com.aliyun.sls.test_log4j - catch exception !
 java.lang.ArithmeticException: / by zero
    at com.aliyun.sls.test_log4j.divide(test_log4j.java:23) ~[bin/:?]
    at com.aliyun.sls.test_log4j.main(test_log4j.java:13) [bin/:?]
2016-02-25 15:38:02 [main] INFO com.aliyun.sls.test_log4j - normal log

采集配置

input {
  file {
    type => "common_log_1"
    path => ["C:/test/multiline/*.log"]
    start_position => "beginning"
    codec => multiline {
      pattern => "^d{4}-d{2}-d{2} d{2}:d{2}:d{2}"
      negate => true
      auto_flush_interval => 3
      what => previous
    }
  }
}
output {
  if [type] == "common_log_1" {
  logservice {
        codec => "json"
        endpoint => "***"
        project => "***"
        logstore => "***"
        topic => ""
        source => ""
        access_key_id => "***"
        access_key_secret => "***"
        max_send_retry => 10
    }
    }
}

1. 配置文件格式必須以UTF-8無BOM格式編碼，可以下載notepad++修改文件編碼格式。
2. path填寫文件路徑時請使用UNIX模式的分隔符，如：C:/test/multiline/*.log，否則無法支持模煳匹配。
3. type字段需要統一修改並在該文件內保持一致，如果單台機器存在多個logstash配置文件，需要保證各配置type字段唯一，否則會導致數據處理的錯亂。