CODEWITHSUNDEEP
elasticsearchlogstash-grokgrok
RedHead_121
RedHead_121

Reputation: 55

Logstash Grok error

My logstash configuration is giving me this error:

whenever i run this command: /opt/logstash/bin/logstash -f /etc/logstash/conf.d/logstash.conf --auto-reload --debug 

reason=>"Expected one of #, {, ,, ] at line 27, column 95 (byte 677) after filter {\n\n\tif [type] == \"s3\" {\n\t\tgrok {\n\t\n  \t\t\tmatch => [\"message\", \"%{IP:client} %{USERNAME} %{USERNAME} \\[%{HTTPDATE:timestamp}\\] (?:\"", :level=>:error, :file=>"logstash/agent.rb", :line=>"430", :method=>"create_pipeline"}

This has to do with my pattern.But when i checked same in Grok online debugger its giving me required answer.Please help.

Here is my logstash configuration: 

input {
    s3 {
      access_key_id => ""
      bucket => ""
      region => ""
      secret_access_key => ""
      prefix => "access"
      type => "s3"
      add_field => { source => gzfiles }
      sincedb_path => "/dev/null"
      #path => "/home/shubham/logstash.json"
      #temporary_directory => "/home/shubham/S3_temp/"

      backup_add_prefix => "logstash-backup"
      backup_to_bucket => "logstash-nginx-overcart"


}

}

 filter {

        if [type] == "s3" {
                grok {

                        match => ["message", "%{IP:client} %{USERNAME} %{USERNAME} \[%{HTTPDATE:timestamp}\] (?:"%{WORD:request} 
        %{URIPATHPARAM:path} HTTP/%{NUMBER:version}" %{NUMBER:reponse} %{NUMBER:bytes} "%{USERNAME}" %{GREEDYDATA:responseMessage})"]
        }
        }
        }

 output {
    elasticsearch {
    hosts => ''
    index => "accesslogs"
}
  }

Upvotes: 0

Views: 337

Answers (1)

Sönke Liebau
Sönke Liebau

Reputation: 1973

You have a couple of unescaped " characters in your match assignment (around the username var for example), which trip up the parser. If you escape those with a \ it should work.

Upvotes: 0

Related Questions