Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

logstash-7.1.0 stores headers as value #83

Open
giovannicadiz opened this issue May 15, 2020 · 0 comments
Open

logstash-7.1.0 stores headers as value #83

giovannicadiz opened this issue May 15, 2020 · 0 comments

Comments

@giovannicadiz
Copy link

giovannicadiz commented May 15, 2020

  • logstash-7.1.0
  • Windows 10

I have a problem loading data with losgatsh this when executing logshtash.bat only stores headers as values. Previously it had 2 pipes and now only 1 but it is not solved. I have tried several filters but it does not work

  1. Input csv:

ipaddress;name;isp;state;isreachable;operativo;request;response;total_seconds;enviados;recibidos;perdidos;performance
127.0.0.1;TD-26;Nextel;Initialized;1;UP;2020-05-15 01:30:02.278598;2020-05-15 01:30:07.387343;5.108745;5;5;0;100.0

  1. config file:

input {
file {
start_position => beginning
path => "C:/ELK/logstash-7.1.0/data/td/ping/*.csv"
sincedb_path => "C:/ELK/logstash-7.1.0/sincedb/sincedb_app_concentrator_ping/sincedb.log"
}
}
filter {
csv {
separator => ';'
#autodetect_column_names => true
columns => ["ipaddress", "name", "isp", "state", "isreachable", "operativo", "request", "response", "total_seconds", "enviados", "recibidos", "perdidos", "performance"]
}

# mutate {
# 	remove_field => ["message", "@version", "_id", "_score", "_type", "host", "path"]
# }

}
output {

elasticsearch {
	hosts => "localhost:9200"
	index => "index_concentrator_ping"
	user => logstash_internal 
	password => logstash_internal

}
stdout {codec => rubydebug}

}

  1. stdout:

{
"isreachable" => "isreachable",
"operativo" => "operativo",
"name" => "name",
"isp" => "isp",
"perdidos" => "perdidos",
"message" => "ipaddress;name;isp;state;isreachable;operativo;request;response;total_seconds;enviados;recibidos;perdidos;performance\r",
"@Version" => "1",
"path" => "C:/ELK/logstash-7.1.0/data/td/ping/temp_TD-105941.csv",
"host" => "CHLEDX10S028430",
"total_seconds" => "total_seconds",
"state" => "state",
"enviados" => "enviados",
"request" => "request",
"@timestamp" => 2020-05-15T17:11:56.832Z,
"recibidos" => "recibidos",
"ipaddress" => "ipaddress",
"response" => "response",
"performance" => "performance"
}

any solution?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant