Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove deprecated kafka flags #1424

Merged

Conversation

ledor473
Copy link
Member

@ledor473 ledor473 commented Mar 15, 2019

They are deprecated in favor of kafka.producer and kafka.consumer flags

Which problem is this PR solving?

Short description of the changes

$ SPAN_STORAGE_TYPE=kafka go run cmd/ingester/main.go -h

Jaeger ingester consumes spans from a particular Kafka topic and writes them to all configured storage types.

Usage:
  (experimental) jaeger-ingester [flags]
  (experimental) [command]

Available Commands:
  env         Help about environment variables
  help        Help about any command
  version     Print the version

Flags:
      --config-file string                   Configuration file in JSON, TOML, YAML, HCL, or Java properties formats (default none). See spf13/viper for precedence.
      --downsampling.hashsalt string         Salt used when hashing trace id for downsampling.
      --downsampling.ratio float             Ratio of spans passed to storage after downsampling (between 0 and 1), e.g ratio = 0.3 means we are keeping 30% of spans and dropping 70% of spans; ratio = 1.0 disables downsampling. (default 1)
      --health-check-http-port int           The http port for the health check service (default 14270)
  -h, --help                                 help for (experimental)
      --ingester.deadlockInterval duration   Interval to check for deadlocks. If no messages gets processed in given time, ingester app will exit. Value of 0 disables deadlock check. (default 1m0s)
      --ingester.http-port int               The http port for the ingester service (default 14271)
      --ingester.parallelism string          The number of messages to process in parallel (default "1000")
      --kafka.consumer.brokers string        The comma-separated list of kafka brokers. i.e. '127.0.0.1:9092,0.0.0:1234' (default "127.0.0.1:9092")
      --kafka.consumer.encoding string       The encoding of spans ("json", "protobuf", "zipkin-thrift") consumed from kafka (default "protobuf")
      --kafka.consumer.group-id string       The Consumer Group that ingester will be consuming on behalf of (default "jaeger-ingester")
      --kafka.consumer.topic string          The name of the kafka topic to consume from (default "jaeger-spans")
      --kafka.producer.brokers string        (experimental) The comma-separated list of kafka brokers. i.e. '127.0.0.1:9092,0.0.0:1234' (default "127.0.0.1:9092")
      --kafka.producer.encoding string       (experimental) Encoding of spans ("json" or "protobuf") sent to kafka. (default "protobuf")
      --kafka.producer.topic string          (experimental) The name of the kafka topic (default "jaeger-spans")
      --log-level string                     Minimal allowed log Level. For more levels see https://github.com/uber-go/zap (default "info")
      --metrics-backend string               Defines which metrics backend to use for metrics reporting: expvar, prometheus, none (default "prometheus")
      --metrics-http-route string            Defines the route of HTTP endpoint for metrics backends that support scraping (default "/metrics")
      --span-storage.type string             Deprecated; please use SPAN_STORAGE_TYPE environment variable. Run this binary with "env" command for help.

Use "(experimental) [command] --help" for more information about a command.

…nsumer flags

Signed-off-by: Louis-Etienne Dorval <louis-etienne.dorval@ticketmaster.com>
@ledor473
Copy link
Member Author

Before we merge, I'd like to try the Kafka to Kafka flow.

Yuri Shkuro added 5 commits March 17, 2019 17:57
Signed-off-by: Yuri Shkuro <ys@uber.com>
Signed-off-by: Yuri Shkuro <ys@uber.com>
Signed-off-by: Yuri Shkuro <ys@uber.com>
Signed-off-by: Yuri Shkuro <ys@uber.com>
Signed-off-by: Yuri Shkuro <ys@uber.com>
@codecov
Copy link

codecov bot commented Mar 17, 2019

Codecov Report

Merging #1424 into master will not change coverage.
The diff coverage is 100%.

Impacted file tree graph

@@          Coverage Diff           @@
##           master   #1424   +/-   ##
======================================
  Coverage     100%    100%           
======================================
  Files         165     165           
  Lines        7572    7503   -69     
======================================
- Hits         7572    7503   -69
Impacted Files Coverage Δ
plugin/storage/kafka/options.go 100% <ø> (ø) ⬆️
cmd/ingester/app/flags.go 100% <100%> (ø) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 44eaf08...99a965c. Read the comment docs.

Signed-off-by: Yuri Shkuro <ys@uber.com>
@yurishkuro yurishkuro merged commit 1157a7d into jaegertracing:master Mar 17, 2019
chvck pushed a commit to chvck/jaeger that referenced this pull request Mar 18, 2019
* Remove deprecated kafka flags in favor of kafka.producer and kafka.consumer flags

Signed-off-by: Louis-Etienne Dorval <louis-etienne.dorval@ticketmaster.com>

* run make fmt

Signed-off-by: Yuri Shkuro <ys@uber.com>

* update kafka flags in the integration test

Signed-off-by: Yuri Shkuro <ys@uber.com>

* Fix test

Signed-off-by: Yuri Shkuro <ys@uber.com>

* Fix Kafka integration test

Signed-off-by: Yuri Shkuro <ys@uber.com>

* More test fixes

Signed-off-by: Yuri Shkuro <ys@uber.com>

* Fix changelog

Signed-off-by: Yuri Shkuro <ys@uber.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants