jaeger icon indicating copy to clipboard operation
jaeger copied to clipboard

SURVEY: Who is using Jaeger

Open badiib opened this issue 7 years ago • 42 comments

Hi, you are in a group of individuals who have create or commented on issues in the Jaeger repository and we are doing a simple informal survey about Jaeger usage. If you could answer the following questions, it would be very valuable to gauge interest in the project:

  • If applicable, what company/organization do you represent? How many software engineers?
  • How are you using Jaeger? E.g. full production deployment, considering, experimenting, or "I am not using Jaeger" etc.
    • How long have you been using Jaeger?
    • If you are not using Jaeger but chose another tracing system, what were the reasons?
  • How many services (or microservices) exist in your system layout?
    • How many of them are traced?
  • Can you describe your tracing setup and volumes? I.e. which storage you use, how many traces/spans you store, etc.
  • What types of problems are you solving with tracing?

Also consider adding your organization to ADOPTERS.md.

@jkandasa @sunfaces @jbdalido @princeop @pavolloffay @mabn @jpkrohling @nlamirault @JodeZer @prestonprice57 @jrbury @objectiser @sloev @hwinkel @Madhu1512 @yuekui2 @valichek @dianvaltodorov @ZhouZiHe @LoungeFlyZ @jeluard @diegofernandes @d-ulyanov @jyothepro @yqf3139 @tomersimis @ruinanchen @szdavid92 @anuptalwalkar @hekike @sul4bh @Strandedpirate @julianste @awhiteside @nklmish @sweatybridge @kevinearls @felixbarny @hzariv @nlamirault @longXboy @drzero42 @xdralex @philipgian @bharat-p

badiib avatar Jun 14 '17 20:06 badiib

  • A financial system service providers company From Shanghai
  • experimenting
  • To be honest, we are considering zipkin more.My team members are more familiar with ES and MySql than Cassandra, and our java coders like zipkin. Though l as a pure gocoder perfer jaeger.
  • We are during a microservice transformation.And our system is half java and half golang.
  • BTW, we select a kafka x ES solution with zipkin which jaeger does not provide.

JodeZer avatar Jun 15 '17 01:06 JodeZer

If applicable, what company/organization do you represent?

I am a contributor to fission, which is a FaaS solution on top of Kubernetes.

How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

We need to integrate a distributed tracer for two usage:

  • Help to troubleshoot performance problems with fission itself.
  • Provide tracer handler to user so that they can instrument their code easily and trace the functions as part of a bigger solution.

Currently I am doing some experiments on the integration.

If you are not using Jaeger, why not?

Will find myself some time to try Jaeger. It seems Jaeger has better client library support.

How many services (or microservices) exist in your system layout?

Around 10 microservices. Excluding user functions, which are also services evolving over time.

yqf3139 avatar Jun 15 '17 01:06 yqf3139

  • If applicable, what company/organization do you represent?

I work for a subsidiary company of Orange.

  • How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

We are experimenting OpenTracing in a futur API Gateway services.

  • If you are not using Jaeger, why not?

We use Jaeger using Kubernetes deployment.

  • How many services (or microservices) exist in your system layout?

Around 10 services.

  • which storage are you using ?

Cassandra.

nlamirault avatar Jun 15 '17 07:06 nlamirault

Interesting to hear folks say jaeger has a better client library, especially as Jaeger is OpenTracing which is supposed to make that point moot between systems. If anyone cares to elaborate on which library (at least language) is being compared and what they like better, that'd be interesting feedback, too.

codefromthecrypt avatar Jun 15 '17 08:06 codefromthecrypt

  • Zenly, a live location sharing social network (https://github.com/znly)
  • Full production deployment on top of scylladb
  • Around 10 services using jaeger in production, more coming

jbdalido avatar Jun 15 '17 08:06 jbdalido

@jbdalido glad to see scylladb !

JodeZer avatar Jun 15 '17 15:06 JodeZer

  • Elastica (part of Symantec)
  • Experimenting in QA/Dev systems
  • Around 10-15 services/microservices

bharat-p avatar Jun 15 '17 15:06 bharat-p

  • If applicable, what company/organization do you represent? --- eBay, Inc

  • How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc. --- We are currently evaluating Jaeger and Open Zipkin for OpenTracing

  • If you are not using Jaeger, why not? --- We have not ruled out Jaeger yet. We used Jaeger Java client first and now evaluating the backend that was recently open sourced. Lack of streaming support for the collector is an issue for Jaeger.

  • How many services (or microservices) exist in your system layout? --- 500+

Also integration with mesh service proxy such as Envoy or Linkerd is important to us.

hzariv avatar Jun 15 '17 15:06 hzariv

If applicable, what company/organization do you represent? Stitch Fix

How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc. Considering/experimenting

If you are not using Jaeger, why not? The environment for which we are considering Jaeger is mostly Python 3, so waiting either for this pull request to be merged or an alternative implementation :)

xdralex avatar Jun 15 '17 21:06 xdralex

If applicable, what company/organization do you represent? Base CRM

How are you using Jaeger? Experimenting in production - there's a process which listens on kafka to our custom traces, converts them and publishes to jaeger.

If you are not using Jaeger, why not? Traces with ~1M spans make jaeger hard to use, have to deal with it first. As for instrumenting services with opentracing - this will take time, only 1 service has it so far.

How many services (or microservices) exist in your system layout? 100+

Storage We're using AWS managed Elasticsearch - mainly because it's managed, but also because we have experience with ES and not with Cassandra. I'm still trying to make it work properly though - right now (2017-09-22) it performs poorly and drops a lot of spans because indexing does not use bulk API, indices are created without index.translog.durability=async and AWS ES requires signing of each index so there's additional proxy to go through.

mabn avatar Jun 16 '17 00:06 mabn

If applicable, what company/organization do you represent? RisingStack

How are you using Jaeger? Experimenting with automatic instrumentation for Node.js: https://github.com/RisingStack/jaeger-node

If you are not using Jaeger, why not? Node.js async_hooks is still in experimental phase. Currently, our own tracing is more feature complete: http://trace.risingstack.com

How many services (or microservices) exist in your system layout? 50+ (our product's backend)

hekike avatar Jun 21 '17 13:06 hekike

Lightbend has OpenTracing integration for Akka (and this is being extended to more Lightbend technologies, such as Akka HTTP, Play, and Lagom). Many of our customers are interested in tracing for distributed systems or microservices. The Jaeger client is used as the default OpenTracing client to report to Jaeger or Zipkin, giving our customers the option of using Jaeger.

pvlugter avatar Aug 02 '17 04:08 pvlugter

If applicable, what company/organization do you represent?

GrafanaLabs

How are you using Jaeger?

currently prototyping an implementation for our tsdb with the goal of validating performance and suitability and then taking to production. potentially we may add opentracing to our other software (like Grafana) as well. our most urgent need was just getting rich, context-specific distributed logging in place so we can diagnose performance trouble and jaeger looks like a good fit. In particular compared to "just distributed logging" systems like ELK/crate or oklog, we realized we want tracing not just logging.

How many services (or microservices) exist in your system layout?

We have about 20 different projects that we run, but many of them run them multiple times (many of our customers have a dedicated single-tenant deployments in kubernetes)

UPDATE sept 22 we're now using jaeger in prod for 2 different projects (each running hundreds times due to multi-tenancy) and we're also working on adding jaeger support into grafana itself.

backend: cassandra

Dieterbe avatar Aug 09 '17 21:08 Dieterbe

If applicable, what company/organization do you represent?

Northwestern Mutual

How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

I developed Kanali which we use to proxy all production traffic in our Kubernetes clusters. Kanali integrates with Opentracing to provide end to end distributed tracing. I love the Jaeger project as it is the most robust and clean UI for Opentracing IMHO

How many services (or microservices) exist in your system layout?

We currently use Jaeger to visualize tracing for 100s of microservices. These traces are used by 1000s of developers every day.

frankgreco avatar Aug 15 '17 02:08 frankgreco

Interesting to hear folks say jaeger has a better client library, especially as Jaeger is OpenTracing which is supposed to make that point moot between systems.

@adriancole I think people say this because OpenZipkin doesn't seem to have OpenTracing compatible Python or Node tracer, only Java and Go or, if it has, it's not immediately obvious.

otisg avatar Aug 28 '17 21:08 otisg

If applicable, what company/organization do you represent?

Under Armor

How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

Limited production deployment, expanding.

How many services (or microservices) exist in your system layout?

100s.

ejwood79 avatar Sep 09 '17 22:09 ejwood79

#396 @black-adder

  1. If applicable, what company/organization do you represent?

Weave

  1. How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

Full production deployment across both Kubernetes and virtual machines. Using OpenTracing+Jaeger with Cassandra for storage.

  1. How many services (or microservices) exist in your system layout?

100s of microservices

jnewmano avatar Sep 15 '17 04:09 jnewmano

Am I the only one who finds "How many services (or microservices) exist in your system layout?" an ambiguous question? I don't understand if this means the amount of unique software projects, or the amount of daemons running (where you count all copies of the same service running)

Dieterbe avatar Sep 15 '17 08:09 Dieterbe

@Dieterbe I take service to be a unique microservice. A good analogy would be a Kubernetes service.

frankgreco avatar Sep 15 '17 15:09 frankgreco

Hi all, @jnewmano @ejwood79 @otisg @frankgreco @Dieterbe @pvlugter @hekike @mabn @xdralex @hzariv @bharat-p @jbdalido @nlamirault @yqf3139 @JodeZer

could you also please mention which storage are you using? Whether Cassandra or Elasticsearch. Edit your comment or just comment below.

Thanks

pavolloffay avatar Sep 22 '17 09:09 pavolloffay

We’re using Cassandra.

Sent from my iPhone

On Sep 22, 2017, at 04:28, Pavol Loffay [email protected] wrote:

Hi all, @jnewmano @ejwood79 @otisg @frankgreco @Dieterbe @pvlugter @hekike @mabn @xdralex @hzariv @bharat-p @jbdalido @nlamirault @yqf3139 @JodeZer

could you also please mention which storage are you using? Whether Cassandra or Elasticsearch. Edit your comment or just comment below.

Thanks

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

ejwood79 avatar Sep 24 '17 18:09 ejwood79

Elasticsearch here at Sematext

otisg avatar Sep 25 '17 03:09 otisg

We're in experimentation phase at Ticketmaster. Hundreds of microservics that will need to be instrumented but after a few teams have started tracing interest is gaining.

bigkraig avatar Nov 16 '17 01:11 bigkraig

If applicable, what company/organization do you represent?

https://github.com/ContaAzul | http://contaazul.com

How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.

We just deployed it to production in our Kubernetes cluster saving data to ElasticSearch on AWS (AWS Elastic Search Service)

How many services (or microservices) exist in your system layout?

~100 instances of ~ 50 services

B0go avatar May 04 '18 13:05 B0go

  • If applicable, what company/organization do you represent?
    • SpotHero
  • How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc.
    • Tracing workloads in all environments
  • If you are not using Jaeger, why not?
    • N/A - We use Jaeger and love it
  • How many services (or microservices) exist in your system layout?
    • In then tens and growing
  • Storage
    • ElasticSearch 6 via AWS, in a private VPC

benjigoldberg avatar Jun 26 '18 21:06 benjigoldberg

  • If applicable, what company/organization do you represent? local.ch localsearch

  • How are you using Jaeger? Production deployment inside k8s using ES backend and zipkin reporters. Java (spring-sleuth), Ruby and pending Go instrumentations.

  • How many services (or microservices) exist in your system layout? 40+ services/batches and expanding

golonzovsky avatar Jun 27 '18 14:06 golonzovsky

Q: How are you using Jaeger? A: I'm doing evaluation of several OpenTracing frameworks for C++. I had successes with both OpenTracing-cpp and OpenCensus-cpp. I still haven't evaluated Jaeger's C++ (todo). While doing this, I realized I needed viewer, and started with Zipkin's UI for the first few hours, though found some limitations, or maybe I'm putting too much information at the app (several thousand traces). At first I was avoiding Jaeger's UI, since I thought it was just specific to Jaeger itself (had to do an evaluation over a day, and would continue through the week), only to find that it supports ZipKin mode. I was pre-excited about seeing the screenshots, the nice timeline, the folding/unfolding, and visually it was pleasure to use (ZipKin's UI also looks nice, maybe there are things ZipKin's UI can do that Jaeger's can't.). At any rate, I'll continue using it, and keep on looking until I finalize my choice.

Q:How are you using Jaeger? E.g. full production deployment, considering, experimenting, or I am not using Jaeger etc. A: As I said not yet now, still evaluating, but the plan is to have metrics in our desktop app, that talks to few servers, eventually have these servers, and whatever they are fronted with also monitored, and find out what collection scheme/mechanism would be appropriate. It's an in house game level editor, used by hundreths of people from few different studios, and we already collect logs (elastic), but perf metrics are done on demand - by asking users to run XPerf and then we analyze through WPA (Microsoft tools). Additionally we collect crash dumps, but not using exceptions yet (C++). So something that unifies, or provides alternative information (also export aggregated metrics to prometheus/grafana, which OpenCensus can do, and maybe Jaeger too (need to start looking into it soon)). All in all, just trying to get the idea what's available right now.

Q: If you are not using Jaeger, why not? A: Still evaluating,

Q: How many services (or microservices) exist in your system layout? A: For our app we have to talk to one or more (edge) perforce servers, custom caching solution, spawn SN-DBS fxc.exe (shader compiler), eventually to a local Windows Service serving/processing assets, etc. But we also have heavy multi-threaded case using ConCRT (Microsoft's "lite" version of Intel's TBB in a way), plus std::thread, and even WinAPI style CreateThread()'s. I'm looking for ways to safely hook this (propage my context across), and there are some gotchas - like green threads/coroutines, and possibly using thread local with push/pop style to keep the "active" thread. How easy I can achieve this may dictate which of the API's I would use (I've also noted that OpenCensus may have some extra locks, hidden allocs per span creation, though this should not be a big deal, and seems fixable). So I'm very excited to go ahead and eval Jaeger, and report back.

--- I worked for Google for some time, and had to use dapper, occasionally look at rpcz, tracez, etc during my oncall duties (wasn't regular SRE, medium sized java team with mixed responsibilities). Since then I've loved the approach, and the genuine idea of distributed tracing, and trying to see whether it's going to bring benefit to us. I'm glad that the industry is moving in the right way, though the information is a bit like sparse, and I don't know yet all the players :)

malkia avatar Jul 31 '18 15:07 malkia

@malkia:

If applicable, what company/organization do you represent?

isaachier avatar Jul 31 '18 15:07 isaachier

I speak only for my team, I don't know whether it's used in other teams/projects across the company, but my team is part of Activision's Central Tech.

malkia avatar Jul 31 '18 15:07 malkia

@malkia very cool. Thanks for answering that.

isaachier avatar Jul 31 '18 15:07 isaachier