SoundCloud

Jump to bottom Edit New page

Zoltán Nagy edited this page Jun 18, 2019 · 1 revision

ZIPKIN : SoundCloud

Created by Adrian Cole, last modified by Kristof Adriaenssens on Nov 12, 2018

Introduction and Scope

SoundCloud is the world's leading social sound platform where anyone can listen to or create sounds and share them everywhere.
We have over 100 million tracks on the platform and more than 12 hours of audio gets uploaded every minute.
SoundCloud has over 100 engineers and hundreds of microservices.
> 80% of our services are Finagle based. Most of them communicate using http+json.
A small infrastructure team supports the distributed tracing setup.
Please see this engineering blog post for more background.

System Overview

We deploy Zipkin using docker + k8s.
There’s one Zipkin collector per Kubernetes cluster, but that interacts with a single common Cassandra cluster for storage.
All Finagle-based services automatically report traces to Zipkin, typically at a very low sampling rate.

Current Status (10-2017)

We have 10 Zipkin collector instances all together handling >1000 incoming spans per second.
Cassandra retains 7 days’ worth of data.

Document generated by Confluence on Jun 18, 2019 18:50