KafkaSoftware

Apache Kafka is an open-source distributed event streaming platform that is used for data streaming pipelines, integration, and ingestion at PayPal. It supports our most mission-critical applications and ingests trillions of messages per day into the platform, making it one of the most reliable platforms for handling the enormous volumes of data we process every day.

How PayPal relies on Kafka

developer.paypal.com ↗·2023-09-07Wrong?

With all the other message queues out there, Kafka seemed like a natural fit for these requirements.

Monzo on choosing Kafka for asynchronous messaging

monzo.com ↗·2016-09-19Wrong?

Kafka's strong durability and low latency have enabled us to use Kafka to power a number of newer mission-critical use cases at LinkedIn.

LinkedIn on Kafka, which it developed

linkedin.com ↗·2016-04-19Wrong?

Specifically, we will cover how Kafka is used for storing all the articles ever published by The New York Times, and how Kafka and the Streams API is used to feed published content in real-time to the various applications and systems that make it available to our readers.

The New York Times log-based publishing architecture on Kafka

open.nytimes.com ↗·2017-09-06Wrong?

Kafka underpins most of our real-time data movement — whether it’s asynchronous messaging between services, log collection, or streaming updates for analytics.

Wise's 2025 tech stack update: data in motion

medium.com ↗·2025-02-12Wrong?

Coban - Grab’s real-time data streaming platform - has been operating Kafka on Kubernetes with Strimzi in

Grab's streaming platform runs Kafka on Kubernetes with Strimzi

engineering.grab.com ↗·2023-12-26Wrong?

TLDR: Coinbase is leveraging AWS’ Managed Streaming for Kafka (MSK) for ultra low latency, seamless service-to-service communication, data ETLs, and database Change Data Capture (CDC).

Coinbase on running Kafka through AWS MSK

coinbase.com ↗·2021-08-24Wrong?

We quickly agreed on gRPC as our mechanism for synchronous service-to-service communication, using Apache Kafka as a message queue.

DoorDash's new backend stack: gRPC and Kafka

doordash.engineering ↗·2021-05-04Wrong?

High throughput jobs and inter-service communication using Kafka;

Nubank's engineering practices: Kafka for jobs and inter-service communication

building.nubank.com ↗·2019-11-22Wrong?

We use Kafka as our databus to stream data, which usually comes from external feeds, or from internal Faust apps.

Robinhood's data lake ingestion layer

robinhood.com ↗·2019-09-09Wrong?

Writing to Snuba starts with reading from a Kafka topic of JSON events that have gone through Sentry’s normalization and processing steps.

Sentry on feeding Snuba from a Kafka topic of events

blog.sentry.io ↗·2019-05-16Wrong?

Today, the Keystone platform offers two production services: Data Pipeline : streaming enabled Routing Service and Kafka enabled Messaging Service

Netflix Keystone real-time stream processing platform built on Kafka

netflixtechblog.com ↗·2018-09-10Wrong?

Secor is a service persisting Kafka logs to Amazon S3

Pinterest's Secor project page: persisting Kafka logs to cloud storage (undated page)

github.com ↗Wrong?