BackstageSoftware
recommended
Today, Backstage is the IDP platform of choice — with over 3,000 companies having adopted it to build IDPs of their own.
Spotify on five years of its own open source developer portal framework
engineering.atspotify.com ↗·2025-04-23Wrong?
Google CloudService
recommended
Having evaluated the potential outcomes, we decided on the third option, an ‘all-in’ move to just one provider where we could build a deeper working relationship that went beyond simply offloading infrastructure to a third party. This led us to commit to the Google Cloud Platform (GCP).
Why Spotify moved from its own data centers all-in to Google Cloud Platform
engineering.atspotify.com ↗·2019-12-09Wrong?
ScalaSoftware
recommended
Pipeline code written in Scala are usually 20% the size of their Java counterparts while offering comparable performance and big improvement over Python.
Why Scala is Spotify's preferred language for data pipelines
engineering.atspotify.com ↗·2017-10-16Wrong?
Google Cloud DataflowService
recommended
Scio on Google Cloud Dataflow is fully managed, which means there is no operational overhead of setting up, tear down or maintaining a cluster.
Spotify running its Scio data pipelines on Dataflow
engineering.atspotify.com ↗·2017-10-16Wrong?
ScioSoftware
recommended
It is now the preferred data processing framework within Spotify and has gained many external users and open source contributors.
Spotify on its own Scala API for Apache Beam
engineering.atspotify.com ↗·2017-10-16Wrong?
Apache BeamSoftware
uses
Scio is a high level Scala API for the Beam Java SDK created by Spotify to run both batch and streaming pipelines at scale.
Spotify building Scio on top of Apache Beam
engineering.atspotify.com ↗·2017-10-16Wrong?