BigQueryService
BigQuery is the most heavily used Google big data product at Spotify.
Spotify on Scio and BigQuery usage (part 2)
2017-10-23·engineering.atspotify.com ↗
Recommendations you can check.
Audio streaming company; its engineering blog covers its backend, data and developer tooling.
engineering.atspotify.com ↗spotify.com ↗
Also onwiqqi, about them
9 things
BigQueryService
BigQuery is the most heavily used Google big data product at Spotify.
Spotify on Scio and BigQuery usage (part 2)
2017-10-23·engineering.atspotify.com ↗
BackstageSoftware
Today, Backstage is the IDP platform of choice — with over 3,000 companies having adopted it to build IDPs of their own.
Spotify on five years of its own open source developer portal framework
2025-04-23·engineering.atspotify.com ↗
Google CloudService
Having evaluated the potential outcomes, we decided on the third option, an ‘all-in’ move to just one provider where we could build a deeper working relationship that went beyond simply offloading infrastructure to a third party. This led us to commit to the Google Cloud Platform (GCP).
Why Spotify moved from its own data centers all-in to Google Cloud Platform
2019-12-09·engineering.atspotify.com ↗
ScalaSoftware
Pipeline code written in Scala are usually 20% the size of their Java counterparts while offering comparable performance and big improvement over Python.
Why Scala is Spotify's preferred language for data pipelines
2017-10-16·engineering.atspotify.com ↗
Google Cloud DataflowService
Scio on Google Cloud Dataflow is fully managed, which means there is no operational overhead of setting up, tear down or maintaining a cluster.
Spotify running its Scio data pipelines on Dataflow
2017-10-16·engineering.atspotify.com ↗
ScioSoftware
It is now the preferred data processing framework within Spotify and has gained many external users and open source contributors.
Spotify on its own Scala API for Apache Beam
2017-10-16·engineering.atspotify.com ↗
BranchService
Spotify decided to migrate from Adjust to Branch for the preferred deep linking and attribution partner as described in detail in this Spotify Engineering blog post .
Spotify engineering on its automated performance-marketing system; its mobile measurement partner moved from Adjust to Branch.
2023-11-07·engineering.atspotify.com ↗
Apache BeamSoftware
Scio is a high level Scala API for the Beam Java SDK created by Spotify to run both batch and streaming pipelines at scale.
Spotify building Scio on top of Apache Beam
2017-10-16·engineering.atspotify.com ↗
BigQueryService
we’re slowly shifting towards replacing HDFS with Cloud Storage , and Hive with BigQuery .
Spotify's event delivery system rebuilt on Google Cloud managed services (part III)
2016-03-10·engineering.atspotify.com ↗
AdjustService
We carved out time to verify that consuming ad performance attribution data from Branch instead of Adjust did not result in performance implication of the ML ranking model, and we came up with detailed technical specifications of the tasks involved.
Spotify engineering: Adjust was replaced by Branch as Spotify's mobile measurement and attribution partner.
2023-11-07·engineering.atspotify.com ↗
Every entry is a verbatim quote and a link to the public post it came from. Nothing is paraphrased. If it is not on record somewhere public, it is not here.
The verdict is what they actually said: loved and liked are explicit; recommended means they told others to get it; uses means they only say they use it; read is a book on their public shelf with no verdict; mixed and disliked are kept too.
A dashed affiliate link, sponsored or their own label means the post disclosed a relationship. It is shown, never hidden.
The shading behind a date shows how dated a recommendation is for its kind of thing.
The shading behind a date shows how dated a recommendation is, for its kind of thing. Fully green is recent. It drains a quarter at a time as the post gets older, and is empty once it reads as dated.
What counts as old depends on the thing. A laptop praised four years ago has been replaced twice; a book loved twenty years ago is probably still loved. The shading is gone after about:
Stripes mean the post carries no date and the date shown is an estimate. No date at all, no shading.