Data Infrastructure Engineer - Data Platform at spotify

The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the frameworks, capabilities and tools needed to welcome a billion customers. Join us and help to amplify productivity, quality and innovation across Spotify. We are looking for a Data Infrastructure Engineer to join our team in the Data Collection Product Area. We develop the heart of Spotify’s Event Delivery infrastructure, enabling hundreds of other teams to seamlessly collect more than a Trillion events per day and consume this data to empower Spotify's existing products as well as innovation of new products. We are heavy users of Google Cloud Pub/Sub, GKE, Dataflow and many other GCP products and work closely with Google to improve their product offering. We also rely on internal backend and data platform products, built by other squads at Spotify. What You'll Do • Work on our infrastructure together with the squad, making it reliable and efficient while delivering value to data producers and consumers within Spotify. • Build large-scale Java and Apollo based backend systems and batch and real-time data pipelines with data processing frameworks like Scio and Apache Beam. • Take an active part in the operational responsibilities for our own infrastructure • Work in an autonomous, multi-functional agile team and collaborate with other squads in our product area to continuously iterate and deliver on new product objectives. Who You Are • You have experience working with backend and data engineering in Java and Scala and have an understanding of that problem space and tooling ecosystem. • You are curious about solving technical challenges and operating business-critical, huge scale distributed systems and cloud solutions. • You have a good understanding of quality, system design, data structures, and algorithms. • You appreciate agile software processes, data-driven development, reliability, and responsible experimentation. • You use standard methodologies in continuous integration and delivery • You work well independently and collaboratively, and are open to giving and receiving feedback in order to learn as an individual and as a team. Where You'll Be • This role is based in London. • We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home. Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can. Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.