Data Engineer II
Belfast
Hybrid Schedule (M/F remote, T/W/TH in-office)
At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we’re looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world’s largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!
In this role you will:
-
Build and optimize data pipelines using Apache Spark and Python, processing billions of events in both streaming and batch modes.
-
Collaborate with SRE teams to provision infrastructure using Terraform and AWS (future Kubernetes on-premise).
-
Design secure and scalable APIs for data retrieval and integration.
-
Proactively improve Magnite’s Audience data pipeline by identifying and implementing innovative solutions.
-
Own the operational performance of your builds, ensuring uptime and implementing recovery strategies.
We’re looking for someone with:
-
2+ years of experience
-
Hands-on experience with Apache Spark, including large-scale data processing. Ideally you will have written a variety of pipelines that you have deployed in production.
-
Strong Python skills, particularly in the context of Databricks and Spark.
-
Data pipeline design knowledge, from sourcing event data to creating queryable data layers.
-
Familiarity with event-based data architecture (e.g., Kafka).
-
SQL experience for data analysis and transformations.
-
Hands-on experience with AWS and Terraform for IaaS solutions.
-
Experience writing Jenkins or Github actions pipelines to run build and integration actions.
Also preferred:
-
GoLang for distributed service development
-
Kubernetes experience
Comprehensive Perks and Benefits:
-
Comprehensive Healthcare Coverage for you and your dependants from Day One
-
Complimentary lunch in the office
-
Generous Time Off
-
Holiday Breaks and Quarterly Wellness Days
-
RSU Equity and Employee Stock Purchase Plan
-
Family-Focused Benefits and Parental Leave
-
Competitive Pension match
-
Disability and Life Insurance
-
Mobile Phone Subsidy
-
Fitness and Wellness Reimbursement
Company Culture:
We believe collaboration is essential to success. Magnite’s hybrid schedule includes two days worked remotely (Monday and Friday) and three days on-site (Tuesday, Wednesday and Thursday). Our offices provide catered lunches, beverages, snacks, training and development, and office events to support your work week. We also understand you have appointments, families, hobbies, and other commitments. Magnite strives to maintain a healthy work/life integration for all employees so you can bring your best every day - both at work and at home.
-
Community Service and Volunteer Events
-
Company-Matched Charitable Contributions
-
Wellness Coach and Mental Health Support
Magnite Invests in You:
-
Career Development Initiatives and a Career Growth Framework
-
Culture and Inclusion Programs
-
Bonusly Peer-to-Peer Recognition Program
About Us
The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC.
