Senior Data Engineer, APM Video Science

Amazon.com Services LLC•3h ago

United StatesOnsiteFull-timeSenior Level5+ yrs exp

H-1B verified · 2310 LCAs

Apply now

Top focus

Data EngineerSenior Data EngineerVp DataData Warehouse Engineer

Transform how Prime Video and Twitch measure advertising impact by building the data foundation that powers billions of daily decisions. You’ll design and operate petabyte-scale data pipelines that turn raw ad-serving and streaming events into trusted signals driving advertiser outcomes and shaping product strategy. We are looking for a senior data engineer who thrives in ambiguity, builds reliable data products
partners closely with scientists, product
engineering to scale our measurement capabilities. Key job responsibilities Design, build
own end-to-end data pipelines to process large-scale ad-serving, playback
conversion events. Ensure pipelines are scalable, monitored
resilient to failures. Model and curate canonical datasets the science team relies on — delivery, content, customer outcomes
experiment results — replacing ad-hoc, per-analysis extracts with governed, documented data products that enforce schema standards and data quality. Productionize experiment and measurement pipelines to deliver reproducible, self-serve insights. Automate deployment, monitoring
alerting to eliminate manual re-derivation. Partner with applied scientists to transform research prototypes into scheduled, monitored production jobs that deliver actionable insights at scale. Establish data governance frameworks — define schema standards, implement lineage tracking, enforce data quality SLAs
deploy alerting, backfill
replay tooling to ensure pipeline reliability and trust. Drive decisions under ambiguity by selecting optimal storage, compute
modeling approaches for unstructured or evolving problems, balancing cost, performance
scalability. Mentor and develop junior engineers through code reviews, pair programming
knowledge-sharing. Foster adoption of best practices to elevate team efficiency and quality. Lead data engineering standards and processes for enterprise-scale impact. Define team-wide conventions for pipeline architecture, monitoring dashboards
align with infrastructure and security teams to meet organizational goals for scalability, cost
compliance. A day in the life As a Senior Data Engineer on our science team, you’ll build reliable, reusable data products that replace manual, one-off analysis. Your responsibilities include reviewing pipeline health, prioritizing canonical datasets with applied scientists
designing ETL pipelines to capture and curate critical metrics. You’ll collaborate with engineering partners to productionize feature-engineering workflows, ensuring they run reliably in production with monitoring and alerting. You’ll also establish data governance standards—defining schemas, documenting lineage
setting service-level agreements—while directly shaping live advertising products and executive-facing measurement dashboards. About the team We're a small, fast-moving science team focused on building the measurement and targeting systems that connect brands with audiences across premium streaming and live content. We work closely with applied scientists, product managers
engineering partners to turn research into production systems that serve real business outcomes. Our vision is to make data trustworthy, self-serve
accessible—so scientists can focus on insights rather than data wrangling
products can scale with confidence. You'll be joining a collaborative group that values both technical rigor and partnership
your contributions directly shape how we understand and optimize advertising performance.
Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent - 5+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with SQL - Experience in at least one modern scripting or programming language, such as Python, Java, Scala
NodeJS - Experience providing technical leadership and mentoring other engineers for best practices on data engineering - Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing
operational excellence - Knowledge of distributed systems as it pertains to data storage and computing
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data warehouses - Experience communicating with users, other technical teams
management to collect requirements, describe data modeling decisions and data engineering strategy - Experience providing technical leadership on high-impact cross-fucntional technical project Twitch is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability
other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications
location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off
parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, NY, New York - 170,000.00 - 230,000.00 USD annually USA, TX, Austin - 154,600.00 - 209,100.00 USD annually

Required skills

PythonSQLHadoopHiveSparkEMR