Software Development Manager, Open Data Analytics Engines
Amazon Development Center U.S., Inc.•4h ago
United StatesOnsiteFull-timeManager Level7+ yrs exp
H-1B verified · 2310 LCAs
Top focus
Vp DataSoftware EngineerClinical Data ManagerData AnalystData Engineer
- Amazon EMR is a web service that enables customers to run massive clusters with open-source data processing frameworks like Apache Spark, Hive, Presto, Hadoop, HBase and more, with the ability to scale up and down as needed. EMR runs across multiple deployment modes (EC2, EKS
- Serverless), serving millions of clusters across all AWS regions. The ODA Fundamentals team owns the end-to-end lifecycle of releases across Amazon EMR (EC2, EKS, Serverless), AWS Glue
- Amazon Athena. We build, validate, register
- distribute AMIs and Docker images that power every cluster. We own the Kamino pipeline, the automated system that takes open-source frameworks and packages them into production-ready releases. We also own patching (in-place and OS-level), region builds (launching services in new AWS regions)
- release automation tooling. Our pipeline directly impacts every EMR, Glue
- Athena customer. We are looking for a Software Development Manager to lead a team of 13-15 engineers building the next generation of release automation for Open Data Analytics. You will own reducing operational toil, improving release velocity
- scaling our pipeline to new services and regions. Your team will design and implement services that automate the build, validation
- distribution of releases across all deployment modes. You will drive the architecture and delivery of distributed systems that must be reliable, scalable
- secure, because failures in our pipeline block releases for the entire ODA organization. As a manager on this team, you will set the technical direction for release infrastructure, define the roadmap for automating manual operational work
- ensure our services are available in every AWS region. You will balance investing in new automation capabilities against maintaining the reliability of existing pipelines. You will hire, develop
- retain strong engineers
- create an environment where the team delivers high-quality software at increasing velocity. Successful candidates will have experience managing teams that build and operate large-scale distributed systems. You should have a track record of driving automation to reduce operational burden, delivering infrastructure or platform services used by other engineering teams
- shipping software in a CI/CD environment. Experience with release engineering, infrastructure-as-code, container image pipelines
- AMI build systems is a plus. You should be comfortable making technical trade-offs, diving deep into system designs
- holding a high bar for operational excellence. To learn more about EMR and our services: AWS EMR: https://aws.amazon.com/emr AWS Athena: https://aws.amazon.com/athena AWS Glue: https://aws.amazon.com/glue AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/ About the team AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path
- includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home
- is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
- 3+ years of engineering team management experience - 7+ years of working directly within engineering teams experience - 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience - Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification
- livesite operations - Experience partnering with product or program management teams
- Experience in communicating with users, other technical teams
- senior leadership to collect requirements, describe software product features, technical designs
- product strategy - Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills
- make them more effective, product software engineers Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability
- other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications
- location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off
- parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, WA, Redmond - 184,900.00 - 250,200.00 USD annually
Required skills
Apache SparkHivePrestoHadoopHBaseCI/CDrelease engineeringinfrastructure-as-codecontainer image pipelinesAMI build systems