Director of Engineering for Open Data Analytics Engines, Data Processing & Experience
Amazon Development Center U.S., Inc.•16h ago
United StatesOnsite$264.1K–$350KFull-timeDirector Level10+ yrs exp
H-1B verified · 2310 LCAs
Top focus
Director EngineeringVp EngineeringVp Data
- AWS Open Data Analytics Engines is a suite of fully managed, high-performance analytics services built on popular open-source frameworks, enabling customers to process, analyze
- derive insights from massive datasets with speed, flexibility
- cost efficiency. Open Data Analytics Engines make it easy for organizations to run petabyte-scale analytics using familiar open-source tools without the operational burden of managing infrastructure. AWS Open Data Analytics Engines encompasses services purpose-built for large-scale data processing, interactive querying, real-time streaming
- machine learning workloads. The platform leverages open-source engines such as Apache Spark, Presto/Trino, Apache Flink
- Apache Hive, delivering seamless integration with the broader AWS ecosystem. Compute and storage are decoupled, enabling elastic scaling, fine-grained cost optimization
- support for diverse data lake architectures. As Director of Engineering for Open Data Analytics Engines, you will own the strategy and technical roadmap for innovations in engine efficiency, features
- performance. You'll lead a group of top talent in the design, development
- operation of next-generation open-source analytics services on AWS, driving advances in query planning and optimization, distributed execution
- cost-performance across the portfolio. Key job responsibilities Grow and lead a software development organization responsible for building key AWS analytics services based on open-source engines. Drive the design, implementation, testing
- deployment of managed analytics services spanning batch processing, interactive queries
- real-time streaming. Own the strategy and technical roadmap for innovations in engine efficiency, query planning and optimization
- performance — setting the direction for how AWS advances the state of the art in open-source analytics. Draw from your deep and broad technical and management expertise to mentor senior engineers and managers, complete hands-on technical work
- provide leadership on complex technical issues, design tradeoffs
- feature and schedule prioritization. Work with senior executives to develop business targets and resource requirements, influence technical and business strategy, hire talented engineers and managers
- conceive innovative new solutions for customers. A day in the life Leading the Open Data Analytics Engines team gives you the opportunity to: Work on industry-defining products in the rapidly evolving open-source data analytics space Solve challenging problems in distributed query execution, query planning and optimization, stream processing, resource scheduling
- performance optimization at cloud scale Build products that deliver the power of open-source analytics with the reliability, security
- ease-of-use customers expect from AWS Work for a company that is a recognized leader in cloud computing Be involved in the fast-growing cloud analytics and data lake market Develop and execute a strategic roadmap for the future of open-source analytics on AWS
- Bachelor's degree in Computer Science (or related field) or equivalent work experience 10+ years in the development of mission-critical system software, including work on distributed systems, large-scale data processing
- analytics platforms 5+ years managing engineering teams
- 5+ years partnering with sales, marketing
- customer success teams Experience developing and deploying cloud-based analytics technology, particularly services built on open-source frameworks (Spark, Presto/Trino, Flink, Hive) Deep knowledge of query planning and optimization in distributed query engines or relational databases, including experience with resource scheduling, data lake architectures
- performance optimization at petabyte scale Experience operating services at global scale with stringent latency, throughput
- availability requirements Advanced degree: Masters or PhD in Computer Science or Engineering
- MBA or similar business qualification Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability
- other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications
- location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off
- parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, WA, Redmond - 264,100.00 - 350,000.00 USD annually
Required skills
AWSApache SparkPrestoTrinoApache FlinkApache Hivedistributed systemsdata processinganalytics platformsquery planningoptimizationresource schedulingdata lake architectures