Databricks Data Engineer
Accenture•3h ago
United StatesOnsiteFull-timeMid Level4+ yrs exp
H-1B verified · 292 LCAs
Top focus
Data EngineerVp DataSenior Data Engineer
Join Accenture and help transform leading organizations and communities around the world. The sheer scale of our capabilities and client engagements and the way we collaborate, operate and deliver value provides an unparalleled opportunity to grow and advance.
Role Summary We are looking for a Databricks Data Engineer with strong Python skills to design, build, secure, and maintain scalable data pipelines across cloud data platforms. The role will focus on developing robust data flows from heterogeneous sources into usable, reliable, and well-documented datasets that support analytics, reporting, and business use cases.
The ideal candidate has hands-on experience with Databricks, Python, cloud data platforms such as Azure or AWS, and modern data engineering practices including data quality, monitoring, performance optimization, and operational support
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks and Python.
- Develop data ingestion, transformation, and processing workflows from heterogeneous data sources.
- Work with cloud data platforms, data lakes, middleware, and enterprise data ecosystems.
- Ensure data pipelines are secure, reliable, performant, and scalable.
- Implement monitoring, alerting, incident analysis, and optimization of data flows.
- Support data quality processes, including validation, cleansing, completeness checks, and consistency controls.
- Contribute to data modeling and transformation activities to make data usable for business and technical teams.
- Recommend and implement appropriate technical solutions for data consumption, data modeling, and interoperability needs.
- Maintain technical documentation, data flow diagrams, and development documentation.
- Collaborate with business, analytics, architecture, and operations teams to deliver high-quality data solutions.
- Participate in Agile delivery practices and contribute to continuous improvement of data engineering standards.
- Preferred Skills Experience with Azure Data Factory, Azure cloud services, AWS data services, or similar cloud integration tools.
- Knowledge of DataOps practices.
- Experience with FinOps dashboards, cost optimization reporting, or data products supporting cloud cost management.
- Experience with Power BI or other reporting/dashboarding tools.
- Exposure to spec-driven development or AI-assisted development practices.
- Familiarity with enterprise security, governance, and operational standards.
- Experience/Required Skills: Strong hands-on experience with Databricks.
- Strong programming experience in Python.
- Minimum 4 years of experience in data engineering or data manipulation projects.
- Experience designing and building ETL / ELT data pipelines.
- Good understanding of data lakes, cloud data platforms, and modern data architectures.
- Experience with Azure and/or AWS cloud environments.
- Knowledge of data transformation methodologies and data modeling concepts.
- Ability to write clean, maintainable, and well-documented code.
- Good understanding of development methodologies and Agile delivery.
- Experience with data quality, pipeline monitoring, performance optimization, and operational support.
- Good communication skills in English; French is a plus depending on project context
Benefits
- Competitive salary and benefits package.
- Opportunities for continuous learning and professional growth.
- A collaborative and inclusive work environment.
- Exposure to cutting-edge technologies and innovative projects.
- Supportive leadership and career development programs.
- Accenture does not discriminate on the basis of race, religion, color, sex, age, non-disqualifying physical or mental disability, national origin, sexual orientation, gender identity or expression
- any other basis covered by local law.
- About Accenture Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale.
- We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries.
- Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships.
- We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability.
- Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships.
- We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
- Visit us at www.accenture.com Equal Employment Opportunity Statement We believe that no one should be discriminated against because of their differences.
- All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law.
- Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Required skills
PythonDatabricksAzureAWSDataOpsETLELTData QualityData ModelingData TransformationAgile