Sr.Data Engineering
Bosch•2h ago
bengaluru, inOnsiteFull-timeMid Level6+ yrs exp
Top focus
Vp EngineeringVp DataData AnalystData EngineerData Scientist
- Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates, it’s the largest software development center of Bosch, outside Germany, indicating that it is the Technology Powerhouse of Bosch in India with a global footprint and presence in the US, Europe and the Asia Pacific region.
- Job DescriptionOverall"mso-spacerun:yes"> 6– 8 years of relevant experience.Should be flexible to adapt to project requirements needs.Key Responsibilities:Data Pipeline Development: Design, build
- optimize robust, scalable
- efficient ETL/ELT data pipelines using Python and PySpark, primarily within Azure Databricks and Azure Data Factory.Data Ingestion & Processing: Develop and manage processes for ingesting data from various sources (e.g., transactional databases, APIs, streaming sources) and transforming it into clean, usable formats for downstream consumption.Data Quality & Monitoring: Implement comprehensive unit and integration test coverage for data pipelines. Establish and maintain monitoring, alerting
- dashboarding solutions (e.g., Grafana) for data quality, pipeline health
- performance.Cloud Infrastructure Management (OpenShift/Azure): Contribute to the setup, configuration
- maintenance of data-related infrastructure on OpenShift, ensuring deployment readiness and leveraging tools like HELM for application packaging and deployment.CI/CD & Automation: Drive CI/CD best practices using GitHub Actions, ensuring automated testing (unit tests), build
- deployment processes for data solutions to environments like OpenShift.SQL & Data Modeling: Develop and optimize complex SQL queries for data extraction, transformation
- loading. Apply strong data modeling principles for efficient data storage and retrieval in SQL Server and other data stores.Azure Ecosystem Leverage: Utilize a broad range of Azure data and analytics services, including Azure Data Factory, Azure Databricks, Azure SQL Server, Azure Key Vault
- others to build comprehensive data solutions.Performance Optimization: Proactively identify and resolve performance bottlenecks in data pipelines and databases through query optimization, indexing strategies
- efficient data processing techniques.Collaboration & Documentation: Work closely with data scientists, analysts
- other engineering teams to understand data requirements. Create clear and concise documentation for data pipelines, architecture
- processes.Required Core Skills & Qualifications:Programming & Data Processing:Strong proficiency in Python and PySpark for large-scale data processing and ETL development.Data Warehousing & SQL:Expertise in SQL for complex querying, data manipulation
- schema design.(Optional, but highly preferred): Proven experience in SQL optimization and performance tuning.ETL Development:Demonstrable experience in designing, building
- maintaining robust ETL/ELT data pipelines.Cloud Data Platform (Azure Focus):Hands-on experience with Azure Databricks.Proficiency with core Azure Analytics Services including Azure Data Factory, Azure SQL Server
- Azure Key Vault.DevOps & CI/CD:Experience implementing CI/CD pipelines from GitHub (including GitHub Actions) for automated testing (unit tests), build
- deployment processes.Containerization & Orchestration:Familiarity and practical experience with OpenShift (setup, deployment-ready configurations
- management).Experience with HELM for deploying applications on Kubernetes/OpenShift.Monitoring & Observability:Experience in setting up and configuring Grafana for dashboards to monitor data quality and pipeline health.Preferred Qualifications:Bachelor's or Master's degree in Computer Science, Engineering, Data Science
- a related quantitative field.Relevant Azure certifications (e.g., Azure Data Engineer Associate).Experience with real-time data processing frameworks (e.g., Kafka, Azure Event Hubs).Understanding of data governance, data security
- compliance best practices.
- BE,MCA,M Tech
- 6-8
Required skills
PythonPySparkAzure DatabricksAzure Data FactorySQLGrafanaGitHub ActionsOpenShiftHELM