Applications Developer - ETL/Pyspark - Assistant Vice President
Top focus
We are seeking an enthusiastic, detail-oriented ETL Developer to join our data engineering team. In this role, you will be designing, developing, and maintaining scalable data pipelines using PySpark , Talend , and Ab Initio . You will work closely with senior developers to transform raw data into valuable business insights, ensuring optimal data quality and performance ETL Pipeline Development: Building and maintaining Extraction, Transformation, and Loading (ETL) workflows Big Data Processing: Utilize PySpark for data processing, manipulation, and analysis within big data ecosystems.
Data Extraction & Ingestion: Extract data from multiple sources including relational databases (SQL), flat files etc. Data Transformation: Create mapping documents and apply business logic to transform large datasets. Performance Tuning: Assist in analyzing and optimizing existing ETL jobs and Spark scripts for better scalability and execution speed.
Testing & Documentation: Perform unit testing, validate data accuracy, and maintain technical documentation for all ETL processes. Production Support: Help monitor scheduled daily/weekly jobs and troubleshoot data integration or quality issues Recommended Qualifications: 8-10 years of relevant experience Experience in systems analysis and programming of software applications Programming Languages: Proficiency in Pyspark and SQL .
Big Data Frameworks: Hands-on experience or strong conceptual understanding of PySpark . ETL Tools: Familiarity with Data Integration/Big Data tools and Ab Initio components. Scripting: Basic to intermediate knowledge of Unix/Linux Shell Scripting .
Databases: Understanding of Big Data (Hadoop) & RDBMS like Oracle, or PostgreSQL Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements Education: Bachelor’s degree/University degree or equivalent experience This job description provides a high-level review of the types of work performed.
Other job-related duties may be assigned as required. ------------------------------------------------------ Job Family Group: Technology ------------------------------------------------------ Job Family: Applications Development ------------------------------------------------------ Time Type: Full time ------------------------------------------------------ Most Relevant Skills Please see the requirements listed above. ------------------------------------------------------ Other Relevant Skills For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi . View Citi’s EEO Policy Statement and the Know Your Rights poster.