Senior Data Engineer (Microsoft Fabric / Financial Data)
Allstate•22h ago
United StatesRemoteFull-timeSenior Level5+ yrs exp
Top focus
Data EngineerSenior Data EngineerVp DataData Warehouse Engineer
- At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description We are seeking a Senior Data Engineering (Microsoft Fabric /Financial Data) to design, develop
- support critical financial and operational data solutions that support reserving, claims
- enterprise decision-making. This role combines hands-on technical development with strong business partnership to ensure data is accurate, scalable
- aligned with financial reporting requirements. The ideal candidate will have experience building and maintaining complex data solutions using SQL, Python, PySpark, Microsoft Fabric
- similar cloud data platforms. This individual will help automate reconciliations, improve data quality controls, reduce manual processes
- deliver reporting and analytics solutions that strengthen operational effectiveness and reduce business risk. The Allstate internal job title for this role is Software Engineer Lead Cons. Key Responsibilities Design, develop, test, deploy
- support enterprise data solutions used for financial reporting, reserving
- claims. Own and maintain critical data structures, transformation logic, business rules, bucketing logic
- controls within claims data. Develop and maintain data pipelines, transformation processes
- reporting datasets using SQL, Python, PySpark, Microsoft Fabric
- similar cloud data platforms. Partner with Actuarial Reserving, Accounting Operations, Product, Claims, Financial Planning and Analysis
- other business teams to understand requirements and translate them into scalable technical solutions. Lead and participate in end-user testing to confirm changes are implemented correctly and downstream reporting impacts are understood before production release. Automate reconciliations, exception monitoring, data quality checks
- control processes to improve consistency, scalability
- accuracy. Analyze complex business and data challenges and recommend solutions that improve reporting, decision-making
- operational efficiency. Review code, design
- testing work to support quality, maintainability
- development best practices. Provide technical guidance, coaching
- knowledge-sharing to peers and less experienced developers. Support production issues, investigate root causes
- implement sustainable solutions that reduce future risk. Identify opportunities to modernize tools, improve data governance
- introduce more efficient development practices. Essential Qualifications 5 years or more of experience in data engineering, analytics engineering, application development, business intelligence development
- a related technical field. (Or Equivalent) 1-2 years of hands-on Microsoft Fabric experience preferred, including data engineering, data transformation, data warehousing
- analytics capabilities. (Or Equivalent) Equivalent experience with Azure Synapse Analytics, Databricks, Snowflake, Azure Data Factory, Redshift, BigQuery
- similar cloud data platforms will also be considered. Strong experience developing complex data transformation processes using SQL, Python, and/or PySpark. Experience designing, building
- supporting enterprise data pipelines, data models, data structures
- reporting datasets. Experience working with financial, claims, premium, accounting, operational
- other complex business data. Strong understanding of ETL/ELT development, data quality controls, reconciliation processes
- data governance concepts. Experience partnering directly with business stakeholders to gather requirements, clarify priorities
- deliver technical solutions. Strong analytical, troubleshooting
- problem-solving skills. Ability to manage multiple priorities and deliver high-quality solutions in a fast-paced environment. Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences. Desirable Qualifications Experience with Microsoft Fabric Data Factory, Lakehouse, Warehouse, Power BI
- related Microsoft analytics capabilities. Experience within property and casualty insurance, financial services
- another highly regulated industry. Knowledge of reserving, claims, premium, financial reporting, accounting
- operational reporting processes. Experience automating reconciliations, exception reporting, data validation
- data quality monitoring. Experience with dashboards, automated reports
- analytics solutions using Power BI or similar reporting tools. Experience with Azure cloud services, DevOps practices, version control
- deployment pipelines. Experience leading technical initiatives or mentoring junior developers. Why This Role Matters This role plays an important part in ensuring the accuracy, integrity
- availability of data used for financial reporting, reserving, claims operations
- strategic decision-making. The successful candidate will help improve data controls, reduce manual work, strengthen reporting reliability
- support key enterprise initiatives through modern data engineering solutions. Experience
- 5 or more years of experience (Preferred) Supervisory Responsibilities
- This job does not have supervisory duties. #LI-MF1 Skills Azure Data Factory, Business Intelligence (BI), Data Engineering, Data Governance, Data Pipelines, Data Quality, Data Solutions, Data Structures, Data Transformation, Data Validation, Data Warehousing (DW), Enterprise Data, Extract Transform Load (ETL), Process Improvements, Python (Programming Language), Relational Data Modeling, Reporting, Structured Query Language (SQL), Technical Requirements Compensation Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications. The candidate(s) offered this position will be required to submit to a background investigation. Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact. Allstate generally does not sponsor individuals for employment-based visas for this position. Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component. For jobs in San Francisco, please click “ here ” for information regarding the San Francisco Fair Chance Ordinance. For jobs in Los Angeles, please click “ here ” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance. To view the “EEO Know Your Rights” poster click “ here ”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs. To view the FMLA poster, click “ here ”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint. It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex
- sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline
- separation of employment. Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard
- mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs. When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.
Required skills
PythonSnowflakeBigQueryDatabricksAzure