Risk Modeling Solutions - Full-stack GenAI - Assistant Vice President
Top focus
Full-Stack Gen AI Lead Engineer – Model/Anlys/Valid Sr Analyst (C12) The AI Lab is the engineering core of our Risk Modeling Solutions (RMS) team, focused on integrating Gen AI solutions into our risk management framework. The team is responsible for building and deploying practical, high-impact applications that combine deep quantitative analysis with cutting-edge AI.
These solutions enhance analytical decision-making, automate complex reporting, and create significant operational efficiencies for the business. The responsibility includes but not limited to the following activities: Architect Agentic Systems: Design and lead the implementation of complex, multi-agent AI workflows capable of advanced reasoning, planning, and autonomous execution using frameworks like LangGraph, CrewAI, and Google ADK.
Solution Design & Development: Translate complex business problems within the risk domain into well-defined technical requirements, and develop robust, end-to-end AI solutions to address them. AI Workflow Development: Implement end-to-end agentic AI workflows using frameworks like LangGraph, CrewAI, and AutoGen, focusing on reasoning, tool use, and memory.
LLM Orchestration: Build and optimize retrieval pipelines, memory layers, and tool-use sequences using frameworks like LangChain. Backend & API Engineering: Develop robust, scalable Python-based microservices and REST APIs using FastAPI to expose AI capabilities.
RAG Implementation: Construct and refine Retrieval-Augmented Generation (RAG) pipelines, including document ingestion, embedding, and vector search integration with databases like Azure AI Search or Pinecone. Containerization & Deployment: Package AI services using Docker and deploy them on Kubernetes, contributing to CI/CD pipelines for smooth and reliable releases.
Observability & Evaluation: Instrument AI workflows using platforms like Langfuse for tracing and debugging. Implement and maintain evaluation harnesses to ensure model quality and performance
Qualifications
- 7+ years of professional experience in a role blending software development and data science/machine learning.
- Expert-level Python development skills and a proven track record of designing and building scalable backend services and APIs (FastAPI preferred).
- Deep, hands-on experience designing and building solutions with multiple agentic frameworks (e.g., LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel).
- Extensive experience architecting and optimizing RAG systems and integrating with vector databases (e.g., OpenSearch, Pinecone, Weaviate).
- Proven expertise in designing and deploying containerized (Docker/Kubernetes) AI systems on a major cloud platform (AWS, Azure, or GCP).
- Strong experience implementing MLOps principles, including CI/CD, observability, and evaluation frameworks for LLM-based systems.
- In-depth understanding of AI risk, safety, and enterprise governance requirements.
- Strong background in ML, deep learning, and NLP, including Transformer architectures.
- Preferred Qualifications Experience leading the design of LLM evaluation harnesses for automated release validation.
- Deep experience with Langfuse or similar AI observability and tracing platforms.
- Hands-on expertise with AWS Bedrock, Azure AI Foundry, or GCP Vertex AI.
- Knowledge of GraphRAG patterns and advanced multi-hop retrieval strategies.
- AWS certifications (e.g., Solutions Architect, AI/ML Specialty) or equivalent.
- Background in financial services or another highly regulated industry.
- Education: Bachelor's degree in Computer Science, Engineering, Business, or a related field.
- This is a Individual contributor role. ------------------------------------------------------ Job Family Group: Risk Management ------------------------------------------------------ Job Family: Model Development and Analytics ------------------------------------------------------ Time Type: Full time ------------------------------------------------------ Most Relevant Skills Analytical Thinking, Credible Challenge, Data Analysis, Governance, Policy, Procedure
- Regulation, Risk Management Lifecycle. ------------------------------------------------------ Other Relevant Skills For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ Citi is an equal opportunity employer
- qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran
- any other characteristic protected by law.
- If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .
- View Citi’s EEO Policy Statement and the Know Your Rights poster.