Director - Applied AI ML (Software Engineering/Data & Agentic Systems)

Join our innovative team and shape the future of software development with AI-driven solutions.

As an Applied GenAI Engineering Director within the Ai4Tect Team at JPMorganChase, you will leverage deep software engineering and data engineering expertise to design, build, and deliver trusted, secure, stable, and scalable GenAI capabilities. You will partner with agile engineering teams to create production-grade agentic workflows and RAG-based systems, and to establish reusable frameworks (“golden paths”), shared components, and best practices that accelerate delivery and ensure consistency across business functions. You will stay current on GenAI engineering trends and translate complex technical tradeoffs into clear guidance for senior stakeholders, enabling informed decisions and measurable business impact.

Job Responsibilities

• Establish and promote a library of reusable GenAI/ML engineering assets, including reference implementations, standardized templates/SDKs, shared RAG components (ingestion, chunking, embedding, indexing, retrieval), and deployment patterns.
• Lead the creation of shared tools and platforms that streamline the end-to-end lifecycle for GenAI applications, including data pipelines, orchestration, evaluation, monitoring/telemetry, and release governance.
• Build and operationalize agentic GenAI workflows (planning/execution patterns, tool calling, state management, retries) with appropriate guardrails, permissions, and observability.
• Design and implement Generative AI evaluation and feedback loops (offline test suites, human review where needed, continuous evaluation, telemetry-based monitoring, regression gating in CI/CD).
• Advise on strategy and development across multiple GenAI products, applications, and technology portfolios—focusing on common capabilities that scale across teams rather than one-off solutions.
• Serve as a lead advisor on technical feasibility and business value for GenAI use cases, driving build-vs-buy decisions and pragmatic solution designs.
• Liaise with firmwide AI/ML stakeholders to drive standards, interoperability, adoption, and reuse of shared frameworks.
• Communicate complex technical issues and tradeoffs (quality vs latency vs cost; evaluation design; governance; security) to leadership to support well-informed strategic decisions.
• Influence across business, product, and technology teams; effectively manage senior stakeholder relationships; mentor engineers and practitioners to raise engineering and delivery standards.

• Champion the firm’s culture of diversity, opportunity, inclusion, and respect.

  
  

Required qualifications, capabilities, and skills

• 10+ years of applied experience in software engineering and/or data engineering using Python, Java, or similar languages, building production distributed systems end-to-end.
• Hands-on experience designing and delivering GenAI systems to production, including RAG (embeddings, retrieval/indexing) and evaluation/monitoring.
• Hands-on experience building agentic workflows (tool calling, orchestration, state, retries, guardrails) using frameworks such as LangChain/LangGraph or equivalent.
• Strong understanding of data architecture and engineering (lakehouse/data platform concepts), including data quality, lineage/metadata, idempotent pipelines, backfills, and governance/PII controls relevant to GenAI.
• Strong cloud-native experience on AWS, including secure deployment and operations (e.g., EKS and/or managed services), plus cost/latency management.

• Proven ability to translate complex technical issues to senior stakeholders; excellent communication, attention to detail, and follow-through.

  
  

Preferred qualifications, capabilities, and skills

• Bachelor’s/Master’s degree in Computer Science (or equivalent practical experience).
• Working knowledge of PyTorch or TensorFlow (enough to partner effectively with ML practitioners).

• Experience with ML/GenAI evaluation automation and CI/CD quality gates (beyond basic offline testing).

  
  

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.