Lead Software Engineer-AI Foundation Services

JP Morgan Chase · Palo Alto, California; Wilmington, Delaware; Jersey City, New Jersey and 3 more · Posted 2026-07-14

Description -----------

Join JPMorganChase’s Chief Data & Analytics (AIML Data Platforms) team in Jersey City as a Lead Software Engineer building AI foundation services for GenAI and ML at enterprise scale. You’ll lead hands-on delivery of secure, reliable, cloud-native platform capabilities (Kubernetes/CI/CD/IaC) and partner with application teams to create reusable integrations, reference implementations, and onboarding assets.

As a Lead Software Engineer at JPMorganChase within the AIML Data Platforms – Chief Data and Analytics team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. In this role you will get to drive significant business impact through your capabilities and contributions and apply your deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.

Job responsibilities

Partners with Lines of Business application teams to implement AI Foundation Services capabilities that unblock GenAI/AI use cases, supporting delivery from technical design through build, launch, and early operational support
Builds and enhances reusable platform services, APIs, SDKs, and libraries that standardize how application teams consume model hosting, inference, and AI/ML managed services
Translates functional and non-functional application requirements into clear technical designs, engineering tasks, and delivery milestones with support from senior engineers and architects
Develops secure, stable, and high-quality production code, and participates in code reviews, debugging, testing, and remediation of defects across AI Foundation Services components
Creates and maintains reusable engineering assets such as reference implementations, runbooks, test harnesses, baseline configurations, and onboarding guides to accelerate adoption across teams
Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
Designs and implements scalable software components using appropriate software design patterns, cloud-native practices, and platform engineering standards
Collaborates with cross-functional teams across product, architecture, security, infrastructure, and application development to resolve technical dependencies and deliver production-ready capabilities
Contributes to technical methods, standards, documentation, and implementation patterns within AI Foundation Services, helping improve consistency, reliability, and reuse across delivery teams
Communicates technical progress, risks, dependencies, and implementation options to engineering managers, product partners, and senior technical stakeholders

Required qualifications, capabilities, and skills

Formal training or certification on software engineering concepts and 5+ years applied experience

Strong hands-on coding experience in one or more languages used for platform services, such as Python, Java, or Go, with experience delivering production-grade services or APIs
Experience building shared services, reusable components, or platform capabilities consumed by multiple application or engineering teams
Experience with infrastructure-as-code and cloud-native delivery practices, including tools such as Terraform, containers, Kubernetes, CI/CD pipelines, and automated deployment workflows
Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
Hands-on practical experience with system design, application development, automated testing, debugging, and operational stability for production software
Experience implementing observability, logging, metrics, alerts, Service Level Objectives, incident response practices, and root-cause analysis for services in production
Working knowledge of software application development and technical processes, with depth in one or more areas such as cloud platforms, artificial intelligence, machine learning platforms, distributed systems, or infrastructure engineering
Ability to break down technical requirements into executable engineering tasks, manage dependencies, and deliver against milestones in partnership with product and application teams
Strong written and verbal communication skills, with the ability to explain technical decisions, trade-offs, issues, and risks to engineering teams and stakeholders

Preferred qualifications, capabilities, and skills

Experience supporting AI/ML or GenAI platform capabilities, including model hosting, inference services, model gateways, managed AI services, or developer-facing AI/ML infrastructure
Experience with GPU-enabled platforms or AI workload optimization, including inference latency, throughput, batching, capacity planning, or cost/performance tuning
Experience building reusable “golden path” assets such as templates, reference implementations, SDKs, automated tests, onboarding guides, and deployment patterns
Familiarity with model serving patterns, rollout strategies, safety controls, authorization, rate limiting, policy enforcement, and evaluation hooks

About JP Morgan Chase

JP Morgan Chase is a global financial services provider that offers investment banking, asset management, treasury, and other services.

Lead Software Engineer-AI Foundation Services

About JP Morgan Chase

More jobs at JP Morgan Chase

Related searches