Lead Software Engineer – Applied AI/ML Infrastructure – Cloud/Platform - (Kubernetes / AWS / Terraform)

As a Lead Software Engineer at JPMorgan Chase within the Corporate and Investment Banking Applied Artificial Intelligence and Machine Learning team, you will play a pivotal role in transforming the operations of the world's largest bank. You will collaborate with software engineers, data scientists, and line of business teams to develop and sustain resilient infrastructure for AI/ML solutions.

 

Job Responsibilities

• Design, deploy, and operate application infrastructure using Amazon EKS/ECS.
• Build and maintain foundational data storage infrastructure, including Aurora Postgres, OpenSearch, and Amazon S3.
• Deploy and operate open-source AI/ML software, ensuring scalability, security, and operational efficiency.
• Automate infrastructure provisioning and management using Terraform, Helm, Spinnaker, and related tools.
• Implement and uphold resiliency best practices, including defining and meeting SLAs/SLOs.
• Monitor and manage controls and hygiene alerts to maintain compliance and operational excellence.
• Lead initiatives to promote best practices in infrastructure engineering and DevOps.
• Collaborate closely with SRE and production monitoring teams to ensure system reliability, performance, and rapid incident response.

 

Required Qualifications, Capabilities, and Skills

• Bachelor’s degree or higher in Computer Science, Engineering, or a related field, or equivalent formal training/certification.
• Proven hands-on experience with AWS services (Aurora/RDS, EKS, ECS, VPC, IAM, S3).
• Strong experience with Kubernetes (Amazon EKS).
• Proficiency with Infrastructure as Code (IaC) tools, such as Terraform.
• Experience automating operational tasks and CI/CD workflows.
• Demonstrated ability to design and operate resilient, scalable, and secure infrastructure in production environments.

• Excellent communication skills, with the ability to convey technical information clearly and build trust with stakeholders at all levels.

   

Preferred Qualifications, Capabilities, and Skills

• Practical experience deploying LLM-based applications into production and an understanding of MLOps.

 

J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
   We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.