Principal Software Test Engineer - Ally.ai Platform

General Information

Career area Technology Work Location(s) 601 S. Tryon Street, NC Remote? No Ref # 20757 Posted Date 10-01-25 Working time Full time

Ally And Your Career

Ally Financial only succeeds when its people do - and that’s more than some cliché people put on job postings. We live this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion. From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You’re constantly evolving, so shouldn’t your opportunities be, too?
Work Schedule: Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role's specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity

Join Ally’s Generative AI journey as a Principal Software Test Engineer on the Ally.ai platform. You’ll define the quality strategy and test architecture that ensure our LLM-powered APIs and platform services are secure, reliable, and compliant. This role leads the design of automated API, performance, resiliency, and security testing that integrates tightly with our DevSecOps pipelines and Cloud infrastructure. You’ll partner with platform engineering, SRE, and cyber security teams to build repeatable, measurable quality gates for Ally.ai

At this time, Ally will not sponsor a new applicant for employment authorization for this position.

The Work Itself

• Own the Test Strategy & Architecture for Ally.ai platform services, aligning with the existing test strategy and environments. Define what, where, and how we test across functional, integration, regression, and UAT layers.
• Build end‑to‑end API test automation (Python) for RESTful services, including contract tests, negative/fuzz tests, auth/entitlements, and data integrity checks—integrated with GitLab quality gates and IaC-driven ephemeral environments.
• Production Quality & Monitoring: partner with SRE to convert test signals into production SLOs and alerting; validate audit/telemetry pipelines as part of “definition of done.”
• Mentor & Lead: coach teams on test design, flaky-test reduction, and deterministic testing patterns for non-deterministic LLM outputs; advocate for inner‑source contributions to quality tooling. 
• Operationalize non‑functional testing: performance (latency, throughput, cost/efficiency for LLM calls), chaos/resiliency (degradations, timeouts, retries), and observability-driven validation.

The Skills You Bring

• 5+ years of experience creating test automation (functional, integration, and load) using Python required. 
• 3+ years of demonstratable experience with automated testing for APIs and infrastructure required.
• Hands-on experience with code management and CI/CD pipelines (GitLab Preferred)
• Familiarity creating regression testing across multiple API versions.
• Experience with creating and managing Collections using tools like Postman or Insomnia.
• Practical knowledge of Cloud Native and serverless and services (AWS preferred).
• Bachelor's degree in computer science, electrical engineering or related field preferred

Good to have skills

• Familiarity with AI / GenAI technologies
• Experience with synthetic data generation, de‑identification/masking strategies, and validation of audit trails.
• Experience with tools like CloudWatch, Datadog, or Prometheus for performance monitoring.
• Ability to mentor engineers, lead technical discussions, and influence architectural decisions.
• AI First Mindset: Desire to infuse AI into all steps of the engineering process.

How We'Ll Have Your Back

Ally's compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

• Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).
• Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.
• Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.
• Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.
• Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.
• Other compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.
• To view more detailed information about Ally’s Total Rewards, please visit this link: https://www.ally.com/content/dam/pdf/corporate/ally-total-rewards-snapshot.pdf

 

Who We Are:

 

Ally Financial is a customer-centric, leading digital financial services company with passionate customer service and innovative financial solutions. We are relentlessly focused on "Doing it Right" and being a trusted financial-services provider to our consumer, commercial, and corporate customers. For more information, visit www.ally.com.

 

Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law.

 

We are committed to working with and providing reasonable accommodation to applicants with physical or mental disabilities. For accommodation requests, email us at hrpolicy@ally.com. Ally will not discriminate against any qualified individual who is capable of performing the essential functions of the job with or without reasonable accommodation.

Base Pay Range: $90000 - $150000 USDAn individual's position in the range is determined by the specific role, the scope and responsibilities of the role, work experience, education, certification(s), training, and additional qualifications. We review internal pay, the competitive market, and business environment prior to extending an offer.  Incentive Compensation: This position is eligible to participate in our annual incentive plan.