Test Engineer - Data Platforms

Test Engineer – Data Platforms

Role Overview

We are seeking an experienced Lead Test Engineer to take full ownership of the testing approach for data pipelines and data products within a modern Azure data platform. This role is hands-on: you will design, implement, and execute test strategies across the stack, working alongside data engineers, BI developers, and architects to ensure robust, high-quality, and reliable solutions.

The platform leverages Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. As the sole test specialist, you will embed quality engineering into every stage of delivery, acting as the authority on data testing practices.

Key Responsibilities

• Test Ownership & Strategy
• Define and own the overall testing strategy for data pipelines, models, and reporting solutions.
• Establish automated testing frameworks and ensure they are embedded in delivery processes.
• Act as the subject matter expert for data testing, advising engineers and stakeholders.
• Hands-on Testing
• Design and execute test cases across data ingestion, transformation, storage, and presentation layers.
• Implement automated validation for data pipelines (Databricks notebooks, ADF workflows, ADLS layers).
• Validate Power BI dashboards and reports for data accuracy, performance, and usability.
• Perform exploratory, regression, and performance testing as required.
• Quality Assurance
• Set up data quality checks, reconciliation processes, and monitoring.
• Ensure compliance with data security and governance requirements.
• Integrate test execution into CI/CD pipelines to enforce quality gates.
• Collaboration
• Work closely with data engineers to embed testing at source.
• Partner with architects and product owners to define acceptance criteria.
• Represent testing considerations in sprint planning and delivery reviews.

Requirements

Essential Skills & Experience

• Strong track record as a Test Engineer in data engineering or analytics projects.
• Expertise in testing Azure data services: Databricks, ADF, ADLS, and Power BI.
• Proficiency in SQL and data profiling for test design and validation.
• Hands-on experience with test automation frameworks for data (e.g., Python/Pyspark, Great Expectations, Pytest, dbt tests, or equivalent).
• Practical knowledge of CI/CD integration (Azure DevOps, GitHub Actions, or similar).
• Excellent problem-solving skills and the ability to work independently as the sole testing specialist on a delivery team.

Desirable Skills

• Familiarity with public sector delivery frameworks and regulated data environments.
• Experience of data performance testing and monitoring.
• Knowledge of Agile delivery methods and DevOps practices.
• Exposure to Test-Driven Development (TDD) and Behaviour-Driven Development (BDD) practices.
• ISTQB or similar testing certification.

Benefits

Why people choose to grow their careers at UBDS Group

 Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

 UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover

About Ubds Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.