Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Role Summary:

We are seeking a Technical ETL Lead to design, build, and manage scalable data pipelines and modern data platforms using Databricks and cloud-based data lakes. This role will play a critical part in delivering data solutions that support analytics, reporting, and AI initiatives.

Key Responsibilities

Data Engineering Leadership
- Lead design and implementation of ETL/ELT pipelines on cloud platforms
- Drive best practices for scalable, reliable, and high-performance data solutions
- Provide technical leadership and mentoring to data engineers
Databricks & Data Platform Development
- Build and optimize data pipelines using Azure Databricks
- Design and manage Data Lake architectures (Lakehouse preferred)
- Develop reusable frameworks for ingestion, transformation, and orchestration
Architecture & Design
- Define data models, integration patterns, and storage strategies
- Ensure data quality, governance, and security across pipelines
- Optimize performance and cost across large-scale data processing systems
Collaboration & Delivery
- Work with business, analytics, and application teams to define data requirements
- Partner with cloud, DevOps, and architecture teams for platform integration
Automation & AI Enablement
- Incorporate automation, AI/ML pipelines, and agentic workflows
- Build intelligent data pipelines with monitoring and self-healing capabilities

Experience:

8+ years in Data Engineering / ETL development
2–3+ years in a lead or senior technical role

Skills Required:

Strong experience with:
- Azure Databricks (Spark, PySpark)
- Data Lakes (Azure Data Lake Storage)
- ETL/ELT frameworks and distributed data processing
- SQL, Python (preferred), and data modeling
Cloud & Tools
- Azure ecosystem (ADF, Synapse, Databricks)
- CI/CD pipelines for data workflows
- Data governance and monitoring tools
Soft Skills
- Strong problem-solving and communication skills
- Ability to translate business needs into technical solutions

Preferred Experience

Large-scale enterprise data platform implementation
Experience with real-time streaming (Kafka/Event Hub)
Familiarity with AI/ML pipelines and advanced analytics
Experience in regulated/audit environments

Key Differentiator:

Ability to build modern, AI-enabled data platforms with strong automation and scalability

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

What information we collect during our application and recruitment process and why we collect it;
How we handle that information; and

ETL/Data Engineer

Want to see the full job description?

Job details

Orion Innovation