About this role
Role Overview
We are seeking a highly skilled Senior Data Engineer with strong expertise in SQL development, ETL processes, database optimization, and enterprise data integration. The ideal candidate has hands-on experience working with large datasets, optimizing performance, and enabling data flows across heterogeneous systems and platforms.
Key Responsibilities
-
Design, develop, and optimize robust data pipelines and ETL workflows.
-
Write complex SQL queries, stored procedures, and performance-optimized transformations across large datasets.
-
Develop and maintain data views, schemas, indexing strategies, and database objects for optimal query execution.
-
Lead and execute data migration initiatives across heterogeneous systems (on-prem, cloud, legacy, modern).
-
Implement data transformation logic to support business rules, data enrichment, cleansing, and aggregation.
-
Integrate external data sources through RESTful APIs, including authentication, pagination, error handling, and ingestion orchestration.
-
Collaborate with cross-functional teams to ensure data models, pipelines, and integrations support analytical and operational requirements.
-
Ensure data quality, consistency, reconciliation, and validation across environments.
-
Participate in cut-over planning, testing cycles, and controlled deployment processes.
-
Contribute to data governance, metadata management, and technical documentation.
Required Skills & Experience
Strong SQL Proficiency (6–7 years)
-
Expert in complex SQL queries (joins, subqueries, window functions, stored procedures).
-
Hands-on experience with performance tuning and handling large datasets.
SQL Optimization (3+ years)
-
Demonstrated experience optimizing database queries and improving performance across large-scale data environments.
ETL Development (6–7 years)
-
Experience with ETL tools such as Informatica, Datastage, or ODI (any is acceptable).
Database Engineering (6–7 years)
-
Must have: PostgreSQL and/or Oracle experience including:
-
schema design
-
views
-
indexing
-
stored procedures
-
database optimization
-
Data Migration (5+ years)
-
Experience migrating data between heterogeneous systems (on-prem to cloud, legacy to modern).
-
Involvement in validation, reconciliation, testing, and cut-over planning.
Data Transformation (5+ years)
-
Experience implementing complex transformation rules with focus on data consistency, cleansing, enrichment, and aggregation.
REST API Integration (3+ years)
-
Experience consuming REST APIs for data ingestion.
-
Ability to handle authentication (OAuth/API Keys), pagination, rate limits, JSON parsing, and error handling.
-
Bonus: Exposure to building lightweight REST APIs to expose curated datasets.