Data BAU Lead (Snowflake & AWS)

We are looking for a seasoned BAU Lead - Data Engineering to lead our data operations and support function in a cloud-first environment. The ideal candidate will bring strong technical leadership, hands-on expertise in AWS and Snowflake, and proven experience in managing Business-As-Usual (BAU) data platforms, production support, and continuous improvement initiatives.

▪ Develop tools to improve data flows between internal/external systems and the data lake/warehouse.

▪ Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.

▪ Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.

▪ Understanding existing data applications and infrastructure architecture

▪ Build and support new data feeds for various Data Management layers and Data Lakes

▪ Evaluate business needs and requirements.

▪ Support migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.

▪ Lead the migration of the existing data transformation jobs in Oracle, Hive, Impala etc. into Spark, Python on Glue etc.

▪ Able to document the processes and steps.

▪ Develop and maintain datasets.

▪ Improve data quality and efficiency.

▪ Lead Business requirements and deliver accordingly.

▪ Collaborate with Data Scientists, Architect and Team onseveral Data Analytics projects.

▪ Collaborate with DevOps Engineer to improve system deployment and monitoring process.

▪ Experience in critical production support and how the BAU functions is preferred.

Requirements

▪ At least 8+ years of Data Engineer Experience.

▪ At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.

▪ 2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.

Lead a team of data engineers in managing day-to-day BAU operations, production support, incident management, and platform stability.

▪ Strong AWS knowledge in terms of designing new architecture and providing optimized solutions for existing ones. (S3, Glue, DMS, MWAA, AMS, IAM).

▪ In-depth knowledge with respect to Snowflake and its architecture.

▪ Prefer prior Experience in BAU environment.

▪ Good knowledge on Airflow and MWAA.

▪ Hands-on experience in SQL/Python/Pyspark.

▪ Expertise in optimizing techniques in cloud environments