ADP is hiring a Lead Data Operations Engineer – Sales and Marketing.

The Lead Data Operations Engineer will develop and support our sales and marketing data lake house and data pipelines through integration, analytics and reporting using both on premises and cloud-based technology. Operating within a cross-functional agile team, the Engineer will interface with product owners, data architects, data scientists and developers to define and understand data engineering requirements and implement solutions. The Engineer will perform data wrangling – ingesting, cleansing, and combining data from many sources- enabling additional segmentation, measurement, and activation capabilities across the client experience spectrum. The Engineer will also produce advanced data analysis and metrics and support the data pipeline CI/CD system.

Main responsibilities:

Interface with product owners, data architects, data scientists and developers to define and understand data engineering requirements and implement solutions
Implement solutions to aggregate and consolidate vast, complex data sets to empower business leaders to make better, data-informed decisions.
Develop Python notebooks to perform data wrangling – ingesting, cleansing, and combining data from many sources- enabling additional segmentation, measurement, and activation capabilities across the client experience spectrum
Integrate and optimize performance of python notebooks in highly complex Databricks workflows
Provide operational support for 24/7 Business Critical data pipelines
Create and improve processes and standards to automate and optimize data delivery and scalability.
Create solutions to provide visibility and metrics (KPIs) providing insights into data pipeline operational efficiency.
Analyze data to identify and interpret associations, trends, and patterns.

Qualifications:

3+ years of experience in Python/PySpark for data engineering on Databricks with Unity Catalog.
6+ years of experience in data engineering or database administration, ETL, business intelligence, and advanced SQL with traditional databases like Oracle, SQL Server, Postgres and others.
Extensive experience in writing complex SQL queries to extract, transform and load data from large heterogenous data sources to meet business requirements.
Exposure to marketing data domain knowledge- sales automation, sales processes, Salesforce.com integrations with Databricks, Salesforce Data cloud and zero-copy options is desirable.
Experience with Databricks on AWS web services, and with Redshift is desirable
Experience visualizing data with PowerBI is desirable.
Knowledge about database architecture and schema design to create and load data to tables.
Basic knowledge of API configuration to extract and load data into databases.
Bachelor's Degree -- Computer Science or equivalent

Qualifications

#LI-RG2