ETL Designer - Senior Consultants only

Company Description

Tittle: Senior ETL Designer GCP Consultant 
Location: Plano TX (remote but CST working hours)
Type: Contract
 
Job Description:
We are seeking a highly experienced ETL designer to join our team. The ideal candidate will have over 12-15 years of experience in designing and implementing data solutions, with a strong focus on cloud data warehousing and real-time data processing. This role requires advanced knowledge in various data technologies and the ability to translate business requirements into scalable and efficient data architectures.
 
Key Responsibilities:
•         Design, develop, and maintain robust ETL pipelines on GCP using tools like Dataflow, BigQuery, Cloud Composer (Apache Airflow), and Pub/Sub
•         Optimize data ingestion, transformation, and loading processes for high-volume, real-time, and batch data processing
•         Ensure data integrity, quality, and security throughout the ETL lifecycle
•         Collaborate with data engineers, analysts, and business teams to understand data needs and translate them into efficient ETL solutions
•         Implement best practices for performance tuning, error handling, and monitoring of ETL jobs
•         Work with structured and unstructured data sources, integrating API-based, event-driven, and batch processing workflows
•         Automate and document ETL processes to enhance maintainability and scalability
•         Utilize Git for version control and deployment of ETL workflows, ensuring smooth CI/CD integration
 
Key Skills:
•         12+ years of experience in ETL design and development
•         Proficiency in SQL, Python, and Apache Beam for data processing using dataflow, dataproc appliances.
•         Strong experience in advance DML operations, query optimization
•         Strong expertise in GCP services (BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer)
•         Experience with data modeling, warehousing concepts, and data lakes
•         Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer on DAG design, Error handling and monitoring
•         Knowledge of performance tuning, data partitioning, and optimization techniques
•         Experience in real-time streaming ETL and event-driven architectures is a plus
•         Familiarity with Git for version control and deployment of ETL pipelines
•         Strong problem-solving skills and ability to work in an agile environment
 
Qualifications:
•         Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
•         Proven experience in ETL design and implementation in DWH systems.
•         Strong problem-solving skills and the ability to work in a fast-paced environment.
•         Excellent communication and collaboration skills.
 
 

Additional Information

All your information will be kept confidential according to EEO guidelines.