Data Engineer L2
Vana.com
Office
Guatemala
Full Time
About the Job:We are seeking a motivated and skilled Data Engineer to join our fast-growing fintech company in Latin America. As a Data Engineer Level 2, you will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. You will work closely with data scientists and analysts to ensure data quality, availability, and integrity. This role requires initiative, problem-solving skills, and the ability to work independently while collaborating with cross-functional teams.
Key Responsibilities:
• Data Pipeline Development: Design and maintain scalable data pipelines using Python and SQL to ingest and process data from various sources.• Data Warehouse Management: Optimize and administer our data warehouse (Redshift), including performance tuning and managing data access.• ETL Processes: Implement and maintain ETL processes to ensure data consistency and quality.• Collaboration: Work with data scientists and analysts to understand data needs and ensure the availability of required datasets.• Data Quality Assurance: Monitor and troubleshoot data pipelines, fix inconsistencies, and ensure smooth operation.• Automation and Scripting: Develop scripts and tools to automate data engineering tasks and improve efficiency.• Cloud Services Integration: Utilize AWS services (e.g., Redshift, Lambda, ECS) to manage and optimize cloud resources for data operations.• Workflow Orchestration: Use tools like Airflow to schedule and manage data workflows.• Documentation: Document processes, configurations, and workflows for knowledge sharing and scalability.• Continuous Improvement: Identify opportunities to enhance data infrastructure, processes, and technologies.
Requirements:
• Education: Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent practical experience.• Experience: 4+ years in data engineering or a related field.
Technical Skills:
• Proficiency in Python for data manipulation and automation.• Strong SQL skills for querying and managing databases.• Familiarity with AWS services like Redshift, Lambda, and ECS.• Experience with workflow orchestration tools like Airflow.• Understanding of ETL concepts and processes.• Experience with version control (Git) and CI/CD pipelines.
Soft Skills:
• Strong problem-solving and analytical abilities.• Excellent communication skills for collaborating with cross-functional teams.• Ability to work independently and as part of a team.• Attention to detail and commitment to data quality.• Eagerness to learn and adapt to new technologies.
Preferred Qualifications:
• Experience with data modeling and schema design.• Knowledge of big data technologies like Spark or Hadoop.• Familiarity with data visualization tools.• Understanding of data governance and security best practices.• Experience in the fintech industry or fast-paced startup environments.
What We Offer:• Dynamic Environment: Work in a fast-paced, collaborative setting.• Professional Growth: Opportunities for career advancement and mentorship.• Innovative Technologies: Exposure to cutting-edge fintech technologies.• Impactful Work: Make a significant impact on the company's growth and success.
Key Responsibilities:
• Data Pipeline Development: Design and maintain scalable data pipelines using Python and SQL to ingest and process data from various sources.• Data Warehouse Management: Optimize and administer our data warehouse (Redshift), including performance tuning and managing data access.• ETL Processes: Implement and maintain ETL processes to ensure data consistency and quality.• Collaboration: Work with data scientists and analysts to understand data needs and ensure the availability of required datasets.• Data Quality Assurance: Monitor and troubleshoot data pipelines, fix inconsistencies, and ensure smooth operation.• Automation and Scripting: Develop scripts and tools to automate data engineering tasks and improve efficiency.• Cloud Services Integration: Utilize AWS services (e.g., Redshift, Lambda, ECS) to manage and optimize cloud resources for data operations.• Workflow Orchestration: Use tools like Airflow to schedule and manage data workflows.• Documentation: Document processes, configurations, and workflows for knowledge sharing and scalability.• Continuous Improvement: Identify opportunities to enhance data infrastructure, processes, and technologies.
Requirements:
• Education: Bachelor's degree in Computer Science, Engineering, Information Systems, or related field, or equivalent practical experience.• Experience: 4+ years in data engineering or a related field.
Technical Skills:
• Proficiency in Python for data manipulation and automation.• Strong SQL skills for querying and managing databases.• Familiarity with AWS services like Redshift, Lambda, and ECS.• Experience with workflow orchestration tools like Airflow.• Understanding of ETL concepts and processes.• Experience with version control (Git) and CI/CD pipelines.
Soft Skills:
• Strong problem-solving and analytical abilities.• Excellent communication skills for collaborating with cross-functional teams.• Ability to work independently and as part of a team.• Attention to detail and commitment to data quality.• Eagerness to learn and adapt to new technologies.
Preferred Qualifications:
• Experience with data modeling and schema design.• Knowledge of big data technologies like Spark or Hadoop.• Familiarity with data visualization tools.• Understanding of data governance and security best practices.• Experience in the fintech industry or fast-paced startup environments.
What We Offer:• Dynamic Environment: Work in a fast-paced, collaborative setting.• Professional Growth: Opportunities for career advancement and mentorship.• Innovative Technologies: Exposure to cutting-edge fintech technologies.• Impactful Work: Make a significant impact on the company's growth and success.