Data Engineer Databricks - AWS - Brussels - ASAP Start - Freelance / CDI

Company Description

About the Company
A global energy and services group dedicated to accelerating the transition to a carbon-neutral world. The B2C division in Belgium provides energy solutions to retail customers (residential and SMEs), supporting their energy transition journey.

Context
The B2C Belgium team has established a Databricks environment on AWS Cloud to migrate projects and use cases from various technologies (SAS, AWS Sagemaker, BW/HANA, etc.).

Job Description

Role Overview
Seeking a Junior Databricks Data Engineer to join the squad responsible for managing multiple data platforms. The role involves working under the supervision of the squad’s Product Owner, with dedicated support and onboarding.

Key Responsibilities

• Data Ingestion & Pipeline Development
• Access & Security Management
• Monitoring & Optimization
• Team Support
• Develop and maintain Delta Live Tables (DLT) pipelines for ingesting data from diverse source systems.
• Ensure data quality, lineage, and monitoring are integrated into ingestion workflows as needed.
• Set up and manage table-level access controls using Unity Catalog or other Databricks-native solutions.
• Collaborate with infrastructure and other teams to ensure compliance with standards.
• Implement monitoring and alerting for data pipelines.
• Optimize performance and costs, following established best practices.
• Assist with infrastructure management and respond to requests from teams using the Databricks platform.

Qualifications

Required Skills

• Proficiency in Python and SQL.
• Hands-on experience with Delta Lake and Delta Live Tables.
• Strong communication and organizational skills.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
• Databricks Data Engineer certification.

Languages

• Fluent in Dutch or French.
• English as a working language.

Location & Period

• Brussels (minimum 2 days/week in the office).