Enterprise SaaS - MSD - Power Platform - Developer

Data Engineer — Microsoft Fabric (with Power Platform)

Role purpose
Build reliable, observable Fabric pipelines ingesting Salesforce (incl. CPQ) into Lakehouse/Delta with ~5–10 minute updates; extend to Oracle integration in Phase 2, implementing medallion architecture and quality by design. 

Responsibilities

• Implement incremental ingestion via Data Factory, Dataflows Gen2 and notebooks (Spark/SQL); parameterise, manage secrets, retry/error-handling, SLAs. 
• Design bronze/silver/gold layers with testing/expectations, SCD handling and lineage; optimise partitioning and file sizes.
• Build Phase 2 Oracle interfaces (API/flat-file staging), field mappings and validations; support reconciliations. 
• Automate environment promotion (Dev/QA/Prod) and CI/CD; expose operational metrics.
• Leverage Power Platform connectors/Dataflows where appropriate; enable Power Automate notifications for pipeline events.

Essential Experience

• Fabric engineering at scale (Lakehouse/Delta, pipelines, Spark/SQL), strong SQL/Python/PySpark; Git-based CI/CD.
• Ingesting Salesforce data and integrating Oracle/finance sources.

Desirable

• Event-driven/near-real-time patterns; Purview; DP-203/DP-600.