Senior Data Engineer (Python | Dataiku | Cloud)

Job Description

You will work on a project focused on the evolution of third-party data ecosystems would aim to streamline the integration of new data and technologies such as data virtualization, APIs, etc., enhancing the accessibility and real-time availability  of data across systems.

• Develop the technical solution framework and participate in TPCV modeling     
• Develop the TPCV and implement unit tests                                                        
• Industrialize the solution according to CI/CD best practices                                                    
• Participate in the validation phase with end-users                                                           
• Implement the data exposure solution            

Qualifications

• Proficiency in Python programming language and libraries such as Pandas, Polars, SQLAlchemy, Psycopg2, ibmboto3, etc                                                   
• Mastery of good programming practices (CI/CD, unit testing, versioning, etc.) and Dataiku (mandatory)                                                 
• Experience with cloud environments (AWS, IBM, etc.) and containerization using Docker                     
• Agile Methodologies and tools (Jira, Confluence, ALM)                                                 
• Knowledge of ETL (Extract, Transform, Load) processes and best practices/optimizations​. Strong understanding of SQL and one or more databases (PostgreSQL, Oracle, etc.)              
• English - fluent