Senior ML Ops Engineer (m/f/d)

Job Description

About your tasks:

• Develop and maintain CI/CD pipelines for deploying ML and LLM models in production, ensuring rapid and reliable model iteration.
• Optimize the deployment process for LLMs, considering cost, latency, and scalability constraints.
• Automate model retraining and redeployment processes to respond to changing data patterns.
• Set up and manage cloud and on-premise infrastructure for ML/LLM workloads on platforms such as AWS, GCP, or Azure.
• Work with containerization and orchestration tools (e.g., Docker, Kubernetes) to ensure scalable and resilient model deployment.
• Implement data versioning and validation processes to maintain data integrity throughout the ML lifecycle.
• Use tools like MLflow for tracking experiments, managing model versions, and maintaining reproducibility.
• Document MLOps/LLMOps practices and mentor team members on deployment best practices.

Qualifications

About you:

• Experience in MLOps, DevOps, or a related role, with hands-on experience deploying ML/LLM models.
• Proficiency in cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes).
• Experience with CI/CD tools (e.g. Github Actions or Jenkins) and ML workflow tools (e.g., MLflow, Kubeflow).
• Strong scripting skills (Python, Bash) and familiarity with infrastructure-as-code tools (e.g., Terraform) and experience with Git or version control mechanisms.
• Strong analytical and problem-solving skills.

Additional Information

About your benefits:

In order to provide you with the best possible support for your individual needs - whether it‘s living a healthy life, having enough time for your family, or developing your skills - we offer a wide range of different, site-specific benefits:

• Work from Home: If your job does not require you to be present in the office, we can arrange the place you work from individually - even for up to 20 days a year anywhere in the EU.
• Personal development: Grow! We support and encourage your individual development through various in- and external trainings.
• Redcare events: We promote teambuilding through creative team events, and celebrate our successes together at regularly scheduled parties.
• Corporate pension plan: We offer a company pension scheme and have a dedicated external consultant to offer you the best guidance and advice.
• Mental Health: Get quick and professional help from psychologists of nilo if you feel overwhelmed in private or professional life. Anonymous and free of charge.