
Senior Data Engineer
CREATEQ
Posted 4 days ago
- Working with stakeholders to grow the amount and kinds of customer-defined targetings we can calculate in real-time
- Develop new features for our in-house streaming key/value DBs
- Improve resource utilization across all stages of our data pipelines, from validation and ingestion to storage to dynamic queries
- Collaborate with developers and stakeholders to design services in order to meet product and business requirements
Requirements
- Strong experience designing, building, implementing, and maintaining large real-time data pipelines with Kafka and Kafka Streams
- Significant expertise with data consistency, throughput, and event-driven system concepts
- Fluent in Python and/or Java
- Familiar with designing and deploying data jobs
- Experience with managing and monitoring service infrastructure and deployments
- Worked with Kafka, Kafka Streams, Trino (or any distributed SQL engine), Airflow, Kubernetes, Docker, Helm, Jenkins, Prometheus, Grafana, Elasticsearch
- Nice to have: Basic knowledge of AWS services such as S3 and RDS, and Terraform
Benefits
- Challenging projects in a highly professional, but also a collaborative and supportive environment
- Working in small and excellently skilled teams
- Opportunity for long-term professional growth within our development center
- Competitive compensation depending on experience and skills <...
Job details
Jobr Assistant extension
Get the extension →