DataBricks Manager Hiring
KPMG India
Office
Bangalore, Karnataka, India
Full Time
- Bachelor's or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent (minimum 10+ years overall work experience).
- Expertise in designing and implementing high-performance data ingestion pipelines using Databricks and other relevant technologies.
- Proven track record of delivering and presenting proofs of concept for key technology components to project stakeholders.
- Development of scalable and reusable frameworks for ingesting, processing, and enriching datasets using Databricks.
- Integration of end-to-end data pipelines, ensuring data is efficiently transported from various source systems to target data stores.
- At least 7+ years of experience in developing data ingestion, data processing, and analytical pipelines using big data technologies, relational databases, and data warehouse solutions.
- Extensive hands-on experience implementing data ingestion and ETL processes on Databricks, leveraging technologies like Spark, Delta Lake, and MLflow.
- Expertise in Spark, SQL, Python, and Scala for data processing and analytics on Databricks.
- Strong knowledge of cloud migration strategies and tools, including Databricks-specific solutions.
- Familiarity with Big Data file formats and compression techniques.
- Proficiency in cloud architectures and understanding the pros and cons of different migration approaches.
- Proven ability to work independently under pressure while managing multiple priorities.
- Excellent communication skills, both written and verbal, with the ability to collaborate in a team environment.
- Experience working with engineering teams to define best practices in data engineering, including agile methodologies, coding standards, and CI/CD processes.
A Databricks Data Engineer is responsible for designing, building, and maintaining data solutions that leverage Databricks' powerful capabilities on the cloud platform. Key responsibilities include:
- Designing and deploying data pipelines that efficiently process vast amounts of data using Databricks, optimizing for performance and scalability.
- Collaborating with data scientists and business stakeholders to understand requirements and provide data solutions tailored to those needs.
- Implementing robust data models and architectures utilizing Databricks, ensuring data quality and integrity.
- Monitoring and troubleshooting data pipelines, proactively identifying and resolving issues to ensure smooth data flows.
- Ensuring data security, governance, and privacy measures are in place, adhering to industry best practices.
- Optimizing data storage and processing costs while maintaining high performance.
- Engaging in continuous improvement activities, researching new technologies and methodologies to enhance data solutions.
DataBricks Manager Hiring
Office
Bangalore, Karnataka, India
Full Time
August 20, 2025