company logo

DataBricks Manager Hiring

KPMG India

Office

Bangalore, Karnataka, India

Full Time

  • Bachelor's or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent (minimum 10+ years overall work experience).
  • Expertise in designing and implementing high-performance data ingestion pipelines using Databricks and other relevant technologies.
  • Proven track record of delivering and presenting proofs of concept for key technology components to project stakeholders.
  • Development of scalable and reusable frameworks for ingesting, processing, and enriching datasets using Databricks.
  • Integration of end-to-end data pipelines, ensuring data is efficiently transported from various source systems to target data stores.
  • At least 7+ years of experience in developing data ingestion, data processing, and analytical pipelines using big data technologies, relational databases, and data warehouse solutions.
  • Extensive hands-on experience implementing data ingestion and ETL processes on Databricks, leveraging technologies like Spark, Delta Lake, and MLflow.
  • Expertise in Spark, SQL, Python, and Scala for data processing and analytics on Databricks.
  • Strong knowledge of cloud migration strategies and tools, including Databricks-specific solutions.
  • Familiarity with Big Data file formats and compression techniques.
  • Proficiency in cloud architectures and understanding the pros and cons of different migration approaches.
  • Proven ability to work independently under pressure while managing multiple priorities.
  • Excellent communication skills, both written and verbal, with the ability to collaborate in a team environment.
  • Experience working with engineering teams to define best practices in data engineering, including agile methodologies, coding standards, and CI/CD processes.

A Databricks Data Engineer is responsible for designing, building, and maintaining data solutions that leverage Databricks' powerful capabilities on the cloud platform. Key responsibilities include:

 

  • Designing and deploying data pipelines that efficiently process vast amounts of data using Databricks, optimizing for performance and scalability.
  • Collaborating with data scientists and business stakeholders to understand requirements and provide data solutions tailored to those needs.
  • Implementing robust data models and architectures utilizing Databricks, ensuring data quality and integrity.
  • Monitoring and troubleshooting data pipelines, proactively identifying and resolving issues to ensure smooth data flows.
  • Ensuring data security, governance, and privacy measures are in place, adhering to industry best practices.
  • Optimizing data storage and processing costs while maintaining high performance.
  • Engaging in continuous improvement activities, researching new technologies and methodologies to enhance data solutions.

DataBricks Manager Hiring

Office

Bangalore, Karnataka, India

Full Time

August 20, 2025

company logo

KPMG India