Job Title:  T&T | Engineering| Databricks + Pyspark

The Team 

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.

Mandatory Skills: Databricks, Spark, Python / SQL 

Your Work Profile 

· Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.

· Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.

· Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.

· Develop data models and schemas to support reporting and analytics needs.

· Ensure data quality, integrity, and security by implementing appropriate checks and controls.

· Monitor and optimize data processing performance, identifying, and resolving bottlenecks.

· Stay up to date with the latest advancements in data engineering and Databricks technologies.

Preferred Qualification

· Bachelor’s or master’s degree in any field

· Your experience in designing, implementing, and maintaining data solutions on Databricks

· Experience with at least one of the popular cloud platforms – Azure, AWS or GCP

· Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes

· Knowledge of data warehousing and data modelling concepts

· Experience with Python or SQL

· Experience with Delta Lake

· Understanding of DevOps principles and practices

· Excellent problem-solving and troubleshooting skills

· Strong communication and teamwork skills

Location and Way of Working 

• Base location: Bangalore (Work From Office)

Your role as Senior Consultant

At Deloitte India, we believe in the importance of leadership at all levels. We expect our people to embrace and live our purpose by challenging themselves to identify issues that are most important for our clients, our people, and for society and make an impact that matters. In addition to living our purpose, Consultant across our organization: Develop high-performing people and teams through challenging and meaningful opportunities
Deliver exceptional client service; maximize results and drive high performance from people while fostering collaboration across businesses and borders Influence clients, teams, and individuals positively, leading by example and establishing confident relationships with increasingly senior people Understand key objectives for clients and Deloitte; align people to objectives and set priorities and direction. Acts as a role model, embracing and living our purpose and values, and recognizing others for the impact they make