Job Title: Senior Consultant | ETL | Bengaluru | Engineering
India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.
At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters.
The Team
Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
As an ELK Stack Consultant with expertise in both administration and development, you will play a pivotal role in implementing, managing, and optimizing Elasticsearch-based solutions. Your role will encompass configuring and maintaining infrastructure, developing pipelines, creating insightful dashboards, and troubleshooting issues to ensure system efficiency and reliability.
.
- ELK Stack Administration & Development:
- Deploy, configure, and maintain Elasticsearch, Logstash, Kibana, and Beats infrastructure to ensure system reliability and scalability. Monitor Elasticsearch cluster health, node performance, and usage metrics, optimizing for performance. Develop and maintain Logstash pipelines for efficient data ingestion and transformation from diverse sources. Create, manage, and optimize Kibana dashboards, including Spaces, Data Views, Canvas, alerting, and reporting, to deliver actionable business insights.
- Elasticsearch Expertise:
- Proficient in Query DSL, templates, data streams, Index Lifecycle Management (ILM), Cross-Cluster Replication (CCR), snapshots, and shard management.
- Pipelines & Ingestion:
- Hands-on experience with Logstash, Beats (Filebeat, Metricbeat, Auditbeat), Kafka/Redis/JDBC ingestion methods, and Elasticsearch ingest pipelines.
- System Maintenance & Security:
- Perform routine updates, upgrades, and backups for all ELK components. Implement robust security policies, including X-Pack features, LDAP/SAML authentication, TLS encryption, Role-Based Access Control (RBAC), audit logging, and compliance frameworks.
- Troubleshooting & Performance Optimization:
- Diagnose and resolve system issues such as performance bottlenecks and scalability challenges. Optimize resource utilization through JVM tuning, Linux internals, disk I/O, Host Bus Adapter (HBA)/storage management, network stack optimization, garbage collection (GC), and cluster state recovery.
- Infrastructure & DevOps:
- Experience with Kubernetes, Docker, Helm, Terraform, Ansible, Puppet, and CI/CD pipeline automation.
- Cloud & Hybrid Environments:
- Skilled in AWS OpenSearch/Elastic Cloud, Azure Elastic, GCP integrations, and cloud migration playbooks.
- Ecosystem Integration & Monitoring:
- Integrate databases, APIs, and custom applications with the ELK stack. Working knowledge of monitoring tools like Grafana, Prometheus, and Elastic-native solutions.
- Collaboration & Documentation:
- Work closely with stakeholders to gather requirements and develop tailored ELK-based solutions. Collaborate with development teams to integrate ELK with application pipelines and data workflows. Document system configurations, workflows, and troubleshooting procedures for effective knowledge sharing.
Soft Skills:
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities for cross-functional team interaction.
- Flexibility to meet critical deadlines as needed.
Experience
5 to 8 years of experience working with ELK Stack or similar technologies, with a combination of hands-on administration and development expertise.
Qualifications
- Proficient in Elasticsearch Query DSL, Logstash pipeline development, and Kibana dashboarding.
- Strong scripting skills in Python, Shell, or similar languages.
- Familiarity with Linux/Unix system administration and basic networking protocols (e.g., HTTP, TCP).
- Knowledge of security best practices for ELK Stack.
- Experience with monitoring tools like Grafana, Prometheus, or ELK-native solutions.
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Certification in ELK Stack or relevant technologies is highly desirable.
Location and way of working:
- Location: Bengaluru, Chennai, Coimbatore, Delhi, Hyderabad, Kolkata, Mumbai, Pune, Kochi, Chennai ODC, Delhi CEC, Bhubaneswar CEC, Noida, Lucknow
- This profile involves occasional travelling to client locations.
- Hybrid is our default way of working. Each domain has customized the hybrid approach to their unique needs.
How you’ll grow
Connect for impact
Our exceptional team of professionals across the globe are solving some of the world’s most complex business problems, as well as directly supporting our communities, the planet, and each other. Know more in our Global Impact Report and our India Impact Report.
Empower to lead
You can be a leader irrespective of your career level. Our colleagues are characterised by their ability to inspire, support, and provide opportunities for people to deliver their best and grow both as professionals and human beings. Know more about Deloitte and our One Young World partnership.
Inclusion for all
At Deloitte, people are valued and respected for who they are and are trusted to add value to their clients, teams and communities in a way that reflects their own unique capabilities. Know more about everyday steps that you can take to be more inclusive. At Deloitte, we believe in the unique skills, attitude and potential each and every one of us brings to the table to make an impact that matters.
Drive your career
At Deloitte, you are encouraged to take ownership of your career. We recognise there is no one size fits all career path, and global, cross-business mobility and up / re-skilling are all within the range of possibilities to shape a unique and fulfilling career. Know more about Life at Deloitte.
Everyone’s welcome… entrust your happiness to us
Our workspaces and initiatives are geared towards your 360-degree happiness. This includes specific needs you may have in terms of accessibility, flexibility, safety and security, and caregiving. Here’s a glimpse of things that are in store for you.
Interview tips
We want job seekers exploring opportunities at Deloitte to feel prepared, confident and comfortable. To help you with your interview, we suggest that you do your research, know some background about the organisation and the business area you’re applying to. Check out recruiting tips from Deloitte professionals.