Job Title:  Consultant | ELK | Bengaluru | Engineering

AM | EA&D-Engineering | ELK Stack

• Location:  Bengaluru
• Entity:  Deloitte Touche Tohmatsu India LLP

The team

Engineering helps Reimagine and re-engineer mission-critical operations and processes; Leverage engineering-led design, deep industry knowledge, and AI and data-driven insights to transform the technology platforms at the heart of business. Working alongside team, we empower and drive mission-critical solutions whether we need to modernize existing systems or implement new technology products and platforms. Through innovation, we improve financial performance, accelerate new digital businesses and fuel growth. Learn more about Engineering, AI and Data

Your work profile

As an ELK Stack Consultant with expertise in both administration and development, you will play a pivotal role in implementing, managing, and optimizing Elasticsearch-based solutions. Your role will encompass configuring and maintaining infrastructure, developing pipelines, creating insightful dashboards, and troubleshooting issues to ensure system efficiency and reliability.

5 to 8 years of experience working with ELK Stack or similar technologies, with a combination of hands-on administration and development expertise.

Key Responsibilities:

Technical Skills:

• ELK Stack Administration & Development:
• Deploy, configure, and maintain Elasticsearch, Logstash, Kibana, and Beats infrastructure to ensure system reliability and scalability. Monitor Elasticsearch cluster health, node performance, and usage metrics, optimizing for performance. Develop and maintain Logstash pipelines for efficient data ingestion and transformation from diverse sources. Create, manage, and optimize Kibana dashboards, including Spaces, Data Views, Canvas, alerting, and reporting, to deliver actionable business insights.
• Elasticsearch Expertise:
• Proficient in Query DSL, templates, data streams, Index Lifecycle Management (ILM), Cross-Cluster Replication (CCR), snapshots, and shard management.
• Pipelines & Ingestion:
• Hands-on experience with Logstash, Beats (Filebeat, Metricbeat, Auditbeat), Kafka/Redis/JDBC ingestion methods, and Elasticsearch ingest pipelines.
• System Maintenance & Security:
• Perform routine updates, upgrades, and backups for all ELK components. Implement robust security policies, including X-Pack features, LDAP/SAML authentication, TLS encryption, Role-Based Access Control (RBAC), audit logging, and compliance frameworks.
• Troubleshooting & Performance Optimization:
• Diagnose and resolve system issues such as performance bottlenecks and scalability challenges. Optimize resource utilization through JVM tuning, Linux internals, disk I/O, Host Bus Adapter (HBA)/storage management, network stack optimization, garbage collection (GC), and cluster state recovery.
• Infrastructure & DevOps:
• Experience with Kubernetes, Docker, Helm, Terraform, Ansible, Puppet, and CI/CD pipeline automation.
• Cloud & Hybrid Environments:
• Skilled in AWS OpenSearch/Elastic Cloud, Azure Elastic, GCP integrations, and cloud migration playbooks.
• Ecosystem Integration & Monitoring:
• Integrate databases, APIs, and custom applications with the ELK stack. Working knowledge of monitoring tools like Grafana, Prometheus, and Elastic-native solutions.
• Collaboration & Documentation:
• Work closely with stakeholders to gather requirements and develop tailored ELK-based solutions. Collaborate with development teams to integrate ELK with application pipelines and data workflows. Document system configurations, workflows, and troubleshooting procedures for effective knowledge sharing.

 Key skills required: 

• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities for cross-functional team interaction.
• Flexibility to meet critical deadlines as needed.

• Proficient in Elasticsearch Query DSL, Logstash pipeline development, and Kibana dashboarding.
• Strong scripting skills in Python, Shell, or similar languages.
• Familiarity with Linux/Unix system administration and basic networking protocols (e.g., HTTP, TCP).
• Knowledge of security best practices for ELK Stack.
• Experience with monitoring tools like Grafana, Prometheus, or ELK-native solutions.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Certification in ELK Stack or relevant technologies is highly desirable.