Elasticsearch Observability Architect

Role Overview:

We are seeking an experienced Observability Architect with deep expertise in the ELK Stack (Elasticsearch, Logstash, Kibana) to design, implement, and manage enterprise-wide logging, monitoring, and observability solutions. This role involves collaborating with cross-functional teams to deliver actionable insights and ensure the robust performance and security of the ELK environment.

Key Responsibilities:
Architect, configure, and manage the ELK Stack to support logging, monitoring, and observability needs across the enterprise.
Collaborate with cross-functional teams to understand business requirements and design dashboards, alerts, and reports for various stakeholders.
Optimize and troubleshoot ELK performance, including tuning Elasticsearch for efficient storage and retrieval of large datasets.
Develop and implement data pipelines with Logstash and other ingestion tools, ensuring reliable data flow from diverse data sources.
Enable advanced analytics and data visualizations in Kibana to provide actionable insights for IT operations.
Implement security, access controls, and best practices within the ELK environment.
Train and mentor team members on ELK best practices and provide technical support as needed.
Required Skills:

Expert-level proficiency in Elasticsearch.
Experience with Distributed Architecture Cluster Design.
Proficiency in Search Index Optimization (Query DSL, Aggregations).
Expertise in Performance Tuning and Scaling.
Knowledge of ILM (Index Lifecycle Management), Data Streams, and Sharding Strategy.
Experience with HADR (High Availability Disaster Recovery) and Multi-region architecture.
Familiarity with CICD and Infrastructure as Code (Terraform, Ansible).
Strong understanding of Security (RBAC, TLS, authentication).
Proficiency in scripting or programming (Python, Java).
Qualifications:

10+ years of relevant experience.
Preferred Skills:

Prior experience in AIOps, ITOM, or other observability solutions.
Familiarity with scripting and automation (e.g., Python, Bash).
Knowledge of infrastructure-as-code tools like Terraform or Ansible.