Job Title: Lead Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
Job Summary:
You will work closely with the senior members of our team to monitor and drive improvements for reliability and observability of critical data pipelines and deliverables. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. The candidate will also be required to work on on-call shifts and on weekend shifts on rotation. We also support a healthy work-life-balance.
Responsibilities and Duties of the Role:
● You will assist with on-call rotations as an Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution.
● You will help drive our problem management process to ensure root cause of data incidents are analyzed and understood, and follow-up work is prioritized with our partner teams.
● You will play a key role in our long-term Incident and Problem Management strategy by contributing to the development of a Data Reliability Observability Platform that will assist in quantifying incident impacts, automate issue detection and track the overall health of our data and data pipelines.
● You will partner with our support and data quality teams, defining success KPI’s, ensuring observability and automation coverage of our pipelines and help create dashboards and visualizations for teams to monitor the overall health of our data
Required Education, Experience/Skills/Training:
● 3+ years of relevant data engineering experience.
● Good understanding of data modeling principles including Dimensional modeling, data normalization principles.
● Experience with process engineering and continuous improvement.
● Detailed problem-solving approach, coupled with a strong sense of drive and ownership.
● Strong communication skills – written and verbal presentations.
● Comfortable working in a fast-paced and highly collaborative environment.
● Familiarity with Agile Scrum principles and ceremonies
Preferred Qualifications:
●2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, exposure to reliability engineering best practices a plus.
●2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
●1+ years of experience programming languages (e.g. Python, Pyspark), preferred.
●Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.Required Education
●Bachelor’s degree in computer science, information systems, or related field or equivalent work experience.
Department-Specific Boiler Plates:
●Ad Platforms is responsible for Disney’s industry-leading ad technology and products – driving advertising performance, innovation, and value in Disney’s sports, news, and entertainment content, across all media platforms.
Business Operations
●The Business Operations team helps guide and articulate technology strategy and research, and is responsible for driving the day-to-day operation of the Product & Technology organization, including: project and portfolio management and tracking; organization-level capital, space, and resource management and allocation; process management; technical incident management; and our administrative and workplace experience support team.
Commerce, Data & Identity
●Commerce, Data & Identity provides the core product management functions for areas crucial to Disney’s media businesses. These include initiatives and products that power digital commerce, identity, and growth, as well as those that reach uniquely across The Walt Disney Company enterprise, such as messaging and privacy, among others. Additionally, it is responsible for the data engineering, science, and products for Disney Entertainment & ESPN, along with their interconnection with other parts of The Walt Disney Company.
Content Platforms & Operations
●Content Platforms & Operations is responsible for the development and ongoing advancement of the technical and operational functions driving the worldwide.
Design
●Design is centrally responsible for the design supporting all consumer-facing and business products and tooling for the Entertainment & ESPN portfolio, including sports, entertainment, enterprise, UX, creative services and design research.