Job Description – AWS DevOps Engineer

Position Summary

We are seeking an experienced AWS DevOps Engineer to support the development, automation, and maintenance of cloud-based data platforms. The ideal candidate will have strong expertise in AWS, Infrastructure as Code, CI/CD pipelines, data lake technologies, and Agile delivery practices. This role requires close collaboration with Data Engineers, Architects, Product Owners, and business stakeholders to deliver scalable and reliable data solutions.

Key Responsibilities

• Design, develop, and manage AWS infrastructure using Terraform and Infrastructure as Code (IaC) principles.
• Build and maintain CI/CD pipelines using GitHub Actions to automate deployment and release processes.
• Manage source code repositories, branching strategies, pull requests, and code reviews using Git and GitHub.
• Develop and support data processing solutions using Python, PySpark, SQL, Apache Hudi, and Apache Iceberg.
• Optimize and maintain cloud-based data lake and lakehouse platforms on AWS.
• Create, publish, and maintain data products within the Collibra Data Marketplace.
• Participate in Agile/SAFe ceremonies including sprint planning, PI planning, stand-ups, and retrospectives.
• Track work items in Jira and maintain technical documentation in Confluence.
• Ensure platform reliability, security, scalability, and operational excellence.

Required Skills & Experience

Technical Skills

• Strong hands-on experience with AWS cloud services.
• Proficiency in Terraform for Infrastructure as Code (IaC).
• Experience with Git and GitHub, including branch management and pull request workflows.
• Strong experience with GitHub Actions and CI/CD pipeline development.
• Proficiency in Python development, including PySpark-based data processing.
• Strong SQL skills, preferably with Amazon Athena.
• Experience with Apache Hudi and Apache Iceberg.
• Understanding of Data Lake and Lakehouse architectures.
• Experience working with Collibra Data Marketplace and data product management.

Agile & Collaboration

• Experience working within a SAFe Agile framework.
• Hands-on experience with Jira and Confluence.
• Strong communication and stakeholder management skills.

Preferred Qualifications

• AWS Certifications (AWS DevOps Engineer, Solutions Architect, or equivalent).
• Experience in enterprise-scale cloud data platforms.
• Knowledge of data governance and metadata management practices.
• Experience with Data Mesh and Data Product concepts.

Education

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

Experience Required

• 5–8 years of overall IT experience.
• Minimum 3+ years of hands-on experience in AWS DevOps and cloud infrastructure automation.
• Experience supporting modern data platforms and cloud-native solutions.