Job Title: Senior Consultant | AWS Data engineer | Hyderabad | Engineering
Education
Bachelor’s degree in relevant field (e.g. Engineering, Analytics or Data Science, Computer Science, Statistics) or equivalent experience.
Experience
- At least 6 years of experience with big data technologies like Azure Data Lake, Synapse, PySpark, Azure Data Factory (ADF), AWS Redshift , S3, SQL Server ,MLOps or their equivalent.
- Experience in implementing complex ETL pipelines day-to-day operations.
- Experience on knowledge graphs is a plus.
- 3+ years of experience in Agile Development and code deployment and CI-CD pipelines.
- 2+ years of experience in job orchestration using Airflow or equivalent.
- 2+ years in AI/ML, specially Gen AI concepts on Rag patterns, chunking techniques.
- Exposure on knowledge graphs is a plus.
- Build, Design and Deliver enterprise data programs.
- Proficiency in implementing data quality rules.
- Proficiency in analytical tools like Tableau, Power BI or equivalent.
- Experience with security models and development on large data sets.
- Experience in data quality management tools.
- Work closely with different stakeholders: Business owners, users, product managers, program managers, architects, engineering managers & developers, etc. to translate business needs and product requirements to well-documented engineering solutions.
- Ensuring data quality and consistency: Ensure data quality and consistency across various sources.
- Strong working knowledge on Python.
- Designing and contributing to best practices: Design and contribute to best practices in Enterprise Data Warehouse (EDW) architecture.
Additional Desired Preferences
• Experience with scientific chemistry nomenclature or prior work experience in life sciences, chemistry, or hard sciences or degree in sciences
• Experience with pharmaceutical datasets and nomenclature
• Experience working with knowledge graphs
• Ability to explain complex technical issues to a non-technical audience
• Self-directed and able to handle multiple concurrent projects and prioritize tasks independently
• Able to make tough decisions when trade-offs are required to deliver results
• Strong communication skills required: Verbal, written, and interpersonal