Job Title:  Deputy Manager | AWS Data Engineering | Hyderabad | Engineering | Data Modernization & Migration

Desired Skill Set

  • 7+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
  • Must have Pyspark, Java coding/ Scala experience for REST API and SOAP webservices
  • Must have AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
  • Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
  • Good to have Snowflake experience in creating automation pipelines for data ingestion and transformation using Spark.
  • Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
  • Must have experience creating CI/CD pipelines – Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit Cloudformation