Job Title: Lead Senior Associate | Google Cloud Platform Data Engineering | Bengaluru | Engineering as a Servic
GCP Data Engineer
Must Have : GCP Bigquery, GCP Composure;CloudStorage, GCP DataProc; Airflow, SQL, Architecture, Python, PySpark, Spark, PubSub,
Good to have :Hive, HDFS, GCP other services,CloudRun, CloudFunctions, DataFlow, Other Cloud, NoSQL Dbs
Minimum Qualifications
• Bachelor's or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, with at least 3+ years working extensively on GCP.
• Strong proficiency with SQL, Python, and/or Java/Scala for data processing and scripting.
• Proven experience with GCP services such as:
• BigQuery
• Dataflow / Apache Beam
• Pub/Sub
• Cloud Storage
• Cloud Composer (Airflow)
• Cloud Functions
• Experience in building large-scale ETL/ELT pipelines and optimizing query performance on cloud platforms.
• Solid understanding of data modeling, partitioning, and schema design for analytical workloads.
• Familiarity with CI/CD practices, Terraform, and version control (e.g., Git).
Preferred Qualifications
• GCP Professional Data Engineer Certification or equivalent.
• Experience with Looker, dbt (data build tool), or similar data modeling tools.
• Prior work with streaming data architectures and technologies such as Kafka, Spark Streaming, or Flink.
• Experience in data privacy, GDPR/CCPA compliance, and implementing data security at rest and in transit.
• Exposure to DevOps and container orchestration tools (e.g., Kubernetes, Cloud Run).
• Strong analytical and problem-solving skills with attention to performance and scalability.
Soft Skills
• Excellent communication and stakeholder engagement skills.
• Proven ability to work independently and lead complex projects end-to-end.
• Collaborative mindset with a drive to mentor, document, and share knowledge.