Job Title:  Manager | Azure Data Engineer | Bengaluru | Engineering

Job Title: Data Engineer And Data Analyst Experience Level: 3-5 Years Location: Hybrid Mode [3-4 days in office and 1-2 days of remote work] Job Description: We are seeking a highly skilled and motivated Data Engineer with 3-5 years of professional experience to join our dynamic analytics team. The ideal candidate will have expertise in big data ETL, data warehousing, and streaming data analytics, with hands-on experience in SQL, Apache Spark, Python, and Databricks on the Azure platform. This role requires a detail-oriented professional who can design, develop, and optimize scalable data pipelines and deliver actionable insights through advanced reporting tools like Power BI. Key Responsibilities: • ETL Development & Optimization: o Design, build, and maintain robust ETL pipelines to ingest, transform, and load large-scale datasets. o Optimize existing ETL processes to improve performance, efficiency, and reliability. • Big Data Processing: o Leverage Apache Spark and Databricks for both batch and streaming data processing to deliver real-time insights. o Develop and maintain data models that ensure data integrity and support analytical needs. • Data Warehousing & Modelling: o Architect and implement data warehousing solutions, ensuring scalable storage and efficient retrieval. o Apply best practices in data modelling to design structured, scalable, and well-organized datasets. • SQL & Analytics: o Write complex SQL queries for data extraction, transformation, and reporting. o Collaborate with cross-functional teams to ensure data quality and consistency across multiple data sources. • Cloud & Streaming Analytics: o Utilize Azure cloud services (e.g., Azure Data Lake, Azure SQL, Databricks) to manage and process data. o Implement streaming data analytics solutions to support real-time business decision making. • Python Development: o Develop, test, and deploy Python scripts and applications for data processing, automation, and analytics. o Utilize Python libraries (such as Pandas, PySpark, and others) to perform data manipulation and analysis. • Reporting & Visualization: o Develop interactive dashboards and reports using Power BI to communicate insights and drive business strategy. o Translate complex data findings into clear, actionable recommendations for stakeholders. • Collaboration & Continuous Improvement: o Work closely with data scientists, analysts, and business users to understand requirements and deliver effective solutions. o Participate in code reviews, troubleshooting, and continuous improvement initiatives. o Document processes and best practices to enhance team knowledge and performance. Required Skills & Qualifications: • 3-5 years of experience in data engineering, big data ETL, or a similar role. • Strong proficiency in SQL and experience with both relational and NoSQL databases. • Extensive hands-on experience with Apache Spark and Databricks for data processing. • Proven expertise in developing and optimizing ETL pipelines using Python. • Solid understanding of data warehousing principles and data modelling techniques. • Experience with streaming data analytics to support real-time processing. • Familiarity with Azure cloud services in a production environment. • Demonstrated ability to create interactive Power BI dashboards and reports. • Excellent problem-solving skills, attention to detail, and a collaborative mindset. • Strong communication skills and the ability to translate complex technical concepts to non-technical stakeholders. Preferred Qualifications: • Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Science, or a related field. • Experience with additional big data technologies (e.g., Hadoop, Kafka) and modern data orchestration tools. • Familiarity with CI/CD, agile methodologies, and cloud-based DevOps practices. • Professional certifications in Azure, Databricks, or data engineering are a plus. Why Join Us: • Work on cutting-edge projects leveraging the latest big data and cloud technologies. • Collaborate in a dynamic, innovative environment with opportunities for professional growth. • Influence data-driven decision making at a strategic level. • Enjoy a competitive compensation package and comprehensive benefits. If you are a proactive, skilled data professional eager to drive impactful data initiatives using Python, Apache Spark, and Databricks on Azure, we encourage you to apply and be a key member of our transformative team