Lead AWS Data Engineer

Job Description – Lead Data Engineer (AWS + Big Data)Location: Pune - HybridExperience: 8+ YearsRole OverviewWe are looking for a Lead Data Engineer with strong hands-on expertise in AWS-based Big Data platforms. The ideal candidate should have extensive implementation experience in designing and building scalable data pipelines, mentoring engineering teams, and driving technical delivery. Databricks exposure is mandatory, while deep implementation experience in Databricks is not essential. Candidates with HBase experience will be preferred.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT solutions on AWS.Build and optimize Big Data applications using Spark/PySpark, HBase, Hive, Kafka, and related technologies.Work with AWS services such as S3, Glue, Lambda, IAM, and CloudWatch for cloud-native data engineering.Lead technical implementation, mentor engineers, conduct code reviews, and drive engineering best practices.Ensure data quality, performance optimization, CI/CD adoption, and production support.Required SkillsStrong hands-on experience with AWS (S3, Glue, Lambda, IAM, CloudWatch)Apache Spark (PySpark/Scala) and Big Data ecosystemDatabricks exposure (mandatory)HBase (strongly preferred)Python or Java, Advanced SQLETL/ELT development and Data Warehousing conceptsApache Airflow or similar orchestration toolsGit, CI/CD, Performance Tuning, and Data QualityGood to HaveKafka / Spark Structured StreamingHive, Impala, Hadoop ecosystemDelta Lake / Lakehouse conceptsSnowflake or other modern cloud data platformsExperience Required8–14 years of Data Engineering experience with strong AWS implementation expertise.Proven experience leading technical delivery and mentoring engineering teams.Strong understanding of enterprise-scale data platforms and Big Data architectures.Ability to collaborate with architects, stakeholders, and cross-functional teams to deliver scalable solutions.NOTE: Final Technical round is mandatory to be taken F2F from Pune, office.