Data Engineer - Apache Spark, Iceberg & Kafka

Job DescriptionThis is a 12 weeks duration engagement. overlap work with US time zone

\n

\nWe are looking for experienced Data Engineers with 5+ years of experience, to join a 12-week engagement focused on building and supporting modern data engineering solutions. The ideal candidates should have strong hands-on experience across a broad range of data engineering technologies and be able to contribute with minimal ramp-up time.

\n

\nKey Responsibilities

\n

\n Design, develop, and maintain scalable data engineering pipelines.\n Work with large-scale data processing and streaming technologies.\n Develop and optimize data pipelines using Apache Spark, Kafka, Airflow, and related technologies.\n Work with modern data lake and data warehouse technologies, including Apache Iceberg and Snowflake.\n Develop solutions using AWS cloud services.\n Write efficient and maintainable code using Java, Python, and SQL.\n Design and implement data models, including Star Schema designs.\n Troubleshoot, optimize, and improve data processing workflows and pipeline performance.\n Collaborate with technical teams to deliver data engineering solutions within defined timelines.\n\n

\nRequired Skills & Experience

\n

\n 5+ years of professional experience in Data Engineering \n Strong hands-on experience with Apache Spark \n Experience with Apache Iceberg \n Experience with Apache Kafka \n Experience with Apache Airflow \n Experience with Snowflake \n Strong experience with AWS \n Proficiency in Java, Python, and SQL \n Strong understanding of Data Modeling and Star Schema Design \n Experience with Apache Flink is preferred\n\n

\nCandidates with hands-on experience across the majority of the required technology stack are strongly preferred. Candidates should be able to contribute independently with limited onboarding or ramp-up time. There may be some flexibility around Apache Flink experience for candidates who demonstrate strong expertise across the other core technologies. Candidates with strong experience across modern data engineering, cloud, streaming, and data platform technologies are encouraged to apply. .