Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have extensive experience in big data technologies and a strong background in data engineering. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven initiatives. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and actionable.

Key Responsibilities:

• Design and implement scalable data processing systems using Hadoop, Spark, and Kafka.
• Develop and maintain ETL processes to extract, transform, and load data from various sources.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Optimize data storage and retrieval processes to improve performance and efficiency.
• Monitor and troubleshoot data pipeline issues to ensure data quality and reliability.
• Stay updated with the latest industry trends and technologies in data engineering and big data.

Required Skills:

• Proficiency in Hadoop ecosystem components such as HDFS, MapReduce, and Hive.
• Strong experience with Apache Spark for data processing and analytics.
• Knowledge of Kafka for real-time data streaming and processing.
• Familiarity with Apache NiFi for data flow automation.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.
• Strong communication skills to collaborate effectively with team members and stakeholders.

If you are passionate about data engineering and have a proven track record of delivering high-quality data solutions, we would love to hear from you. Join us in our mission to leverage data for better decision-making and drive business success.