Big Data Engineer

We are seeking a skilled Big Data Engineer to join our dynamic team in Karnataka or Tamil Nadu. The ideal candidate will have a strong background in big data technologies and a passion for data engineering. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures that support our data analytics initiatives.

Key Responsibilities:

• Design and implement robust data processing systems using technologies such as Hadoop, Spark, and PySpark.
• Develop and optimize SQL queries for data extraction and transformation.
• Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
• Ensure data quality and integrity through rigorous testing and validation processes.
• Monitor and troubleshoot data pipeline performance, making necessary adjustments to improve efficiency.
• Stay updated with the latest trends and technologies in big data and data engineering.

Required Skills:

• Proficiency in Python and experience with PySpark and Spark frameworks.
• Strong knowledge of SQL and experience with data warehousing solutions.
• Familiarity with Hadoop ecosystem components such as Hive.
• Experience in building and maintaining big data solutions.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

If you are passionate about big data and eager to work on challenging projects, we encourage you to apply for this exciting opportunity. Join us in leveraging data to drive business insights and innovation.