Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data architecture and a passion for building robust data pipelines. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions that support our analytics and business intelligence initiatives. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and optimized for performance.

Key Responsibilities:

• Design and develop data pipelines using tools such as Azure Data Factory, Databricks, and PySpark.
• Implement data storage solutions using Delta Lake and manage data governance with Unity Catalog.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Optimize data workflows for performance and scalability.
• Monitor and troubleshoot data pipeline issues to ensure data integrity and availability.
• Stay updated with the latest trends and technologies in data engineering and architecture.

Required Skills:

• Proficiency in Python and experience with data processing frameworks like PySpark.
• Hands-on experience with Azure Data Factory and Databricks.
• Knowledge of data storage solutions, particularly Delta Lake.
• Familiarity with data governance practices and tools, including Unity Catalog.
• Strong understanding of data architecture principles and best practices.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

If you are passionate about data and eager to make an impact, we encourage you to apply for this exciting opportunity.