Data Engineer

Position Overview: We are seeking a talented Data Engineer with expertise in Power BI to join our team. The ideal candidate will be responsible for designing and implementing data pipelines, as well as developing insightful visualizations and reports using Power BI. Additionally, the candidate should have strong skills in Python, data analytics, PySpark, and Databricks. This role requires a blend of technical expertise, analytical thinking, and effective communication skills.Key Responsibilities:Design, develop, and maintain data pipelines and architectures using PySpark and Databricks.Implement ETL processes to extract, transform, and load data from various sources into data warehouses or data lakes.Collaborate with data analysts and business stakeholders to understand data requirements and translate them into actionable insights.Develop interactive dashboards, reports, and visualizations using Power BI to communicate key metrics and trends.Optimize and tune data pipelines for performance, scalability, and reliability.Monitor and troubleshoot data infrastructure to ensure data quality, integrity, and availability.Implement security measures and best practices to protect sensitive data.Stay updated with emerging technologies and best practices in data engineering and data visualization.Document processes, workflows, and configurations to maintain a comprehensive knowledge base.Requirements:Bachelor’s degree in Computer Science, Engineering, or related field. (Master’s degree preferred)Proven experience as a Data Engineer with expertise in Power BI, Python, PySpark, and Databricks.Strong proficiency in Power BI, including data modeling, DAX calculations, and creating interactive reports and dashboards.Solid understanding of data analytics concepts and techniques.Experience working with Big Data technologies such as Hadoop, Spark, or Kafka.Proficiency in programming languages such as Python and SQL.Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud.Excellent analytical and problem-solving skills with attention to detail.Strong communication and collaboration skills to work effectively with cross-functional teams.Ability to work independently and manage multiple tasks simultaneously in a fast-paced environment.Preferred Qualifications:Advanced degree in Computer Science, Engineering, or related field.Certifications in Power BI or related technologies.Experience with data visualization tools other than Power BI (e.g., Tableau, QlikView).Knowledge of machine learning concepts and frameworks.