We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and architectures. As a Senior Data Engineer, you will be responsible for transforming raw data into actionable insights, ensuring data quality, and optimizing data flow for analytics and reporting.
Key Responsibilities:
Design and implement robust data pipelines using GCP technologies such as Dataflow, Dataproc, and BigQuery.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
Develop and maintain ETL processes using tools like Airflow and PySpark.
Write efficient SQL queries to extract and manipulate data from various sources.
Monitor and troubleshoot data pipeline performance, ensuring reliability and efficiency.
Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Required Skills:
Strong proficiency in GCP services, particularly Dataflow, Dataproc, and BigQuery.
Expertise in programming languages such as Python and SQL.
Experience with data processing frameworks like PySpark.
Familiarity with workflow orchestration tools like Airflow.
Excellent problem-solving skills and attention to detail.
Ability to work collaboratively in a fast-paced environment.
If you are passionate about data engineering and want to make a significant impact in our organization, we encourage you to apply for this exciting opportunity.