We are seeking a skilled Data Engineer to join our dynamic team in Tamil Nadu. The ideal candidate will have a strong background in data engineering, with expertise in cloud platforms such as AWS and GCP. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data analytics and business intelligence initiatives.
Key Responsibilities:
Develop and implement ETL and ELT processes to ensure efficient data flow and transformation.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
Utilize tools such as Apache Airflow for workflow management and orchestration of data pipelines.
Write efficient SQL queries for data extraction and manipulation.
Implement CI/CD practices to streamline the deployment of data solutions.
Monitor and optimize data pipelines for performance and reliability.
Stay updated with the latest trends and technologies in data engineering and cloud computing.
Required Skills:
Proficiency in Python for data processing and automation.
Strong experience with SQL for database management and querying.
Familiarity with cloud services, particularly AWS and GCP.
Knowledge of data pipeline orchestration tools, especially Apache Airflow.
Understanding of ETL and ELT methodologies.
Experience with CI/CD practices in data engineering.
If you are passionate about data and have a strong technical background, we encourage you to apply for this exciting opportunity to contribute to our data-driven initiatives.