Data Engineer

🛠️ Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using Python and Apache Spark (PySpark or Scala APIs)Develop and optimize ETL processes for batch and real-time data ingestionCollaborate with data scientists, analysts, and DevOps teams to support data-driven solutionsEnsure data quality, integrity, and governance across all stages of the data lifecycleImplement data validation, monitoring, and alerting mechanisms for production pipelinesWork with cloud platforms (AWS, GCP, or Azure) and tools like Airflow, Kafka, and Delta LakeParticipate in code reviews, performance tuning, and documentation🎓 QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or related field3–6 years of experience in data engineering with a focus on Python and SparkExperience with distributed computing and handling large-scale datasets (10TB+)Familiarity with data security, PII handling, and compliance standards is a plus