Associate - Project

Job Summary

Required Skills & Experience

3 6 Years of experience in ETL Data Testing.

Strong hands on experience with Databricks and Apache Spark PySpark .

Proficiency in Python for scripting and automation.

Experience with Kafka similar frameworks for test automation.

Solid understanding of Delta Lake SQL Mongo and data warehousing concepts.

Experience working in Agile Scrum environments.

Strong analytical and problem solving skills.

Key Responsibilities

Manual Testing

Understand business

Understand business requirements and data flow across ETL pipelines in Databricks.

Perform manual testing of ETL jobs data ingestion transformation and validation.

Write and execute test cases to validate data accuracy completeness and integrity.

Perform root cause analysis for data discrepancies and report defects.

Validate data across multiple sources including Delta Lake Mongo Kafka and external systems.

Automation Testing

Design and implement automated test scripts using Cucumber with Python.

Develop reusable test components for validating Databricks notebooks and workflows.

Integrate automated tests into CI CD pipelines for continuous validation.

Maintain and enhance the automation framework to support evolving data pipelines.

Generate test reports and dashboards for stakeholders. .