GCP Data Engineer

Generic Skills (Must Have) :

Python and advanced SQL.

Data quality checks, reconciliation, alerting, retries, and backfills.

Production pipeline monitoring and troubleshooting.

GCP Skills (Must Have) :

Mandatory: BigQuery: datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.

Option 1: Dataflow / Apache Beam or equivalent streaming/batch framework.

Option 2: Dataproc / PySpark or strong Spark experience.

Pub/Sub or equivalent event streaming.

Cloud Composer / Airflow DAG development.

Nice to have (Trainable) :

Dataform, dbt, CI/CD for data.

BigQuery ML.

Dataflow templates.

Looker / LookML basics.

Terraform for data infrastructure.