Data Architect Databricks / Apache Spark / Cloud

About the Role

We are looking for an experienced Data Architect with strong expertise in Databricks, Apache Spark, Cloud Data Engineering and enterprise data pipelines. The role will involve designing scalable data architectures and providing technical direction for cloud-based data engineering initiatives.

Key Responsibilities

Design and develop scalable and reliable data architectures.

Define architecture patterns for enterprise data platforms.

Design and implement data engineering solutions using Databricks and Apache Spark.

Develop scalable ETL/ELT frameworks and data pipelines.

Work with cloud data engineering platforms across AWS, Azure and/or GCP.

Define data ingestion, processing and transformation architectures.

Evaluate technical requirements and translate them into scalable data solutions.

Design data models and data processing frameworks.

Ensure solutions meet scalability, performance and reliability requirements.

Drive data platform modernization and cloud transformation initiatives.

Establish architecture standards, design principles and reusable patterns.

Identify performance bottlenecks and recommend appropriate solutions.

Collaborate with data engineers, developers, business stakeholders and other architects.

Provide technical guidance and mentoring to engineering teams.

Participate in architecture reviews, technical discussions and solution design.

Ensure proper technical documentation for architecture and implementation.

Required Technical Skills

Databricks

Apache Spark

Cloud Data Engineering

AWS / Azure / GCP

ETL / ELT

Data Pipeline Development

Data Architecture

Data Engineering

Data Modeling

Candidate Profile

915 years of experience in Data Engineering / Data Architecture.

Strong hands-on experience with Databricks and Apache Spark.

Strong understanding of cloud-based data engineering.

Experience designing enterprise-scale data pipelines.

Strong understanding of ETL/ELT and data architecture principles.

Excellent problem-solving and technical communication skills.

Experience providing technical leadership to data engineering teams.

Education

B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Engineering or related discipline preferred. .