W

Data Engineer Databricks/Snowflake

Wissen Technology Verified employer

Actively hiring · Posted 1mo ago · JEV2610106366151D

Salary₹15,00,000 – ₹40,00,000 per year
Experience7–10 yrs
LocationBengaluru (Bangalore)
Work modeOffice · Full time
Openings1

Job description

About the RoleWe are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.Key ResponsibilitiesDesign and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.Required SkillsStrong expertise in Python for developing scalable, modular, and production-ready data engineering applications.Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.Nice to HaveHands-on exposure to Microsoft Fabric for data integration and analytics.Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).Domain expertise in financial services.

Key skills

How to apply

  1. Sign in or create your free profile — takes about two minutes.
  2. Apply with one tap — your profile is shared directly with Wissen Technology.
  3. Track your application and get updates by email and WhatsApp.
Apply now
You may also like

Similar jobs

More jobs
Salary not disclosed 0–6 yrs Jabalpur, Madhya Pradesh Remote · Full time
cold callingpresentationssales strategiescommunication skills
Today · JEV261140ABE411C8View & apply
Data Engineer Databricks/Snowflake₹15,00,000 – ₹40,00,000 /year · Bengaluru (Bangalore)
Apply