L

Lead Data Engineer

Lymbyc Verified employer

Actively hiring · Posted 5d ago · JEV26112A882A7BC1

Salary₹9,00,000 – ₹14,00,000 per year
Experience4–8 yrs
LocationBengaluru (Bangalore)
Work modeOffice · Full time
Openings1

Job description

Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures

Responsibilities :

  • Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics
  • Design and implement data aggregation, cleansing and transformation layers

Skills :

  • Around 4+ years of hands-on experience designing and operating large data platforms
  • Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc;
  • Experience in designing and building streaming data platforms in Lambda, Kappa architectures
  • Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc;
  • Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse
  • Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto
  • Experience in designing and consuming microservices
  • Exposure to security and governance tools like Apache Ranger, Apache Atlas
  • Any contributions to open source projects a plus
  • Experience in performance benchmarks will be a plus

Key skills

How to apply

  1. Sign in or create your free profile — takes about two minutes.
  2. Apply with one tap — your profile is shared directly with Lymbyc.
  3. Track your application and get updates by email and WhatsApp.
Apply now
You may also like

Similar jobs

More jobs
₹2,00,000 – ₹4,00,000 /year 0–2 yrs Gurugram, Haryana Remote · Full time
Model-View-View-Model (MVVM)KotlinCore DataAndroid Development
Today · JEV2611C938E53C87View & apply
Lead Data Engineer₹9,00,000 – ₹14,00,000 /year · Bengaluru (Bangalore)
Apply