Senior Data Engineering Role - Google Cloud Platform with Spark
Zeal Consultants Verified employer
Actively hiring · Posted 2d ago · JEV2611F12D391296
Job description
Data Engineering : Senior Engineer / ManagerAs Senior Engineer/ Manager in Data Engineering, you will translate client requirements into technical design, and implement components for a data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution.Must Have skills :1. GCP2. Spark streaming : Live data streaming experience is desired.3. Any 1 coding language: Java/Pyhton /ScalaSkills & Experience :- Overall experience of MINIMUM 5+ years with Minimum 4 years of relevant experience in Big Data technologies- Hands-on experience with the Hadoop stack - HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end to end data pipeline. Working knowledge on real-time data pipelines is added advantage.- Strong experience in at least of the programming language Java, Scala, Python. Java preferable- Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDb, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery etc.- Well-versed and working knowledge with data platform related services on GCP- Bachelor's degree and year of work experience of 6 to 12 years or any combination of education, training and/or experience that demonstrates the ability to perform the duties of the positionYour Impact :- Data Ingestion, Integration and Transformation- Data Storage and Computation Frameworks, Performance Optimizations- Analytics & Visualizations- Infrastructure & Cloud Computing- Data Management Platforms- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time- Build functionality for data analytics, search and aggregation
Key skills
How to apply
- Sign in or create your free profile — takes about two minutes.
- Apply with one tap — your profile is shared directly with Zeal Consultants.
- Track your application and get updates by email and WhatsApp.