Big Data Developer

Job Title Big Data DeveloperJob DescriptionBachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.Solid Experience of software development experience and leading teams of engineers and scrum teams.4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark).Solid Datawarehousing concepts.Knowledge of Financial reporting ecosystem will be a plus.4+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be an addon.Expert on Distributed ecosystem.Hands-on experience with programming using Core Java or Python/ScalaExpert on Hadoop and Spark Architecture and its working principleHands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data.Experience in UNIX shell scripting.Roles & ResponsibilitiesAbility to design and develop optimized Data pipelines for batch and real time data processingShould have experience in analysis, design, development, testing, and implementation of system applicationsDemonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.Excellent technical and analytical aptitudeGood communication skills.Excellent Project management skills.Results driven Approach.Mandatory SkillsBig Data, PySpark, Hive