Lead Data Engineer

Company ProfileXpressBees – a logistics company started in 2015 – is amongst the fastest growingcompanies of its sector. While we started off rather humbly in the space ofecommerce B2C logistics, the last 5 years have seen us steadily progress towardsexpanding our presence. Our vision to evolve into a strong full-service logisticsorganization reflects itself in our new lines of business like 3PL, B2B Xpress and crossborder operations. Our strong domain expertise and constant focus on meaningfulinnovation have helped us rapidly evolve as the most trusted logistics partner ofIndia. We have progressively carved our way towards best-in-class technologyplatforms, an extensive network reach, and a seamless last mile managementsystem. While on this aggressive growth path, we seek to become the one-stop-shopfor end-to-end logistics solutions. Our big focus areas for the very near futureinclude strengthening our presence as service providers of choice and leveraging thepower of technology to improve efficiencies for our clients.Job ProfileAs a Lead Data Engineer in the Data Platform Team at XpressBees, you will build the data platformand infrastructure to support high quality and agile decision-making in our supply chain and logisticsworkflows.You will define the way we collect and operationalize data (structured / unstructured), andbuild production pipelines for our machine learning models, and (RT, NRT, Batch) reporting &dashboarding requirements. As a Senior Data Engineer in the XB Data Platform Team, you will useyour experience with modern cloud and data frameworks to build products (with storage and servingsystems)that drive optimisation and resilience in the supply chain via data visibility, intelligent decision making,insights, anomaly detection and prediction.What You Will Do• Design and develop data platform and data pipelines for reporting, dashboarding andmachine learning models. These pipelines would productionize machine learning modelsand integrate with agent review tools.• Meet the data completeness, correction and freshness requirements.• Evaluate and identify the data store and data streaming technology choices.• Lead the design of the logical model and implement the physical model to supportbusiness needs. Come up with logical and physical database design across platforms (MPP,MR, Hive/PIG) which are optimal physical designs for different use cases (structured/semistructured). Envision & implement the optimal data modelling, physical design,performance optimization technique/approach required for the problem.• Support your colleagues by reviewing code and designs.• Diagnose and solve issues in our existing data pipelines and envision and build theirsuccessors.Qualifications & Experience relevant for the role• A bachelor's degree in Computer Science or related field with 6 to 9 years of technologyexperience.• Knowledge of Relational and NoSQL data stores, stream processing and micro-batching tomake technology & design choices.• Strong experience in System Integration, Application Development, ETL, Data-Platformprojects. Talented across technologies used in the enterprise space.• Software development experience using:• Expertise in relational and dimensional modelling• Exposure across all the SDLC process• Experience in cloud architecture (AWS)• Proven track record in keeping existing technical skills and developing new ones, so thatyou can make strong contributions to deep architecture discussions around systems andapplications in the cloud ( AWS).• Characteristics of a forward thinker and self-starter that flourishes with new challengesand adapts quickly to learning new knowledge• Ability to work with a cross functional teams of consulting professionals across multipleprojects.• Knack for helping an organization to understand application architectures and integrationapproaches, to architect advanced cloud-based solutions, and to help launch the build-outof those systems• Passion for educating, training, designing, and building end-to-end systems.