SR AWS DATA ENGINEER

Skills / ToolsSQL & Python / PySparkAWS Services: Glue, Appflow, Redshift - MandatoryData warehousing basicsData modelling basicsJob DescriptionExperience of implementing and delivering data solutions and pipelines on AWS Cloud Platform. Design/ implement, and maintain the data architecture for all AWS data servicesA strong understanding of data modelling, data structures, databases (Redshift), and ETL processesWork with stakeholders to identify business needs and requirements for data-related projectStrong SQL and/or Python or PySpark knowledgeCreating data models that can be used to extract information from various sources & store it in a usable formatOptimize data models for performance and efficiencyWrite SQL queries to support data analysis and reportingMonitor and troubleshoot data pipelinesCollaborate with software engineers to design and implement data-driven features Perform root cause analysis on data issues Maintain documentation of the data architecture and ETL processes Identifying opportunities to improve performance by improving database structure or indexing methods Maintaining existing applications by updating existing code or adding new features to meet new requirements Designing and implementing security measures to protect data from unauthorized access or misuse Recommending infrastructure changes to improve capacity or performance Experience in Process industry