Intel DS Next Data ingestion - AWS ETL Developer - S N

Required Skills:

ETL Development

AWS Data Services

PySpark

Python

SQL & Cloud DWH

Terraform

AWS Networking & IAM

CI/CD & Version Control

Nice to Have:

Data Lake & Governance

CloudWatch

RESPONSIBILITIES: This is a strong technology and solution delivery role, accountable for the successful design, development, and delivery of ETL solutions on the corporate Data Platform. Responsible for the delivery of the development activities he/she owns including ETL standards, patterns and best practices. Work with team to ensure standards and patterns are followed. Determines organizational strategies for data integrity validation processes. Establishes policies and best practices for optimizing ETL data throughput/accessibility Identifies opportunities for new initiatives; makes recommendations on the increasing scalability and robustness of ETL platforms and solutions. Partner with the Data modelers to drive improvements and enhancements to the current data landscape and future strategy. Remain current on new ETL techniques and methodologies and communicate trends and opportunities to management and other developers as needed. Identify opportunities for uses of those technologies to enhance current or anticipated information systems and business goals Evaluates existing applications that could address client requirements and makes recommendations from complex projects. Identifies opportunities for solution sharing and reuse. Assists in the development of ETL-related Service Level Agreements. Communicates risks and ensures understanding of these risks. QUALIFICATIONS:B.E or B TECH or MASTERS IN COMPUTER SCIENCE, ELECTRONICS, RELEVANT TECHNICAL CERTIFICATION Experience(in years) : 5 Skill Set Required Technology Skills and Project Experience: - 5 years of experience in ETL design, development and business system designs. - Good understanding of AWS networking concepts: VPC, subnets, routing, NAT gateways, security groups. - Proficiency in IAM concepts: roles, policies, assume-role, and cross-account access. - Hands-on experience in AWS services including but not limited to: S3, KMS, Lambda, Glue (or Spark), SQS, EventBridge. - Hand on experience in writing clean, modular, testable, and maintainable code using functional or OOP principles. - Good experience in at least one programming language such as Python, Scala, Java etc. - Willingness to learn Python/PySpark if not already experienced. - Good understanding of Spark architecture, execution plans, and performance tuning. - Strong SQL skills and experience with Redshift and/or Athena, or any other distributed computer engines. - Experience in writing and maintaining Terraform scripts. - Familiarity with Git, GitHub workflows, and CI/CD tools like Jenkins. - Exposure to data lake architectures and data governance practices. - Familiarity with monitoring and logging tools (e.g., CloudWatch). Business / Soft Skills: - Must have solid presentation, communication (on complex technical solutions) and interpersonal skills. - Ability to work effectively with globally dispersed stakeholders from business. - Ability to manage multiple priorities in a fast-paced environment. - A data-driven mindset, ability to clearly communicate complex business problems and technical solutions. - Ability to manage and make decisions about competing priorities and resources. - Ability to delegate where appropriate - Must be a strong team player .