Level 2 Data Engineer

About Woodside Energy

We are a global energy company, providing reliable and affordable energy to help people lead better lives. Join our team at Woodside Global Solutions in Bengaluru where talent, digital expertise, and operational excellence converge to solve complex energy challenges, accelerate change, and reimagine business capabilities to support Woodside's global operations and our role in the energy transition.

Founded in 1954, Woodside established the liquefied natural gas (LNG) industry in Australia 40 years ago and supplies customers around the globe. 70 years on, Woodside continues to be driven by a spirit of innovation and determination.

At Woodside, we know great results come from our people feeling valued, getting the support they need to reach their full potential and working in a psychologically and physically safe work environment. We believe in nurturing talent and providing opportunities for continuous learning and career advancement.

Refer to our corporate website for more information about our different locations and projects: What We Do

About Woodside Global Solutions

Woodside Global Solutions in Bengaluru is being built as a hub of excellence, to drive innovation, digital transformation, and global collaboration.

Working as one Global team, the Woodside Digital team is a trusted partner driving transformation within the organisation. We are bold in our ambitions and resolute in our actions. Through cutting-edge AI, robust cyber security, and advanced data solutions we drive innovation and influence every part of our business.

We are looking for talented professionals who are passionate about technology and eager to make a global impact, helping to shape the future of Woodside together.

About the role

The purpose of the Level 2 Data Engineer position is to leverage their technical expertise and domain knowledge to design, build, and maintain efficient and robust data solutions. The Data Engineer shall be responsible for the building, testing, and deployment of Data Pipelines on the EDP. The engineer shall ensure that the pipelines are developed and deployed with a secure-by-design approach, delivering robust, thoroughly tested, and maintainable solutions.

Duties & Responsibilities:

Build

Pipeline Development

Develop pipelines using the standard patterns for data pipelines and workflows utilizing Kestra, dbt, Git

Design and Implement data storage and processing solutions employing Snowflake

Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to: Lambda,ECS,MSK,RDS,EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge

Utilize Terraform for AWS and Azure deployments

Leverage and integrate APIs for data access and manipulation

Write Python scripts for data common processing and automation tasks

Leverage Platform API's and Web Applications to enforce Platform Security

Development experience with SQL, Python, C#, .net, JavaScript, shell scripts & container platforms like Docker

The engineer shall have experience integrating with timeseries source systems: Honeywell Plant Historian Database, OSI Pi

The engineer shall have experience in Authentication mechanisms including but not limited to (OAuth 2.0, OIDC, Microsoft Entra, Key Pair Authentication, Certificate based authentication, SAML based SSO)

Test

Quality Assurance

Create and execute comprehensive test plans to ensure the pipelines functionality and performance

Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows

Ensure data accuracy and consistency through rigorous testing processes

Leverage automated testing processes to enhance efficiency

Governance

Compliance & Risk

Due to the Crown Jewel nature of the enterprise data platform, Data Engineers may have access to PII, Confidential and Most Confidential data

This role requires strict adherence to access process and procedures to maintain Data Privacy and Security

Identify and report any potential breaches of the Data Information and Systems Processes

Operate

Platform Maintenance

Monitor and manage the platform to ensure optimal performance and uptime

Conduct regular maintenance tasks such as updates, patches, and backups

Resolve any issues or incidents related to the platform in a timely manner

Continuously improve platform operations through automation and optimization

Strong experience with Windows & Unix like operating systems

Security

Secure by Design

Implement security best practices throughout the pipeline development and deployment process

Conduct regular security reviews and vulnerability assessments

Ensure data encryption, access control, and other security measures are enforced

Use credential management platforms like Thycotic Secret Server, AWS Secrets Manager

Support

Technical Guidance

Assist in troubleshooting and resolving intricate technical issues

Deliverables

Robust and scalable data .