Data Engineer (Remote)
Improving Verified employer
Actively hiring · Posted 1d ago · JEV2611AAD61F5F43
Job description
Data Engineer - RemoteNearshore engineer on a team converting SAS code to Python and SQL on Databricks using generative AI. You will work with the existing accelerators, own deliverables end to end, and communicate directly with client and partner stakeholders.Required for both:4+ years of professional data or software engineering experienceStrong Python and SQLHands-on Databricks (Unity Catalog, Workflows, Databricks Asset Bundles)GitLab CI/CD: pipelines, merge request workflows, automated testingGit branching and code review disciplineClear written and spoken English with client-facing partnersDemonstrated ownership: scoping, delivering, and flagging risk without promptingFocus: Pipeline reliability, validation, and delivery of converted code.Responsibilities:Build and run the pipelines that process SAS inventories and converted outputsValidate converted code for parity against SAS outputs (row counts, checksums, schema, data types)Own deployment through DABs and GitLab CI/CDManage Unity Catalog objects, permissions, and environment promotionTroubleshoot job failures and performance issuesRequired:Spark and Delta Lake performance tuningData validation and reconciliation experienceInfrastructure as code or DAB-based deployment experienceNice to have:SAS reading ability, healthcare data exposure, Azure.
Key skills
How to apply
- Sign in or create your free profile — takes about two minutes.
- Apply with one tap — your profile is shared directly with Improving.
- Track your application and get updates by email and WhatsApp.