Web Scraping Data Engineer
TransForm Solution Verified employer
Actively hiring · Posted 14d ago · JEV26115F83761091
Job description
Design, build web crawlers to scrape data and URLs.
Integrate the data crawled and scraped into our databases
Create more/better ways to crawl relevant information
Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex)
Understanding of data privacy policies (esp. GDPR) and personally identifiable information
Develop automated and reusable routines for extracting information from various data sources
Prepare requirement summary and re-confirm with Operation team
Translate business requirements into specific solutions
Ability to relay technical information to non-technical users
Demonstrate Effective problem solving and analytical skill
Ability to pay attention to detail, pro-active, critical thinking and accuracy is essential
Ability to work to deadlines and give realistic estimates
Skills & Expertise
2+ years of web scraping experience
Experience with two or more of the following web scraping frameworks and tools: Selenium, Scrapy, Import.io, Webhose.io, ScrapingHub, ParseHub, Phantombuster, Octoparse, Puppeter, etc.
Basic knowledge of data engineering (database ingestion, ETL, etc.)
Solution orientation and "can do" attitude - with a desire to tackle complex problems.
Key skills
How to apply
- Sign in or create your free profile — takes about two minutes.
- Apply with one tap — your profile is shared directly with TransForm Solution.
- Track your application and get updates by email and WhatsApp.