Data acquisition research engineer

OverviewWe are looking for Data Acquisition Research Engineers. They will develop and maintain large-scale web scraping and data acquisition systems. The role focuses ondesigning,developingand constantlymaintainingresilientdata collectionand acquisition systems andscrapers for complex web platforms. Thisincludesenvironments whereadversarialand reverse engineering may berequired.You will develop robust datapipelines andensure reliable collection of large volumes of structured and unstructured data.ResponsibilitiesDevelop andmaintain data acquisition systems: web scrapers and automated data collectionDevelop data extraction methods that work with data repositories such as Websites, APIs, and Graph QLendpointsResearchand solve data collection challenges in adversarial environments (rate limits, blocking, anti-bot systems,...)Developand integrate scalable and reliable data pipelinesMonitor scrapers and ensure data qualityand pipeline stabilityWork closely withother teams to transfercollecteddata intodownstream systemsRequirementsExperience with web scraping frameworks (Scrapy, Playwright, Selenium, Puppeteer, etc.)Familiarity with Graph QLAPIs and REST APIsExperience handling anti-bot protections and detection mechanismsExperience with CI/CD workflows for testing and deploying scraping infrastructureAbility to parse and process HTML, JSON, and dynamic web contentSoft SkillsPatience and persistence in handling complex data acquisition challengesCompetitive, results-driven mindset with a strong drive to solve difficult problemsAttention to detail and commitment to data qualityAbility to adapt quickly to changing platforms and adversarial environmentsGood communicationand collaboration skillsNice to HaveExperience building distributed scraping systemsFamiliarity with containerization and cloud infrastructureExperience with data processing pipelines or large-scale data systems