Responsibilities

• Design, develop, and maintain robust web scraping scripts and applications to extract data from various online sources.
• Perform data extraction from multiple websites, effectively handling both static and dynamic content.
• Clean, validate, and structure large volumes of scraped data to ensure accuracy for further analysis.
• Monitor scraping pipelines for data quality, troubleshoot scraping failures, and implement solutions to maintain effectiveness.
• Collaborate with team members to define data requirements and deliverables, ensuring alignment with project goals.
• Document scraping processes and maintain code for scalability and reusability in future projects.

Requirements

• Have proven experience in building and maintaining web scrapers using tools such as Python, Scrapy, Selenium, or similar technologies.
• Have expertise in handling APIs, RESTful interfaces, and...