We are currently seeking a highly skilled Web Scraper with 4+ years of experience to join our dynamic team and help us scrape some websites to obtain data from different sources that do not necessarily have API access but we need to simulate the user interaction with those websites to scrape all their databases.
Job Description
Key Responsibilities:
Developing and Implementing Web Scraping Scripts.Data extraction and processing.Maintaining Scraping Systems.Handling Automation and Batching.Data Storage and Management.Error Handling and Debugging.Performance Optimization.Collaboration and Reporting.Ethical Scraping in compliance with legal regulations.Familiarity with No-SQL Databases (MongoDB and Mongoose in particular).
Qualifications:
4+ years of professional web development experience.Proficiency in JavaScript and Node.js (TypeScript would be a plus)Experience with web scraping tools like Puppeteer and Axios.Understanding of asynchronous programming.Knowledge of databases and data storage technologies. (Google Cloud Storage would be a plus).