Web scraping , crawller admin Node.js or phyron prefered. I need to extract and parce data and output in sql server from 3 sites, the sites have search field where system will put one by one from a list i have, and extract results, skipping some items i will define, thw extracyion of data will be json output and also added to a postgres and also into a sql server database.
The system backend will be able to import the xls file and like mailchimp will match columns with database output and will select columns of data that needs to be search, site to search and dates to search
Hello, I can write the scrapper in java. It will be faster than python or node.js since i will make use of multiple threads here. Let me know the websites you want to scrape.
I have 5 years of experience in web scrapping.
Thanks,
Amit