Create a desktop crawler to crawl datas from some websites

Dear Sir, I can do this job. I will use Python + Scrapy + Selenium to do this job. Let's take a look on my profile https://www.freelancer.com/u/etuannv.html to see some similar projects which I have done or watch these demo video [login to view URL] Thank you!

Hi,sir I have read your post and I am very interested in your project. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.

Hello. I assume that all urls are from the same site, so I can write my code. If that's the case, I will write a program for windows desktop, which you can give to your users to login and start parsing. I will use a mysql or ms access as a database. I am a vb.net programmer, I create custom programs for data scraping. I can scrap all kinds of sites, including those with logins and forms.

Dear Hiring Manager, I have read you project description and i have few questions about it. Just say "Hi" so we can start discussion about it. Thank You

Hi, I am very interested to work on your project. I have 15+ years experience in Web Development using a large variety of programming languages, frameworks, database architecture, APIs, CRMs, ERPs, mobile development, web design, development tools. There are more then 1000 projects(small/medium/high complexity) successfully implemented and few of them related with yours can be seen on my freelancer.com portfolio. * * Note that my bid is relative and will be adjusted after detailed estimation of implementation effort/coast ** Let's start our collaboration by sending me all details in a written document which will be used as reference during project implementation Thank you! AdiC

This should be a very interesting project to complete. As I have written two crawlers for Freelancer and I am familiar with both Python and web technologies, particularly concerning website data fetching and web APIs, this should be a straightforward project for me to work on.

Hello, I am interested in your offer and I am ready to cooperate. I have experience in write a programs for Windows to analysis of processes on the site page and receive information from the site. I have experience writing programs for information processing.

Hi. I am an expert in VBA, VBScript, Visual Basic, C#, F#, C, C++, ASM, Delphi, Java, iMacros, Flash, ASP, ASP.NET, Access, MySQL, MSSQL, QuickBooks, Oracle. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now

I see this project as having three main components. First a simple user interface with login capabilities is required for accessing the tool and loading websites to be scraped from your private database. Second, a web scraper should be able to visit these url's and parse out the required data. Finally a loading script needs to insert all this scraped data into the appropriate tables in your private database. I have completed a very similar personal project in the past in which I set up a crawler to scrape different classified's sites and stored only short term rental ads into a MySQL database. This crawler was set to run on a schedule and make updates on the database when ads have been taken down or edited. This database was then used to make the search process for temporary housing more efficient. For this project I would first of all explore and understand the HTML code structure for the sites to scrape and then create a crawler in python using the Beautiful Soup library to parse out the desired data. After having the crawler I would create an interface to save the parsed data to the database, and another to read in the urls from the database. Finally I would work on a simple user interface that can be used to load urls and execute the crawler. If I get chosen this will be my first project as a freelancer and I am excited to proof myself and do some great work. Webscraping is something I really enjoy and I am more than happy to answer any question you may have. Thanks