I am looking for someone to write me a script that scrapes data from a real-estate website, using a web crawler - I will then run this script on a regular basis.
The script should be written in PHP - I want the data to be exported to a MySQL Database. If you think there is a better method you can discuss with me, but this is my preference.
You should have some knowledge of regular expression, as I would like to change the format of some of the scraped data before placing it in the database (the house prices need to be a consistent format). See attached PDF file for more info about the project.
From the listings on the real estate site, I will want to scrape three things:
- data from all rental listings in each suburb in each state
- data from all property for sale in in each suburb in each state
- data from sold prices on the site in each suburb in each state
The script would be used to scrape data from these on a regular occasion, updating the database whenever it is run. I want it to add new rows to database, rather than overwrite or replace existing rows if there is duplicate (please see attachment for more info)
Further information on the data to be extracted, and the format to be placed into a database is given in the attached pdf.
I want to use a web crawler to minimise data bandwidth and time (ie. I don't want to load images associated with the crawl).
IN YOUR QUOTE, YOU NEED TO INCLUDE DETAIL OTHERWISE YOU WONT BE CONSIDERED :
1) The word 'real estate' so I know you have actually read this advertisement
2) How you will use regular expression to change some data elements, as detailed in the attached PDF file
3) The general structure / approach to producing the scraper
4) Demonstrate your experience with web scrapers, and use of regular expression
I have future work available on same project, so looking for someone to do further work later.
Thanks
we are a team of professional developers and have worked on couple of realestate sites of companies like gc construction etc, we can definately deliver the delight with in the time frame comitted.