Web Scraping Amazon using Python. 50 million + pages in 24 hours.

HI there, recently i have scrap 3 millions products images from the Amazon by the given AISN code given to me. and its take 5 days , i used very high speed internet and multi thereat. so i think its not really possible to get 50 millions data in 24 hours. if you are happy to max the time then we may do this work :)

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Kimi

Dear Sir/Ma'am, I am a Web research, Data Entry & Webs Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet. I am ready to hear the details of the project more in detail now. I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

Hello Web search ,Web scraping and data mining expert is here .I have done many similar scraping projects similar as website which you mentioned on description.I am able to complete your project at lower rate and quality result than other freelancers within short time. Let me send you sample data in excel or csv file. Best Regards

Hi, this is Anshuman. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- [1.] Automated Crawling of Google for SEO Keywords [2.] E-Commerce Crawling. Crawling websites like Amazon, Ebay, Alibaba etc. [3.] E-mail list scraping and phone number scraping for targeted users [4.] Scraping Data from within Android Apps [5.] Dynamic Data crawling through JS Manipulation [6.] Automated Form Filling and Scraping [7.] Proxy Emulation and Authentication in order to prevent server blocking [8.] Mobile Site emulation and crawling mobile site specifically [9.] Scraping data from Desktop Apps, PDFs etc. [10.] Artificial Intelligence to emulate human behaviour while crawling and scraping sites Experience [Programming languages]- Python, PHP, NodeJS, Jquery and Rails. [Frameworks]- Python Scrapy, Apache Nutch, Selenium, DOM Manipulation using Chrome Extensions, URLLib2, Python Requests, PHP Syphony etc. Data can be exported to- Excel Files, MySQL, MongoDB, CouchDB, Cassendra, Redis, Docx. File, Amazon s3, HDFS, Oracle, MSSQL etc. I have read your project description and I am quite confident for it. I will ensure great project experience with timely updates. Would like to discuss about the details of project so please ping me and let’s get started. :)

Hello, I am shahid from kashmir. Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years of experience in , Data entry, Linkedin Lead generation , Google Research Expert,Web scraping. Python and Scrapping expert with 5 years of experience. Linkedin API developer. • Using Python, Wordpress , C Programming , C++Programming, Linux,PHP,MYSQL,Database Programming, Web Scraping ,Java ,Javascript, ,Website Design ,Graphic Design,CSS,Research,Wordpress ,Magento ,Matlab and Mathematica ,Leads ,Web Search ,Machine Learning ,HTML5 ,Linkedin ,Landing Pages ,Web Services ,Internet Research ,Angular.js ,,Data mining,,Web scrapping,Find contacts, Data Processing, Data Entry, Excel, Leads, Web Search, Data Mining, Linked in, Microsoft Office, Email handling. I am a highly skilled web researcher,data entry provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills. I have successfully completed more than 100 projects ranging from, Wordpress , C Programming , C++ Programming, Linux,PHP,MYSQL ,Java ,Javascript ,Website Design ,Graphic Design,CSS,Research,Wordpress ,Magento ,Leads ,Web Search ,Machine Learning ,HTML5 ,Linkedin ,Landing Pages ,Web Services web research, data entry, Internet Research, Linkedin Lead Generation, Google docs & Excel Spreadsheet creation/editing. You can test the quality of my leads and also i provide leads at best price in the market. Regards:

My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & experience that are required to complete this project. I can show you some examples of my work. Please contact me to discuss your project.

Hi Respected Employer, Please come on chat to discuss about project... I have much Experenice with PHP and ASP.net. Developing Web Apps from about 5 Years using various Frameworks, CMSes and Flat PHP. CMSes that i used during Development: > Wordpress > Joomla > Drupal > Magento > OpenCart > Prestashop Frameworks on which i worked: > Zend > Laravel > Codeiginter > Yii > CakePHP > Joomla Feel Proud Providing Quality Services from 5 Years. If you need my Services feel free to contact me, you can also contact me on Skype Skype: mobd007 Regards, Ameer Hamza

Hey there, From the sounds of it, you need someone to scrape some data from Amazon using python. Does that sound right? I have a team of 4 Data Scientists working in the company who are exceptionally good in python. A detailed DISCUSSION OVER THE CHAT would be better. We'll host that script on the server you provide us. For other details such as proxy services, virtual servers, maintenance, etc. we need to know exact details of the project. Some of the questions - 1. Are you available on Skype? Can we continue this conversation there? 2. Do you want 50 million data to be scrapped daily or monthly ? I can assure you that we can complete the project, but the sooner we get started the better. Send me a reply with any questions you have and let's get started today itself. Regards, Akshay Dalal

Hello, I am experienced Java developer (5 years). I can code in Java, J2EE (Spring, Hibernate). I have designed web scrapper for eCommerce companies. Scrapper will be designed in such a way that, wbesite will not be able to track ip of our scrapper. Plan - Use something, so that Amazon will not be able to track ip of our server where scrapper is hosted. - (routing of ips from different locations) If possible, instead of scrapping webpage, try to hit api of Amazon to fetch data in json/other format. Let me know, if you are interested in doing this stuffs with me. Thanks. Regards, Ashwin PATIL

I have created a similar simulator to generate 1000 of search engine result pages. we can ec2 and sqs for this process.