Web scraper and data processing job for retail websites

ปิด โพสต์แล้ว 6 ปีที่ผ่านมา ชำระเงินเมื่อจัดส่ง
ปิด ชำระเงินเมื่อจัดส่ง

Experienced web scraper and data processor to develop daily scraping service off 500+ retail product websites and one single affiliate network. Please only apply if you have referenceable web scraping and automation processing experience at this scale. Please explain the relevance of your experience within your application.

Objective:

To scrape products from 500+ retailer UK websites, all of which have 1,000’s of products (including colour/size/style variants). The data to be scraped is retail product data on the retailer's product detail page, including all available images (at full resolution). Example: [login to view URL]

To scrape commission details for the same retailers (advertisers) from a single affiliate network.

These products need to be scraped daily and then:

• Stripped down to a subset of products based on a simple, single identification criteria (details provided to successful application). E.g. 5,000 products from a retail website might be reduced to 200 to be saved. (it might be that this reduction can be done before the data is scraped)

• Mapped to a provided predefined category taxonomy – e.g. John Lewis might have Mens / Clothing / Tops / Polo Shirts and this will be mapped to Mens / Clothing / Shirts / Polo Shirts

• Appended with the appropriate tracking URL elements for a single affiliate network which will be confirmed to successful applicant (e.g. Affiliate Window, Commission Junction)

• Enriched with Shopify product tags based on data within the products title, description, colour, brand etc

• Enriched products with data from the a single affiliate network which will be confirmed to successful applicant (commission % etc.)

• Consolidated in to a single file/repository

• Enriched with a calculation of the product price / affiliate commissions % (e.g. £30 RRP / 5% Commission = £1.50)

• Uploaded to a Shopify website

The successful applicant will setup the required services and database/repositories on an Amazon AWS machine.

I have had a few conversations with freelancers that have submitted which indicate that my brief is not clear. For the avoidance of doubt:
- This project is to deliver a stand alone solution that will scrape 500 websites every day
- The products to be extracted will likely be 10,000+ (once a majority of the products on websites have been disregarded).
- This process is not a one off, it will be run every day
- The solution will not involve your team performing tasks every day. It needs to be an autonomous solution that requires no further involvement from the developer.
- I will provide examples of data to be scraped and list of retailers to any freelancers that can demonstrate that they have relevant experience will complex, ongoing web scraping like this.
Thanks :)

การตลาดพันธมิตร การประมวลผลข้อมูล Shopify Web Scraping

หมายเลขโปรเจค: #15128808

เกี่ยวกับโปรเจกต์

36 ข้อเสนอ โปรเจกต์ระยะไกล ใช้งาน %project.latestActivity_relativeTime|แทนที่%

freelancer 36 คน กำลังเสนอราคาในงานนี้ โดยมีราคาเฉลี่ยอยู่ที่ $1439

seaanddream

Hi, my name is Sevinc. I read your "Web scraper and data processing job for retail websites" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go a เพิ่มเติม

$6000 USD ใน 45 วัน
(318 รีวิว)
8.0
schoudhary1553

I can extract the products from 500+ UK retailer website. Relevant Skills and Experience Affiliate Marketing, Data Processing, Shopify, Web Scraping Proposed Milestones $1250 USD - Web scraper and data processing job เพิ่มเติม

$1250 USD ใน 10 วัน
(214 รีวิว)
7.7
PigtailXL

Hello Sir/Madam. I'm an experienced web data extractor and I'd like to have a chat with you to refine and define some points. Habilidades y experiencia relevante Experience building solutions like: Windows Desktop App เพิ่มเติม

$1200 USD ใน 10 วัน
(213 รีวิว)
7.4
mirniyazuddin92

Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. Relevant Skills and Experience Data Processing, Shopify, Web Scraping Proposed Milestones $1500 เพิ่มเติม

$1500 USD ใน 20 วัน
(276 รีวิว)
7.6
motiur03

Dear Hiring Manager, You may see my profile here: https://www.freelancer.com/u/motiur03.html Relevant Skills and Experience Gumtree, Craiglist Advert posting, web search, web scrapping, Amazon, eBay, Shopify, WooComm เพิ่มเติม

$750 USD ใน 5 วัน
(167 รีวิว)
6.8
srinichal

I am an expert in delivering custom scripts and projects Relevant Skills and Experience proven track record on this site Proposed Milestones $1058 USD - milestone

$1058 USD ใน 20 วัน
(67 รีวิว)
6.7
maciekjanowski5

Hi I am an expierienced python developer specializing in web scraping. I have written scrapers for over 100 websites. Including: Yelp, Grubhub, Foodora, H&M and much more. My relevant skills are Python+ various scrapin เพิ่มเติม

$1098 USD ใน 5 วัน
(99 รีวิว)
6.6
Nidhijain123

Hello, I cantake up this task and will ensure the task is delivered to your level of satisfaction. I have sound experience in data scarpping through script and have done similar project of large scale Relevant Skills เพิ่มเติม

$1000 USD ใน 20 วัน
(67 รีวิว)
6.0
Harun1986

Hello, I willl do this scraping daily. I have seen your website and I can scrap 500 product every day in your time. I can scrap almost every website. Relevant Skills and Experience I have best scrapping skill and I ca เพิ่มเติม

$750 USD ใน 5 วัน
(85 รีวิว)
6.0
dpune

Build a tool which will be automatically scrape data from 500+ websites, massage it and upload it on shopify platform Relevant Skills and Experience web scarping/ecommerce Proposed Milestones $5000 USD - Completed to เพิ่มเติม

$5000 USD ใน 60 วัน
(47 รีวิว)
5.5
sheak

Hello! I have read all the requirements carefully and I have all the required skills. I am extremely interested in this project and would love to work with you on long term basis, kindly reply back to discuss further r เพิ่มเติม

$1323 USD ใน 20 วัน
(14 รีวิว)
5.3
muzammil21

A proposal has not yet been provided

$882 USD ใน 5 วัน
(26 รีวิว)
5.1
BitLabs

Dear sir, My name is Farid, I have analyzed that I have right experiences in (Affiliate Marketing, Data Processing, Shopify, Web Scraping) to execute your project "Web scraper and data processing job for retail websi เพิ่มเติม

$1362 USD ใน 365 วัน
(8 รีวิว)
4.5
vw6417773vw

Hello! I'm experienced freelancer who worked with a team in the past. I've done quite few big web scraping projects and I can guarantee you will be provided with a quality results. Best regards, M Relevant Skills a เพิ่มเติม

$1111 USD ใน 20 วัน
(10 รีวิว)
4.1
VnBestSolutions

Dear Sir. I had read your descriptions about project. Kindly give me a chance, i would like to discuss more about project and sure everything clear. I am a developer very strong in below skills. Relevant Skills and Ex เพิ่มเติม

$1323 USD ใน 20 วัน
(17 รีวิว)
4.2
huongth

Hi. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now Relevant Skills and Experience I am an expert i เพิ่มเติม

$2777 USD ใน 30 วัน
(14 รีวิว)
3.6
appleearth039

Dear Sir, I am very interesting in your idea and would love to have a chance to discuss project with you. Relevant Skills and Experience I am an excellent scraper, I have rich of experience in Python, Django, Data Ent เพิ่มเติม

$1250 USD ใน 20 วัน
(2 รีวิว)
3.5
adilhussain0411

HI I am expert in Web Scrapping and data mining. I have checked your project and I am sure that I can do it with perfection. I would be glad to work with you. Looking forward to hear from You I have completed 200+ เพิ่มเติม

$750 USD ใน 3 วัน
(7 รีวิว)
3.9
extreamcode

HI Sir/Madam, I can assist you with "Web scraper and data processing job for retail websites", I have experience working with "similar Development". Let's have a quick chat to discuss it further. Relevant Skills and เพิ่มเติม

$1323 USD ใน 20 วัน
(1 รีวิว)
2.3
PavelStefan

Hello, I'm a web scrapper guru. I have scrapped until now over 50 websites and the biggest one was pagesjaunes(dot)fr with over 15m entries. I had lot of problems there because I was blocked every hour and I manage t เพิ่มเติม

$1340 USD ใน 30 วัน
(1 รีวิว)
0.4