PHP Java Web Scraper and Crawler - open to bidding
$30-250 USD
ปิดแล้ว
โพสต์ ประมาณ 7 ปีที่ผ่านมา
$30-250 USD
ชำระเงินเมื่อส่งงาน
Hi,
Can you make PHP Java web scraper/crawler for any website by putting a code into PHP file?
Normally, I put a simple htmldom to my PHP file as following:
<?php
function getDetail($ASIN){
$returndata="";
$contents=curlContent($ASIN);
$html = new simple_html_dom();
$pageURL="http://".$_SERVER['HTTP_HOST'].$_SERVER['REQUEST_URI'];
if(!empty($contents))
{
$html->load($contents);
if($html->find('div[class="product-details-and-care"] ul')){
foreach($html->find('div[class="product-details-and-care"] ul') as $detail){
$returndata=$detail->plaintext;
$regex = '#<img([^>]*) src="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';
$regex = '#<a([^>]*) href="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';
$returndata = preg_replace($regex,'',$returndata);
}
}
else {echo "There is currently no description for this product. We do not represent or warrant that product descriptions or other Content on this Site is accurate, complete, reliable, current, or error-free.";}
$html->clear();
unset($html);
}
return $returndata;
}
echo getDetail($ASIN);
?>
$ASIN is a page url variable of any web page and this case I using with any product page of [login to view URL] such as [login to view URL]
A function will find element UL under div class of product-details-and-care and will print data as plaintext when visiting a page and connect with $ASIN, if not found or can't access page will print custom text as 'There is currently no description...'
However, I got a problem when currently this code seems to be old-fashioned or get restricted to access and print data on my webpage.
So, I want to know can you make or develop a code with other language in java or etc to working with my PHP file to let all websites allow me to crawl and scrape their content to displayed on my webpage?
Thank
Hello,
We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore your needs, which will yield a clear picture of implementation phase.
Prior undertaking project, I want to show demo of the work done previously.
Apart from demo, I will be sharing following documentation which will turn your project into Quality and Successful delivery:
- Technical Project Proposal
- Designs
- Flow chart for this Project
- Execution plan
Hello,
My name is shahid from Kashmir
Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years rich experience in the field of data mining data scrapping, I am certified python developer, I have successfully completed more than 1000 projects in this field you will be glad to know that I am best fit for your project
my key skills are
oodo
Java
PHP
database development
Data mining
data processing
web scrapping
LinkedIn
Leads
python
and much more
I am a highly skilled web researcher,data entry provider seeking an opportunity to leverage my expertise and demonstrate my high level of technical an administrative skills.
I am waiting for your response
regards
shahid.
Hi, I have gone through your requirement and I'm very interested in this job. Yes I already did this type of jobs and its more easier for me to do this job. You can also check my profile's reviews and ratings about my quality of the job. If you need to do any SAMPLES, please let me know. I'm ready to do the Sample
Hi there,
thanks for the project. Please tell me if you want me to send you the demo app? You do not have any obligation about it .
I like to make similar bots, I find your idea very challenging.
Thanks,
MrScraper