Find Jobs
Hire Freelancers

Data Crawler in Node. js Crawlee Library-

$30-250 USD

ที่ทำเสร็จแล้ว
โพสต์ 10 เดือนที่ผ่านมา

$30-250 USD

ชำระเงินเมื่อส่งงาน
Hello, We would like to create a crawler bot in Node. js Crawlee Library that will go and fetch the circled data from attached print screen, So, every 5 mins the bot will enter this link and refresh the data. Every time that it will enter this link and fetch the data, it has to save them in a txt file. So, you have to make a page that it will show all the saved TXT files in order if we wish to be able to download one TXT File. Also, we should be able to export this TXT Files in Excel format. At the top of each ‘column’, we need to have the name of the data fetched. Each day the bot will start at 00:01 a.m. and will finish at 23:59 p.m. GMT+3. The name of the TXT file should be the date and time that is stored. Also, we should have an on-off button in order to be able to stop the bot if we wish. For this demo project we wish to use only one Proxy, but in the live project we want to use a random proxy IP system. Please suggest a proxy system. Once you finish this project on your machine, you will have to provide us with instructions on how we can host this bot in our server. Once you finish the project we will give you other features to implement. Full project here: [login to view URL]
รหัสโปรเจกต์: 36975736

เกี่ยวกับโปรเจกต์

36 ข้อเสนอ
โปรเจกต์ระยะไกล
ใช้งานอยู่ 10 เดือนที่ผ่านมา

กำลังมองหาการสร้างรายได้ใช่ไหม?

ประโยชน์ของการประมูลกับ Freelancer

กำหนดงบประมาณและกรอบเวลาของคุณ
รับเงินจากการงานของคุณ
อธิบายข้อเสนอของคุณในภาพรวม
ลงทะเบียนและเสนอราคาฟรี
หมอบหมายให้:
รูปอวาตาร์ของผู้ใช้
Hello, After checking snapshot about SUPERRUNNER JET 2 product, I'm confident that I can complete this project within 3 days using the Crawler framework. On this type of projects, I have rich experience using Crawler and Selenium during the last 3 years. Regarding random proxy IP system, I highly suggest Smartproxy or IPRoyal services. I'm ready to work on this project Today. Looking forward to meeting with you soon. Kind regards, Chang
$120 USD ใน 4 วัน
5.0 (2 รีวิว)
2.7
2.7
36 ฟรีแลนซ์กำลังเสนอราคาโดยเฉลี่ย $169 USD สำหรับงานนี้
รูปอวาตาร์ของผู้ใช้
Hello, I'm an experienced Node.js developer and I'm excited to work on this crawler bot project for you. I will use the Crawlee Library to fetch the circled data from the provided link and save it in a TXT file every 5 minutes. The bot will run from 00:01 a.m. to 23:59 p.m. GMT+3 each day. To achieve this, I will create a Node.js script that uses the Crawlee Library to fetch the data and save it in a TXT file with the date and time as the filename. I will also create a web page that displays all the saved TXT files in order, allowing you to download them and export them to Excel format. For the proxy system, I suggest using a rotating proxy service that provides a pool of proxy IPs. This will help to avoid IP bans and ensure reliable data fetching. Once the project is completed on my machine, I will provide you with detailed instructions on how to host the bot on your server. I will make sure the setup process is smooth and easy to follow. I'm confident that I can deliver a high-quality solution that meets your requirements and I look forward to working with you on this project. If you have any specific features or requirements you'd like to discuss further, I'm all ears. Thank you for considering me for this project, and I'm eager to get started right away! Best regards, Muzz
$250 USD ใน 7 วัน
5.0 (41 รีวิว)
7.1
7.1
รูปอวาตาร์ของผู้ใช้
Hello! I am Umar, a freelancer with 10 years of experience in IT. I understand that you are looking for a data crawler bot in Node.js Crawley Library. I can provide you with the best solution for this project. If you would like additional features to be added to the project please let me know so we can discuss further.
$140 USD ใน 4 วัน
4.9 (268 รีวิว)
7.3
7.3
รูปอวาตาร์ของผู้ใช้
>>- ⭐️->>Scraping Expert<<- ⭐️-<< Thank you for considering me for your project. I am a Python/Golang/PHP/JavaScript/C# Programmer with more than 20 years of experience in Development, I have a strong knowledge of web scraping. I can scrape any website, even with dynamic / javascript data and login-requirement and then provide scraped/extracted data in any format: Excel/CSV, XML, JSON, Database, GoogleSheet, WordPress API, etc. You can hire me for the following mission: 1) Web Scraping ✔ Data scraping/Extraction, Data mining ✔ Scrapy / Selenium / Playwright / BeautifulSoup / Xpath ✔ Pandas / StyleFrame / Captcha Bypass 2) Development ✔ Python, Golang, PHP, HTML, CSS ✔ WebAdmin: Django, Flask ✔ Automation Bot ✔ API and Backend ✔ WordPress Plugin 3) Database ✔ MongoDB, Mysql, PostgreSQL, Sqlite3, Redis ✔ AWS, S3 Bucket, DynamoDB, CloudWatch I am a full-time freelancer , 8 hours per day. I do my best for you. Looking forward to working with you.
$150 USD ใน 1 วัน
4.8 (44 รีวิว)
6.7
6.7
รูปอวาตาร์ของผู้ใช้
Hi There, Thank you for considering our services. We have thoroughly reviewed your project requirements and are confident in our ability to deliver a high-quality solution. We propose to create a crawler bot using the Node.js Crawlee Library. This bot will periodically fetch the data from the provided link and save it in a TXT file. The bot will refresh the data every 5 minutes, ensuring that the most up-to-date information is captured. To facilitate easy access to the saved TXT files, we will develop a web page that displays all the files in chronological order. Users will have the option to download any specific TXT file of their choice. Additionally, we will implement an export feature that allows users to export the TXT files in Excel format for further analysis. Each column in the web page will be labeled with the corresponding fetched data name, providing clear organization and easy reference. The TXT files will be named based on the date and time they were stored, ensuring proper identification. To provide flexibility, we will include an on-off button that allows users to stop the bot whenever desired. For the demo project, we will use a single proxy, but for the live project, we recommend implementing a random proxy IP system to enhance security and reliability. We can suggest suitable proxy systems based on your specific requirements. Once the project is completed on our end, we will provide detailed instructions on how to host the bot on your server. This...
$140 USD ใน 15 วัน
4.9 (20 รีวิว)
6.6
6.6
รูปอวาตาร์ของผู้ใช้
I have recently completed a similar project, to run multithreadee bots using nodejs to crawl websites. I can deliver the required using a web application with gui interface to control running and configuration. We can discuss further details over the chat.
$250 USD ใน 5 วัน
5.0 (43 รีวิว)
6.3
6.3
รูปอวาตาร์ของผู้ใช้
As a Full Stack developer with loads of experience building complex and scalable applications, I'm pretty skilled at what I do. I'm a total tech geek and love keeping up with the latest trends, tools, and techniques in the industry. When it comes to development, I'm all about writing clean, efficient, and maintainable code that's easy to understand and extend. My track record of delivering high-quality work on time and within budget shows that I've got what it takes to tackle even the toughest issues. I think my skills and experience would be a great fit for your project, and I'd love to chat more about it. Let me know if you're interested in discussing it further! Best regards,
$140 USD ใน 7 วัน
5.0 (24 รีวิว)
6.0
6.0
รูปอวาตาร์ของผู้ใช้
Hello, I have 26 years of experience in creating web platforms, game products and user-friendly and mobile-friendly applications. With experience in JavaScript, Node.js and web scraping I am confident that I can deliver a successful end product. If you would like any further information or directions on how to host this bot please don't hesitate to reach out to me directly! Thank you for considering me for this position. I look forward to hearing from you soon. Paul
$140 USD ใน 7 วัน
5.0 (11 รีวิว)
6.1
6.1
รูปอวาตาร์ของผู้ใช้
Hi. Experienced Node.js developer here with 8+ years of hands-on experience in web scraping and crawler bots. Having worked on similar projects before, I can assist you in creating a crawler bot using the Crawlee Library to fetch data from the specified URL. To proceed further, I kindly request the following information: 1. Could you provide more details on the specific data you need to fetch from the given URL? 2. Do you have any preferences for the data format in the TXT files? 3. Are there any additional features or functionalities you would like to add to the crawler bot? 4. What are your server specifications for hosting this bot? For an amazing experience, please initiate a chat so we can discuss the project and its requirements thoroughly. I look forward to collaborating with you to develop a reliable crawler bot that meets your needs, along with instructions on hosting it on your server.
$140 USD ใน 7 วัน
5.0 (15 รีวิว)
5.9
5.9
รูปอวาตาร์ของผู้ใช้
Hello, I am Adnan, an experienced and results-driven professional with a track record of success in both corporate and entrepreneurial environments. I understand that you are looking for someone to create a crawler bot in Node.js Crawlee Library that will go and fetch the circled data from attached print screen every 5 minutes so that the bot can refresh the data every time it goes to the link and fetch it. Every time it enters this link and fetches the data, it has to save them in a txt file. At the top of each column, we need to have the name of the data fetched so that we can later download one txt file for each day on which it was run. We also need an on-off button so that we can stop the crawler if we wish. We would like to use only one proxy for this demo project but in the live project we want to use a random proxy IP system so that you can confirm that it is working correctly before moving onto other parts of the project. Once you finish this project on your machine we will give you instructions on how to host this bot in our server so that you can test it properly before moving onto other parts of the
$140 USD ใน 7 วัน
4.9 (9 รีวิว)
5.5
5.5
รูปอวาตาร์ของผู้ใช้
Hello, hope you're doing well. I have proficiency in JavaScript and NodeJS. I also have 15+ years of expertise in Website development, Mobile app development, Android and iOS, Artificial Intelligence, Machine learning, Custom cloud app development, Cyber integration, eCommerce, Chatbot development and Graphic design. If you have any questions about our qualifications or services, or would like to discuss the project further let's meet in a personal chat. Thank You
$150 USD ใน 7 วัน
5.0 (5 รีวิว)
4.8
4.8
รูปอวาตาร์ของผู้ใช้
Dear Client, I am writing to express my interest in collaborating with you on your project posted in Freelancer. Based on the project details provided, I assure you that I have the skills and expertise required to deliver high-quality work within the specified timeframe. I am confident in my ability to deliver exceptional results for your project. I am committed to maintaining open lines of communication, delivering on time, and ensuring your complete satisfaction. I look forward to the opportunity to discuss the project further Waiting hear from you. With thanks and regards Anu
$165 USD ใน 4 วัน
4.9 (23 รีวิว)
5.0
5.0
รูปอวาตาร์ของผู้ใช้
Hi, I am Senior Full Stack Developer I'm an Expert in: -PHP -Python -React JS -Laravel - CodeIgniter -Drupal 7,8,9 -Frontend & Backend Development
-Zend
-Cake -Python -Data Science -Machine Learning -JVM technologies -Jquery, PHP -Ionic - Hybrid Mobile Applications -Angular, Node.js -Ruby on Rails -C++

Who Knows the value of time. Very hard working and always delivers the work on time. I will finish your tasks in a timely and efficient manner, I aspire to help others reach their goals through the use of my knowledge and experience, I am available 24 hours support. I am available for the weekend also. If you are looking for website design and development I am the right person for you. 

$140 USD ใน 7 วัน
4.9 (25 รีวิว)
4.6
4.6
รูปอวาตาร์ของผู้ใช้
Hi, i have read your project, i am interested in your project, but i have some doubts, please clear my doubts, i am ready to start the work from now.
$140 USD ใน 7 วัน
5.0 (14 รีวิว)
4.7
4.7
รูปอวาตาร์ของผู้ใช้
Hello, I'm Carlos and I'd love to help you create a crawler bot in Node. js Crawlee Library. I'm a professional web developer, who have extensive experience of more than 5 years in Node.js. I can start your project right now. Please shoot me a message. Best regards, Carlos
$155.56 USD ใน 3 วัน
5.0 (7 รีวิว)
4.5
4.5
รูปอวาตาร์ของผู้ใช้
⭐Hi⭐ I am exicted to apply for the Java and React developer position. As an experienced full stack developer, I am well versed java spring boot and react. I recently developed Maven backend system using Java Spring Security framework as well as React frontend. As you know, we can say that Java spring boot is framework of frameworks such as spring security. Java Spring boot makes developers to create security system and save the time to develop the large project. Actually, i wanted to look for Java job. Please feel free to reach out if you would like more information or an opportunity to discuss this project further. Thank you for your time and I am looking forward to hearing from you. Warmest regards, Mohamed.
$200 USD ใน 3 วัน
5.0 (4 รีวิว)
4.5
4.5
รูปอวาตาร์ของผู้ใช้
Hey there, I can help you to make crawler bot for the marine traffic site you mentioned with NodeJs Crawlee library and will also implement these functionalities - 1. On/Off Button 2. Scrap in every 5 minutes, and save the information in text file. 3. Text files properly managed as per the date and time. Also I can help you to deploy your script in linux server, and will provide you the documentation file for the same or can also dockerise the bot. So DM me to discuss more
$200 USD ใน 2 วัน
5.0 (6 รีวิว)
4.1
4.1
รูปอวาตาร์ของผู้ใช้
Hi, I can build web scrapper in any program language of your choice. I am a developer with 15 years of experience. I have build many web scraping and crawler system in past. Kindly go through my profile and if you find it suitable please reach out to me. We can discuss on features and control needed for the bot
$140 USD ใน 7 วัน
5.0 (14 รีวิว)
4.3
4.3
รูปอวาตาร์ของผู้ใช้
Hello, I am interested in working on your crawler bot project using Node.js Crawlee Library. I understand the requirements and will be able to create the bot that fetches data from the specified link every 5 minutes and saves it in a TXT file. Additionally, I will create a user-friendly web page that displays all the saved TXT files, allowing you to download and export them in Excel format. Key Features: Crawler bot in Node.js Crawlee Library to fetch circled data every 5 minutes and save it in TXT files. Web page to view and download all the saved TXT files, with data organized in columns with proper headers. On-off button for stopping the bot when needed. Usage of one proxy for this demo project, with suggestions for a random proxy IP system for the live project. Timeline: I will deliver the project within the specified timeframe. Hosting Instructions: Once the project is completed, I will provide detailed instructions on how to host the bot on your server. I am excited to work on this project and look forward to implementing additional features as needed. Please feel free to reach out if you have any questions or further requirements. Thank you for considering my bid, and I am eager to start working on this project. Best regards, Dhaval
$250 USD ใน 7 วัน
5.0 (4 รีวิว)
4.2
4.2
รูปอวาตาร์ของผู้ใช้
Thank you for providing detailed and specific instructions. I am able to create the required scraper. Instead of explaining why you should hire me, let's focus on how I will implement this. I propose using a Node server with a dashboard page for controlling the on/off and other system settings. Periodically, the server will use the Crawlee Library to scrape data and store it in the specified format. If you have any questions or would like to discuss any changes, please do not hesitate to contact me.
$160 USD ใน 2 วัน
5.0 (3 รีวิว)
3.5
3.5
รูปอวาตาร์ของผู้ใช้
⭐ Hello, dear client ⭐ I am a professional php/javascript/python developer. My main specializations are automation, web scrapers and web extension development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I can show you one sample of my script in chat. I have done web scrapers for: - Amazon - Instagram - Google - Twitter - Pinterest For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - puppeteer I can bypass: - CloudFlare Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. Thank you for your kind response.
$150 USD ใน 2 วัน
4.3 (5 รีวิว)
2.5
2.5

เกี่ยวกับลูกค้า

ปักธงของ GREECE
Sandanski, Greece
4.9
87
ยืนยันวิธีการชำระเงินแล้ว
เป็นสมาชิกตั้งแต่ มี.ค. 7, 2005

การยืนยันลูกค้า

ขอบคุณ! เราได้ส่งลิงก์สำหรับเครดิตฟรีให้คุณทางอีเมลแล้ว
เกิดข้อผิดพลาดขณะส่งอีเมลของคุณ กรุณาลองอีกครั้ง
โลโก้ Freelancer Thailand / ภาษาไทย ช่วยเหลือและสนับสนุน FreelancerประเภทโปรเจคการประกวดFreelancerองค์กรแพ็กเกจสมาชิกโครงการ Freelancer ชั้นแนวหน้าการจัดการโปรเจคงานในพื้นที่Photo Anywhereหน้าจัดแสดงผลงานAPI สำหรับนักพัฒนาได้รับการยืนยันDesktop App เกี่ยวกับเกี่ยวกับเราวิธีใช้งานความปลอดภัยนักลงทุนแผนผังเว็บไซต์เรื่องราวข่าวออกสื่อทีมรางวัลข่าวประชาสัมพันธ์ร่วมงานกับเรา ข้อกำหนดนโยบายความเป็นส่วนตัวข้อกำหนดและเงื่อนไขนโยบายลิขสิทธิ์ข้อพึงปฏิบัติค่าธรรมเนียมและค่าบริการหุ้นส่วนEscrow.comLoadshiftWarrior Forum แอปโลโก้ Apple App Store โลโก้ Google Play
ไม่สามารถคัดลอกไปยังคลิปบอร์ดได้ โปรดลองอีกครั้งหลังปรับเปลี่ยนการอนุญาต
คัดลอกไปยังคลิปบอร์ดแล้ว
ผู้ใช้ที่ลงทะเบียน งานที่มีการโพสต์ทั้งหมด
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
กำลังโหลดตัวอย่าง
ได้รับอนุญาตสำหรับตำแหน่งทางภูมิศาสตร์
เซสชั่นการเข้าสู่ระบบของคุณหมดอายุและคุณได้ออกจากระบบแล้ว กรุณาเข้าสู่ระบบอีกครั้ง