Web scraping vs data miningงาน
...and include a brief explanation as why you gave yourself that rating: 1. Wordpress plugins 2. SEO experience 3. Javascript 4. Node.js 5. Angular 16 6. API development 7. HTML / CSS 8. PHP 9. Python 10. ERP systems 11. Tailwind 12. TaigaUI 13. Chrome Extensions (please rate yourself and provide any examples you might have) 14. Google Add-on 15. Keyword research tool 16. Web scripts 17. AI / ChatGPT experience 18. Web scraping Next, please answer these "get to know you" questions: Why are you interested in this job/project? What's your favorite stack? How many & what other projects are you currently working on? Do you work with a team, agency, or as an individual? Why should I choose you? How can you make it better or different than keywor...
Build me a python script that scrapes products
I'm in need of an email scraper to build and expand my email list. Currently, my method of collection is manual, which can prove to be quite time consuming. Key Requirements: 1....website link. 4. A sample work of the same project of 100 emails must be done for awarding of the project. 5. You have to complete the sample work in 1 hour. 6. Only interested and skilled freelancers must apply. Ideal skills and experiences: - Extensive experience in building or working with email scraping tools - Proficiency in Google Sheets or other spreadsheet software - Strong understanding of web crawling techniques and web data extraction - Solid background in data management and data cleaning This project will greatly improve the efficiency of building ...
...updates for an offline 3D game originally created with Unity. Here’s what I’m looking for: 1. **Additional Levels:** The game needs to grow as the player progresses. I want to increase the number of levels to keep it exciting and challenging. 2. **Enhanced Gameplay:** There’s always room for improvement. I seek enhancement to make the gaming experience smoother and more interactive. 3. **Player vs AI:** Let's add another dimension to this offline game. I'd like to introduce an AI mode where players can compete against computer-controlled characters. The updated version is intended for Android, so I need someone with experience optimizing for this platform. Ideal candidates should have a strong background in game development using Unity, solid...
...intraday, a new trade can be initiated if the price crosses back above todays signal (x) this is treated as a new trade. • Only 1 "trade" can be open at anyone time (consisting of the the (n) contracts). • I use an hourly timeframe for analysis, but the entries and exists must be at the defined values above (not the close of the bar. This is very important (as results will vary if I use a 5 min vs a 1 hour bar chart). • If I change the intraday timeframe from 1 hour to 5 mins (for a granular view of the chart), there should be no change to the strategy results, the strategy should function the same at 5 mins as 1 hour as the entry and exit values above are all fixed/absolute. Additional development work may be available pending the successful outcome...
I urgently require a robust and efficient email scraper to compile an extensive database of business emails from various websites. Thi...email scraper to compile an extensive database of business emails from various websites. This database will serve as a critical resource for my business operations, and as such, I need it as soon as possible. The ideal professional for this project should: - Have extensive experience in building email scrapers or relevant data extraction tools. - Be proficient in scraping websites quickly and accurately with minimal errors. - Understand privacy guidelines and ethical scraping practices. - Be able to scrape and deliver 100 emails as a sample project before getting selected for the project. - Be able to deliver the project promptly...
...Define tables for categories and any other relevant entities. 3. **Choose Technologies**: - Select appropriate technologies for building the website and managing the database. - Consider using a web framework like Django or Flask for the website, and a database management system like PostgreSQL or MongoDB for the database. 4. **Develop Data Ingestion Pipeline**: - Implement a data ingestion pipeline to continuously fetch new AI tools from various sources. - This pipeline could involve web scraping, integration with APIs, or manual data entry, depending on the availability of data sources. 5. **Implement Indexing and Categorization**: - Develop algorithms to automatically categorize new AI tools based on their attribut...
I require a savvy writer who's adept in crafting both technical reports and engaging blog articles on key aspects of mining, geared towards junior mining companies in Australia. Industry proficiency is highly crucial, with a strong emphasis on safety, mineral exploration, and environmental impacts. Given each article's breadth, an 800-1200 words count is deemed perfect. Favored skills include: * Comprehensive knowledge in mining * Proficient in technical and blog writing * Familiarity with Australian junior mining companies.
...to convert 70 Figma pages into a application while integrating Python web scraping bots, it is integral for me to hire a full-stack developer who exhibits extensive skills and experience in both frontend and backend development. Key Details: - Frontend: I require a developer well-versed in translating Figma designs into a functional application. - Backend: The chosen developer will need to seamlessly integrate Python web scraping bots. - Other Skills: Proficiency in NestJS, Fastify, PostgreSQL, and Python is a necessity. Deliverables: - The final product should be a cloud deployed application. - The project's backend should facilitate the smooth functioning of the Python web scraping bots. - The frontend, true to the origina...
โปรดลงทะเบียน หรือเข้าสู่ระบบ เพื่อดูรายละเอียด
...about clearances and effort - we mutually agree to effort - we assign you the task after mutually agreed - you implement, test and deliver - you provide also unit /integration tests to ensure code is always working - you document each required step to make interaction of systems to work - we test on our premise (you maybe help to fix issues) - we pay (basically the rules of freelancer) Closed book vs open book? We work only on open book. Closed book means you are unwilling to define a WBS for the work and you add only a price tag to the task. We are sorry we will not hire you in such a case! Deliveries? - in our on premise (access will be granted to you) - full sources - new plugins, need prior confirm and we prefer to use mostly latest stable versions - your changes are work...
...main function would be to systematically scrape data from Google Maps as well as various eCommerce platforms. While the exact data to be scrapped and the main purposes of doing so haven't been defined yet, I believe someone with the correct skills set would easily navigate through the process once those details are clarified. Additionally, you might be provided with a list of specific websites or regions or be asked to scrape from any website or region, details of which are currently undefined. Hence, adaptability will be a key trait for succeeding in this project. Ideal Skills: - Proficiency in Python - Experience using Scrapy, Beautiful Soup, and Selenium - Knowledge of Google Maps api, Telegram API, and WhatsApp API for data scraping purposes ...
...proficient developer to construct an API and website for downloading the master data of the latest companies from www.mca.gov.in. The API should allow the master data to be downloaded in a CSV format. Skills needed include API development, automation, and web scraping. Deliverables include: - A well-structured API for accessing and downloading the latest master data. - An intuitive dashboard to easily monitor the downloaded data. Experience in dashboard creation is necessary. The API should be able to fetch the following details from the master data: - Company Name and Address - Directors' Details - Shareholders' Details - Contact info - Email Strong understanding and experience with API development, data scraping...
I'm seeking experienced web scraping specialists to develop and execute a scraper for the Myntra website. This project involves gathering precise data about product prices and specifications from all categories on the site. Your responsibilities: - Develop a robust web scraper tool - Extract and deliver accurate product price data - Extract detailed product specifications - Ensure all categories at Myntra are thoroughly covered Ideal candidate: - Prior proven experience in web scraping - Excellent knowledge of python or similar programming language - Familiarity with Myntra or similar e-commerce websites A successful completion of this project would potentially lead to more web scraping tasks in the future.
Looking for a simple order management system to initiate and fullfil the order. Only require below Modules: 1. User Module (around 10 users). 1 Admin and 9 Users. 2. Order Module - User will initiate the order. Admin will review the order. Will update the quantity. And mark as fulfilled. And will ...fulfilled. And will mark whether the payment was received or in due. 3. Notification Module - We have API and WhatsApp template ready from interakt. Technically need to invoke this Whatsapp API to trigger the notification when order was initiated and order was fullfiled. 4. Report to display the list of orders - pending vs fulfilled. orders - paid vs pending. Thats it. Very low budget. Can use php, mysql. or flutter with firebase. Mobile responsive design for end user. ...
...about clearances and effort - we mutually agree to effort - we assign you the task after mutually agreed - you implement, test and deliver - you provide also unit /integration tests to ensure code is always working - you document each required step to make interaction of systems to work - we test on our premise (you maybe help to fix issues) - we pay (basically the rules of freelancer) Closed book vs open book? We work only on open book. Closed book means you are unwilling to define a WBS for the work and you add only a price tag to the task. We are sorry we will not hire you in such a case! Deliveries? - in our on premise git (access will be granted to you) - full sources - multiple samples of pages to run your unit tests against - bash (and tools like npm, bower, as prior a...
I am looking for a detail-oriented data expert for a research task. The project requires researching and compiling a list of tractor tyre companies located in the Western Cape using Google.co.za. The research should focus on finding accurate and up-to-date: - Contact Details: - Phone numbers - Email addresses - Physical addresses. It's essential to ensure that the information provided relates to the main office of the companies. Please verify the contact details before adding them to the list to ensure accuracy and reliability. Ideal Skills and Experience: - Experience in data mining and internet research - Detail-oriented and committed to accuracy - Familiarity with Google Search tools - Knowledge of the tractor tyre industry would be beneficial but no...
I am looking for a skilled expert in email mining who specializes in gathering email addresses and extracting specific email content. This project will focus on the education sector, and the required information from the mined emails includes the date and time, as well as the subject lines. Key requirements: - Proficient in email mining - Experience in extracting email content - Understanding of privacy laws and ethical guidelines in email mining - Knowledge of or experience in the education sector This task requires someone with great attention to detail, as accuracy is paramount.
I'm experiencing unidentified issues with a Python script that I'm currently running. I need help in identifying and fixing the issues, as the script isn't functioning as expected. The task will include: - Assessing the script to determine the core problem - Remedying the script to ensure appropriate output and error-free operation - Providing a brief r...Troubleshooting and fixing scripts While you don't necessarily have to provide a detailed project proposal, showcasing relevant past work and experiences will very much appreciated. I want to be confident that you know Python and script fixing. As to the purpose of the Python script - I will provide more details once I have chosen a freelancer for the job. However, skills in data analysis, automation and ...
I need competent and reliable individuals proficient in Excel and web-scraping to gather and input text data into an Excel document. This task requires: - Extraction of text data from various online websites - Organizing the entered data alphabetically for convenience - Strong attention to detail ensuring no error is overlooked Prior experience in data extraction from websites and Excel data entry is highly favored. Quick turnaround time is a bonus. Let's streamline this data together!
Technology: Technology must be feasible for scraping big data, the said scraping tool should not be hanged, we are using with .net, or python Technology based some tools etc. You can also suggest some others based on the best fit for our case. Tool should not be hanged. I need an expert in web scraping tools to automate a repetitive task for me. The website to scope is PubChem (). Key Requirements: Please also refer attached excel Data can search by keyword provided in excel. 1. Chemical Name - e.g. Sitagliptin 2. IUPAC Name - e.g. N,N-Diallyl-2-chloroacetamide 3. CAS RN. - e.g. 93-71-0 Note: 1. Only first best match, we need to collect, and out all searched compounds retrieve entries, we need 2. This file should be saved with GBRN+PubChem...
I'm in need of an experienced Python developer to create a program w...effectively organize these reports into folders by date and month for ease of access. Key project requirements: - Handling Duplicates: Any duplicate reports should simply be renamed, ensuring no data is lost or overwritten. - Report Format: The reports should be delivered in CSV format, validated for consistency. - Error Handling: If a report fails to download, the program should attempt to redownload it. Desired skills and experience: - Proficiency in Python programming - Familiarity with web scraping and downloading files - Ability to incorporate exception handling in code - Experience with data organization and CSV formats. The aim is to automate a consistent daily download with...
I am looking for an experienced data scraper who can extract specific text content and images from a moderately complex website. The freelancer must have a good understanding of web data extraction and the necessary tools to do so in an efficient and effective manner. Key Responsibilities: - Scraping text content and images from specified website - Ensuring the integrity and accuracy of the data scraped Ideal Experience and Skills: - Proven past experience in data scraping - Familiarity with scraping moderately complex websites - Advanced knowledge of data extraction tools and methodologies - Attention to detail and commitment to data accuracy Freelancers interested in this job should include examples of their past wo...
I'm in search of a highly skilled and experienced Python programmer who is proficient in leveraging the Selenium library for both web scraping and test automation. Your role will involve: - Implementing web scraping tasks with a focus on dynamic web pages - Designing and writing automation scripts for a variety of testing scenarios Since the specifics of websites and information for the web scraping task have not been detailed, I will need you to be adaptable and willing to work closely with me to identify the requirements as the projects unfold. Although I don't have a stringent time frame for the completion of the project, I am looking for someone who can steadily devote time to the project. Ensuring the quality of work is no...
I'm in need of a talented coder or data mining specialist capable of creating an esteemed script for a daily login, data mining and extraction of details from a government RFP listing site. The specifics of the mined data should include: - RFP Titles - Relevant Contact Information - Bid Due Dates The successful execution of the task would include the automation process, which gathers this data without manual intervention, and automatically updates the acquired details into a Google Sheet daily. Ideal Experience: - Background in coding and data mining - Proficiency in Google Sheets or similar spreadsheet software - Familiarity with governmental RFP listing sites - Prior experience in web scraping and data...
...productos en línea. Quiero que los usuarios puedan visualizar los productos disponibles en los supermercados asociados a la plataforma. - Incorporar funcionalidad de "Scraping". Esto con el objetivo de obtener precios y disponibilidad de productos en tiempo real, acceder a ofertas y descuentos, y comparar precios entre diferentes supermercados. El objetivo principal del scraping es permitir a los usuarios obtener el mejor precio para los productos que buscan. Idealmente, el candidato debe tener experiencia en Flutter Flow, desarrollo de métodos de pago, manejo de base de datos de productos, y haber trabajado con web scraping. Se valorará experiencia en plataformas de compras o de supermercados. presupuesto 70 dolares...
...Description: We are seeking a skilled web developer to create a server-side solution that interacts with an external insurance company's premium calculator web page. The primary objective is to extract calculated premium data from the insurance company's web form and display this information on our own website seamlessly. Project Requirements: Data Extraction: Develop a script or application that can send requests to the insurance company's premium calculation page, simulating form submissions with various user inputs. This script should be able to parse the resulting HTML page and extract premium information from a specific HTML element identified by its class attribute. Integration with Our Website: Implement the functionality to dis...
I am seeking a competent data miner to construct a comprehensive database that includes various sports clubs around the world and their relevant recruiting contacts. The sports to be included are Soccer, Basketball, Tennis, Baseball, Football, Volleyball, Rugby, Hockey, Lacrosse, and Softball. This project specifically requires contact information for professional clubs exclusively, no amateur clubs. To be included in the database for each sports club are the following fields: - Email - Phone number - Social media handles - Scouting Department - Director of Player Personnel - Head Coach/Coaching Staff - Player Development Director - Academy Coaches/Youth Development - General Manager/Sporting Director - Player Agents/Representatives - Club President/Board of Director ...
Preciso melhorar o processo de scraping no meu projeto atual. Para isso, busco um profissional que possa me ajudar a integrar o ScrapeOPS com o framework Playwright em Python, com o foco principal na melhora de eficiência deste processo. O principal desafio deste projeto será implementar mecanismos que permitam alterar o IP do bot para possibilitar mais requisições. Isso exigirá o uso de proxies para mascarar o IP do bot, o uso de uma VPN para alterar o IP do bot, ou talvez até mesmo a configuração de uma rotação de IPs a cada requisição. Algumas habilidades e experiências que seriam úteis para este projeto incluem: - Experiência com Python, particularmente o uso do framework Pla...
I'm in need of an expert well-versed in web scraping to purposefully extract specific data from the Adidas website. Specifically, you'll be tasked with the following: - Extricate product specifications from various items across the site. Ideal Skills: - Proficient in web scraping specialized tools & software. - Great attention to detail to ensure accurate data extraction. - Knowledge about sports apparel would be a plus. Experience with the Adidas website or similar projects will be highly appreciated. This project will require precision and efficiency, and I look forward to working with someone who can deliver exactly what I need in a timely fashion.
...for an expert in web scraping who can extract price information from key wholesalers' websites in Spain. The primary focus of this project is to collect pricing information for a specific liquor brand from online platforms. The Ideal Candidate Should Have: - Extensive experience in web scraping, specifically with e-commerce or wholesale websites - Fluency in Spanish language is a plus, to better navigate through local sites - Proven skill in handling and organising data Scope of Work: - Identify key Spanish wholesalers that sell Hierbas - Extract and compile pricing information from the identified websites into a structurally organized database - Ensure data integrity and accuracy through validation processes Please note, only freelan...
I am seeking an experienced freelancer who can provide web scraping services for a specific website — KPMG LPGA Performance Insights. Your main responsibilities for this project will include: - Scraping text content from the website, with a particular focus on tables - Ensuring accuracy and completeness of the extracted data - Delivering the scraped data in a structured and user-friendly format, also providing the original Python code The ideal candidate should have: • A strong background in web scraping, particularly with websites of a similar complexity • Proficiency in tools used for web scraping • An acute attention to detail to ensure the extracted data's accuracy I am expecting detailed bid...
I'm seeking an expert data miner to compile a list of valid emails for CEOs, CFOs, Human Resource Executives, and Account Managers across five industries: Technology, Healthcare, Manufacturing, Oil and Gas, and Real Estate. Here's what I need: - Verified Contact Information: These must be valid emails. Any bounced emails are not acceptable. - Industry-Specific Contacts: Focus on gathering contacts from the aforementioned industries. - Business Development Purpose: The primary use of these emails will be for business development purposes, so the data needs to be reliable. Ideal Skills & Experience: - Data Mining: You should have significant experience with data mining or information retrieval to ensure the validity of the email...
I am in need of a skilled web scraper who specializes in extracting product information from e-commerce websites. The chosen professional will be adept at finding relevant and useful data, focusing on details that will help me further understand the current product landscape. Top priorities for Success: * Competence in Web Scraping: You need to demonstrate a deep understanding and capability in web scraping. Experience with scraping e-commerce platforms is especially desirable. * Showcase of Past Work: I want to know you can handle this task, so a demonstration of your past work in a similar field is paramount. Please provide examples where you successfully scraped product information from websites. Scope of the project: * Identify and...
...detailed research which requires data sources that will provide me with in-depth historical data of buildings, architectural details and building usage particulars for buildings in Austria. The main purpose for seeking these data sources is to: - Understand historical data of Austrian buildings - Gain comprehensive knowledge about various architectural details - Scrutinize the different building usage patterns These data sources will play a crucial part in my research as I am planning to build machine learning prediction models. In doing so, I am aiming to analyze trends and patterns, compare architectural styles and study building usage patterns based on the obtained data. Ideal candidates for this project would be those who have a vast know...
I need assistance developing a C# web scraping automation.
I need an expert developer to construct an advanced movie searc...efficiently scrape movie databases for movie information. - Ensuring seamless redirection to a video player app for movie playback on user's demand. - Integrating a functional download feature that permits users to download and store movies in their galleries. Essential Skills and Experience: - Proven experience in bot development and application programming interface (API). - Proficiency in database scraping and management. - Expert knowledge in developing seamless and user-friendly UI. - Previous work on similar projects will be a major plus. - Strong problem-solving abilities and attention to detail. - Ability to deliver this project within a given timeline and budget. For more information please contact ...
...needs heavy data scraping from multiple websites, I'm eagerly searching for an Octoparse expert. Understanding of how to evade common hurdles such as captcha challenges, data extraction errors, and website blocking will be beneficial. Even though I didn't specify any particular issues, it'd be beneficial for the freelancer to have knowledge in those areas to tackle any unforeseen challenges. I have up to five different websites that require data scraping. The data I am particularly interested in would be text information and images. So expertise in extracting such data would definitely be a plus for this assignment. The candidate applying for this task should be an expert in Octoparse, with demonstrated experience in ...
...can effectively scrape data from Website 2. Here are the specifics. - Extracted Data: Unfortunately, I neglected to specify the data in the questionnaire, but I am expecting to discuss this in more detail once we begin the project. Here's what I have in mind: - User Data - Product Listings - Metadata Considering this, the ideal candidate for this project would: - Possess a proven track record in web scraping, especially with handling complex and large-scale data extraction tasks. - Have a strong understanding of the terms of use of different sites, ethical web scraping practices, and cybersecurity concerns. - Have the ability to handle possible site structure changes, should they occur during the project. - U...
Hi there! I urgently need a professional to scrape and extract data from specific websites. Then need to be organized and delivered in a timely manner. Given the urgency, preference will be given to talents who can deliver quickly without compromising the quality of work. Thanks
...market researcher who's savvy in the mining industry. Your main responsibility involves creating a list of mining companies that have underground mine operations here in Western Australia, specifically targeting gold as the main commodity. Through that list of operators, generate a suitable list of potential contacts for a targeted sales channel. Here's what I expect: * Market Research: I would like to compile a list of active underground mines here in Western Australia targeting gold as a commodity. * Contact Lists Compilation: As part of your job, you will compile a contact list. I'm specifically interested in contacts with specific job titles. Your ability to sieve out these specific titles will be instrumental to this project. Experience in the mi...
For this project, I'm seeking an expert who can accurately and efficiently scrape product data from industry-specific websites. The information should include: - Product Name - Product Specifications - Contact Details - Date - Price A successful freelancer for this job will have considerable experience in web scraping, especially with industry-specific websites, using tools like Octoparse. You should know how to navigate complex websites, extract the specific data as per the requirement, and organize it for easy interpretation and use. Please ensure that you adhere to all legal and ethical standards for web scraping.
Estoy buscando un desarrollador que realice un script para que de una forma periódica realice un scraping de la reseñas de Google de 5000 empresas y las actualice en la ficha de cada empresa en un directorio. La idea es que esas reseñas estén actualizadas semanalmente . La web del directorio está montada bajo Wordpress y con el plugin site reviews, sería realizar un script o plugin que realizase el escrapeo e importación a la base de datos de site reviews. Actualizando con las nuevas reseñas que hayan cada semana . Gracias
I need an adept web scraper with experience in extracting specific data. - The target for data extraction is Website A. - The specifics I'm interested in are the name, phone, URL, city, state, and occupation. - There are no specialized requirements or filters to apply when scraping data from Website A. Ideal Skills: - Strong background in Web Scraping tools and methodologies. - Ability to deliver accurate and clean data. - Experience with large data sets is preferred, but not necessary.
I'm looking for a skilled and reliable coder who can help me scrape tables of data from designated websites. The project will involve the following: - Scraping data from Websites that I will provide. - The data I am interested in is found in tables across these websites. - The results of the scraping should be formatted in CSV format. Required skills and experience: - Intense understanding of web scraping, with proven expertise in scraping tables specifically. - Proficiency with coding, with the ability to navigate a variety of websites effectively. - Experience working with formats such as CSV to store and organize information. Ideally, the freelancer should have a keen attention to detail as the scraping needs to...
Hi there! I urgently need a professional to scrape and extract data from specific websites. Then need to be organized and delivered in a timely manner. Given the urgency, preference will be given to talents who can deliver quickly without compromising the quality of work. Thanks
I'm seeking an expert data miner to compile a list of valid emails for CEOs, CFOs, Human Resource Executives, and Account Managers across five industries: Technology, Healthcare, Manufacturing, Oil and Gas, and Real Estate. Here's what I need: - Verified Contact Information: These must be valid emails. Any bounced emails are not acceptable. - Industry-Specific Contacts: Focus on gathering contacts from the aforementioned industries. - Business Development Purpose: The primary use of these emails will be for business development purposes, so the data needs to be reliable. Ideal Skills & Experience: - Data Mining: You should have significant experience with data mining or information retrieval to ensure the validity of the email...
Please see attached my CAD files from my patent applications. I need a couple of things: 1. I need to have the drawing revised to show the width of the tab portion being about 1/8" vs. the current 1/2" width 2. I need another drawing, but different dimensions. Body diameter: 4" Leg height: 1/4" Leg width: Same as initial CAD drawing Tab length: 1.25" (should be the full width of the body portion) Tab width: 1/8" 3. The last drawing, again same thing, different dimensions. Body diameter: 2" Leg height: 1/4" Leg width: Same as initial CAD drawing Tab length: 0.625" (should be the full width of the body portion) Tab width: 1/8" The drawings need to be done by someone who lives in the USA, preferably in Texas. Thanks
I am looking for meticulous freelancers who can accurately fill out a provided spreadsheet with detailed business data. This task requires manual effort and diligent research; automated web scraping is prohibited. A spreadsheet will be provided with a list of business names, locations and company website. I am missing information from the following fields that I need filled in: - Number of employees - Minimum spend or project size of their clients - CEO or Managing Director Name - Other key decision makers - Industry specialization (if applicable) There are 81 companies that need to be researched for the above data points on the spreadsheet. The data that needs to be sourced can be found by utilizing tools such as: - (free resource) - Google
