Web scraping pythonงาน

I'm looking for a skilled Python expert who can help me with a data analysis and automation project that I plan to deploy on AWS cloud. The project has two main aspects that need to be developed separately but must work in harmony once completed. Key Requirements: - Python Data Analysis: You'll be responsible for creating a Python program that can handle data analysis tasks. The program should be able to process large datasets and generate meaningful insights from them. - Automation: The second part of the project involves creating an automation system that takes the insights generated by the data analysis program and automates the generation of reports and updates data in real-time. Ideal Skills and Experience: - Proficiency in Python programming -...

...Experience: Minimum of 10 years' practical experience in cybersecurity, preferably with recognized companies. Proficiency with various cybersecurity tools and programming languages. Expertise in identifying and mitigating risks, threats, and vulnerabilities. Technical Skills: Hands-on experience with Security Information and Event Management (SIEM) tools. Proficiency in Python, Linux, and SQL. Knowledge of CIA Triad, governance, risk analysis, compliance, and business continuity planning. Familiarity with Linux and Windows server configuration, Active Directory, network architecture, operations, and security. Experience in areas such as Wireshark, email security, wireless security, cryptography, port scanning, cloud security, an...

...looking to integrate my Mitsubishi CNC M80 with MT Connect using Python. This project has two primary goals: real-time monitoring of machine status and data analysis for performance optimization. Key Requirements: - Real-time Monitoring: The system should constantly monitor the machine's status (running, idle, error) and the spindle speed. Any changes in these parameters should be promptly detected. - Error Handling: If there are any errors or the spindle speed deviates from predefined thresholds, the system should send notifications or alerts to notify me. - Spindle Speed Adjustment: It should also be capable of adjusting the spindle speed automatically based on predefined thresholds. Ideal Skills & Experience: - Proficiency in Python programming. - Experience...

We are seeking a skilled PHP/Python developer to create a web-based solution hosted on an Ubuntu server that enables users to create Indesign documents based on existing InDesign templates then download the customized document. Please place a bid only if you are familliar with Indesign API Freelancers interested in this project should ideally have experience in: - Developing web applications. - Implementing high levels of customization in a web tool. - InDesign, especially its formatting features.

I am looking for a skilled Python developer to build an application that is capable of placing trades on multiple cryptocurrency exchanges, specifically Binance, Coinbase, and Deribit. Key Features: a Python application that connects to Deribit. It should allow me to: • Pull live instrument prices o Would want to be able to pull many instruments at once – I.e. every futures expiry for all listed currencies / All option strikes across multiple expiries • Pull my positions / balances / margin usage • Place / view / amend / cancel orders o Send multiple orders at once o Cancel specific orders o Cancel all outstanding orders • Record market / Position / transaction data Latency / Speed of execution is import...

I need a Python Expert to make correction on my code. I will share the code file on chat and will discuss about the budget and time. Thanks!

There is a need for an experienced developer who can swiftly develop a feature for file uploading and image editing, with capabilities like c...developer who can swiftly develop a feature for file uploading and image editing, with capabilities like cropping. The requirements for the project include: 1. File Uploading: Capable of managing various file types, ensuring smooth upload. 2. Image Editing: Should include an editing feature, with a particular focus on cropping for image customization. Ideal skills for this would be proficiency in Python, JavaScript, HTML, and CSS, with excellent knowledge of libraries and frameworks that can facilitate image processing. This needs to be completed as soon as possible, so a freelancer who can commit and provide quick yet quality work would...

i have py code and need to make winform using qt desinger because it visual and easy+modern to do i need someone have experiance with to integrate my py code in qt (design the form) the code is fully secret for the customer, so need to apply on screen shareLIVE

I'm looking for a tool or app to scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Bu...Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong understanding of car ...

...for a Python expert who can assist me in setting up real-time video streaming and data transfer from Raspberry Pi 5 to a PC over a static network configuration. The project involves an underwater camera and sensor data. Tasks include: Supply Python client and server scripts on a PC and rpi5+camera over a static IP network connection. Using the picamera2 module to stream video to PC. The video is recorded on the PC (time stamp for file name), with text overlay on the video showing PC date and time. UDP for simple 2way communications of small 'hello world' type text strings between the RPI5 and PC. Happy to control everything from the python script on the PC at present with a simple window for viewing the video. No GUI required at present. You should hav...

I'm in urgent need of a mobile backend developer with profound experience in Python Flask. Your primary task will be to integrate and create APIs on my current database structure. - The API should be able to perform: data retrieval, data modification, and user authentication among others. - Your success in this project is highly dependent on your ability to work with a moderate complexity level of database structure. - I'm looking for someone who can start on this project immediately, as the urgency for the API integrations is high. Key Skills and Experience: - Proficiency in Python Flask for backend development - Proven experience in integrating and creating APIs - Ability to work with moderate complexity databases - Strong knowledge in data retrieval, modificati...

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intelligent data mining and competitive market analyses.

...Type: Full-time / Part-time Job Duration: 3 months Job Description: As a Full Stack Developer, you will be responsible for developing and designing front end web architecture, ensuring the responsiveness of applications, and working alongside graphic designers for web design features, among other duties. Roles and Responsibilities: • Develop front end website architecture. • Design user interactions on web pages. • Develop backend website applications. • Create servers and databases for functionality. • Ensure cross-platform optimization for mobile phones. • Ensure responsiveness of applications. • Work alongside graphic designers for web design features. • See projects through from conception to finished product. &...

Application code to implement Roomio as a web application in python. You will use the table definition posted at the end of this document.

Scrape license data from the FL DBPR website and deliver into an excel spreadsheet. Two counties: Osceola and Polk. Two license types: Vacation Rental - Dwelling and Vacation Rental - Condo. In the attached spreadsheet the required fields to identify the license type and county are shown in screenshots and the second tab as an example. The extracted data is then to put into tabs for each county and license type. Multiple rental locations for a primary name should have multiple entries (rows) with the license details repeated and only the rental location being different each row. There maybe some dynamic features in the website that complicates data extraction. Website:

I'm looking for an expert in Django to develop an Enterprise Resource Planning (ERP) system that consists of three main modules: Acutally there are some as follow but everything is in dotnet and I have to convert it into django. 1. Inventory Management 2. Sales Management 3. Human Resources Management Ideal skills for the job include experience in Django, Python, and ERP system development. The system should support 10-50 user accounts. In addition, specific reports need to be generated for each module that includes: - Sales forecast report - Inventory status report - Employee performance report A solid understanding of business operations, particularly Inventory, Sales, and HR management is highly desirable. The successful freelancer will have a keen attention t...

I need a Python code that can detect and count objects on the ground. Key requirements include: - Detecting and counting objects on the ground, concept similar to crowd counting. - Providing a reliable count in, as well as evaluation. Deep learning based counting would be helpful. Ideal freelancer for this project should have: - Proficiency in Python - Experience with object detection algorithms - Knowledge of crowd-based counting systems

I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus o...scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical ...

... Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to extract the body of ...

I need a python supper expert who can do this simple apps for me. simple but complex. if you are supper expert then you can easily do it. i will give you in details in chat. thanks

I need someone to convert a specific function in Python, named GetServicesAreas, to Laravel. This function should be able to retrieve service areas based on countries, with a particular focus on the United States. Ideal Skills: - Laravel - Python - JSON - REST API Specific Responsibilities: - Extracting the function GetServicesAreas from existing Python code - Converting the extracted Python function to Laravel while ensuring complete functionality - The converted function should return service areas based on country parameter - Focusing specifically on the entire United States for function output - Conducting thorough testing to verify that the function operates correctly Experience: - A background in both Python and Laravel is essential - Experi...

I am in need of a skilled Python expert to transform a raw excel report into a final template version of excel. The project requires two main tasks: Formatting and re-arranging of columns along with calculation updates for one column. Key Points; - Need 3 open reports to pull the information and split the reports at the end. - Formatting Changes: The report needs specific columns to have pre-defined blank values for certain columns: Col B, E, J, R, W, AB, AE, AJ, AV, BG, BI, BJ, BQ, BU, BV, BW, BX, BY, BZ. - Calculation Updates: The calculation layer within the excel report needs to be updated and finalized. The ideal freelancer for this project should have a profound understanding of Python and extensive experience in manipulating and formatting excel reports. I am lookin...

Fixed bugs with iCloud website. Automation press button (2bugs only)

Hello and Thank you for being here Please see below code to read USERS from Keycloak using the api task: - Need to get REALM data for each user - Need to get GROUP data for each user We can do a 2nd Milestone if you like and we can talk about that together ----------------------------------------------------------------------------------------------- WORKING CODE TO READ USERS cat from keycloak import KeycloakAdmin admin = KeycloakAdmin( server_url="serverURL:port", username='admin', password='password', realm_name="master") print("current realm",admin.get_current_realm()) users = admin.get_users({}) if len(users) > 0: print("-------------------------------------") for user in users:...

Hello and Thank you for being here Please see below code to read USERS from Keycloak using the api task: - Need to get REALM data for each user - Need to get GROUP data for each user We can do a 2nd Milestone if you like and we can talk about that together ----------------------------------------------------------------------------------------------- WORKING CODE TO READ USERS cat from keycloak import KeycloakAdmin admin = KeycloakAdmin( server_url="serverURL:port", username='admin', password='password', realm_name="master") print("current realm",admin.get_current_realm()) users = admin.get_users({}) if len(users) > 0: print("-------------------------------------") for user in users: ...

...with legal and regulatory standards applicable to blockchain and trading technologies. Develop strong security protocols to protect users' data and transactions. Testing and Deployment: Perform comprehensive testing to confirm the bot's performance and reliability. Deploy the bot on a robust server environment, ensuring high availability and performance. Required Skills: Strong proficiency in Python or JavaScript, with substantial experience in blockchain application development. Previous experience with Telegram bots and API integrations. In-depth knowledge of the Solana blockchain's workings, including its transaction processes and fee structures. Familiarity with regulatory aspects of blockchain and trading technologies. Deliverables: A fully operational Tele...

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

We are seeking a skilled Web Developer and Graphic Designer to create a dynamic, user-friendly recruitment agency website targeting German employers. The goal is to design a site similar to but tailored to our specific needs, including custom graphics and a unique logo that represents our brand identity. KEY REQUIREMENTS Languages and Frameworks: - Frontend: Expertise in HTML5, CSS3, JavaScript, and experience with frameworks like React.js or AngularJS. - Backend: Proficiency in server-side languages such as PHP, Python, or Node.js, with database management using SQL or MongoDB. - CMS Experience: Capability to integrate and customize content management systems (CMS), preferably WordPress or Drupal. Design and Graphics: - Creation of a unique logo and custom graphics

I need an Excel 365 PowerQuery script that can fetch daily market data and handle potential data source interruptions or changes. I will be providing a URL that contains the market data, and you'll need to replicate the Google Sheets function =INDEX(IMPORTXML(" tags. Key requirements: - The PowerQuery should be able to be refreshed with the google sheet. - It needs to include robust error handling. If the data source is unavailable or the structure changes, the PowerQuery should not break but continue to function, ideally providing a notification that an error occurred. Ideal skills: - Proficiency in Excel 365 and PowerQuery. - Experience in web scraping and handling dynamic data sources. - Strong understanding of error handling techniques in PowerQuery.

I'm in need of a Node.js developer with a solid background in web scraping. If you've got experience in this area, I'd like to hear from you to discuss the specifics of the job. Key Requirements: - Proficient in Node.js - Experienced in web scraping - Ability to understand and implement scraping requirements - Good communicator Looking forward to hearing from you.

hi I'd need you again for a scraping job, please reply soon thanks

...seeking a skilled Python freelancer to assist me with a specific automation project. The task involves training video frames for bee detection. Key Tasks: - Train video frames for bee detection: I have a series of video frames that I need to analyze for bee presence. You'll be responsible for training the Python code to recognize bees within these frames efficiently. Goal: The primary objective of this automation task is to enable the Python script to accurately recognize bees within the video frames. The end goal is to achieve optimal object recognition. Ideal Candidate: - Proficient in Python programming - Experience in object recognition - Familiar with training video frames - Background in automation and data analysis If you have the necessary s...

I'm in need of a Cloud-based HPC system for a statistical analysis project. Key Requirements: If you have access to a HPC i need that service for a python code. lets talk about price

I am currently seeking a skilled developer to create an efficient bot for my new Twitter account. This bot is expected to fulfill the following functions: - Auto-follow users - Auto-like tweets - Auto-retweet tweets Moreover, these tasks should ...This bot is expected to fulfill the following functions: - Auto-follow users - Auto-like tweets - Auto-retweet tweets Moreover, these tasks should be performed every hour. The bot should be designed with a specific focus on male audience content themes. In terms of skills, the ideal candidate should have: - Demonstrable experience in bot creation - Understanding of Twitter API - Proficiency in Python, JavaScript or other relevant languages - Proven track record of creating social media bots in the past. I am looking forward to your ...

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

Функция обращается к AET, передает c-find запрос с StudyInstanceUID. Возвращает количество изображений в study. Собственно всё.

convert coordinates into url using webscraping python

I'm currently seeking an adept Python developer capable of crafting a bot designed to circumvent the Cloudflare protection of a specific website (details will be disclosed privately to the chosen freelancer). The bot should reliably bypass the protection consistently, as my attempts have yielded varied results, occasionally succeeding but often encountering 'Failure!' from Cloudflare. Efficiency in handling a large volume of attempts is crucial. If you possess the necessary skills and are up for the challenge, please get in touch. Ideal Candidate: - Proficient in Python, with experience in bot development - Familiar with CloudFlare's security measures and how to bypass them - Experienced in automated testing and website monitoring - Strong problem-solving...

I'm looking for a skilled developer to create Python-based modeling and simulation tools for UAV Swarms. Ideal candidates should have experience in Python and Machine Learning, as well as a solid understanding of industrial processes and systems. The tools should ideally offer real-time simulation capabilities, data visualization, and the ability to integrate with relevant software. A formal report of the project is required with the simulation and coding work. You may need to discuss these details with me once we get started on the project.

...a skilled Python developer to create an Ant Colony Optimization (ACO) algorithm that can read numbers in a matrix to calculate the shortest distance and its respective cost. Key Features: - The algorithm should respect origin and destination points, which will be indicated by specific row and column numbers. - Ideally, the code should be able to parse a .xlsx file format. Desired Skills: - Proficiency in Python programming language - Experience with optimization algorithms, particularly the Ant Colony Optimization algorithm. - Familiarity with .xlsx file parsing. I already have a basic code and can provide it to you as reference material; however, I need someone to improve and expand on this code to meet the requirements. It is essential for the proposed solution to u...

...talented developer with strong expertise in Python and options trading to create neutral trading strategies for me. The scope of this project includes: - Designing trading strategies primarily focusing on neutral approaches. It's critical that you're familiar with various trading strategies and especially skilled in applying neutral strategies. - The strategies should accurately consider option strike prices. An in-depth understanding of how option strike prices impact the trading outcome will be invaluable for the success of the project. - The complexity level required in this project involves developing multi-leg option positions. Therefore, experience and knowledge in creating such advanced strategy positions is a must. Advanced knowledge in Python, fina...

I want a python script that will check the balance of my four wallets inj1.... (injective blockchain), cosmos1.... (cosmos blockchain), osmo1.... (osmo blockchain) and juno1.... (juno blockchain) every 5 seconds. And in case the INJ balance increases, ATOM. OSMO or JUNO, then the entire balance will be transferred fully automatically to another wallet inj1...., cosmos1...., osmo1.... and juno1.....

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.

I'm in need of an expertly developed trading bot capable of purchasing a new coin as soon a...forthwith. Specifically, the platform targeted for this task is kucoin. Key Responsibilities: * Crafting a bot proficient in immediate buying and selling of newly listed coins. * Ensuring immense reliability and speed of the bot's functionality. * Ensuring that the bot is compatible with kucoin and open to future adaptations for other platforms. Ideal Skills and Expertise: * Versatile experience in Python language. * Previous exposure to developing trading bots. * Deep awareness of kucoin and other potential exchange platforms. Ultimately, the bot should advance my trading performance by maximizing profitability through quick purchases and sales in the volatile moments when coi...

I'm seeking a skilled developer to take my existing demo code and bring it to the next level. The application is web-based and is intended to automate the extraction of data from Word and Excel documents, and then compare the data for consistency. Key Responsibilities: - **Improved Data Extraction Accuracy:** The code should be enhanced to improve the accuracy of the data extraction process. The developer should implement robust methods to ensure that all necessary data is correctly captured. - **Enhanced Comparison Algorithm:** The comparison algorithm should be optimized to better handle the extracted data. The developer should ensure that the comparison is done accurately and efficiently. - **User-Friendly Interface:** The current demo code lacks a user-friendly interface. ...

I'm searching for a Python developer knowledgeable in numerical data analysis. The key task of this project will be developing a Python script for classifying images. This script will then need to perform advanced data visualization tasks on numeric data. Task would be to analyze a dataset containing different types of fish breeds Images and is required to classify them using CNN based on their location and chemical compositions in various parts of an ocean/location Ideal Skills: - Excellent grasp of Python programming - Strong understanding of image classification techniques - Proficiency in numerical data analysis - Expertise in data visualization methodologies Previous experience with projects involving Python, image classification and data visual...

I am in need of expert help to scrape text data from specified websites. After the data has been collected, the next step is to clean the data, ensuring that it is in t...collected, the next step is to clean the data, ensuring that it is in the appropriate format for use. The final output should be managed and stored in a Database Management System. The ideal freelancer for this project should have: - Proven experience in web scraping, specifically text data from websites - Advanced skills in data cleaning to ensure the data is usable and well-structured - Capabilities to manage and store the cleaned data into a Database Management System Please provide any relevant examples of previous work in web scraping and data cleaning and provide details about how you ...

I need a web scraping expert to help me get data from a third-party search site. The project is urgent and needs to be completed ASAP. Key Requirements: - Skilled in web scraping techniques - Proficient with tools for scraping - Able to work under tight deadlines - Excellent communication skills Please note that the specific search site is not mentioned, but the task involves scraping information from it. If you have the experience and can work quickly, please reach out.

I'm seeking a professional in Python with experience in computer vision, specifically with DVS 346 cameras. The goal of the project is to: - Detect human movements: Standing, walking, sitting, waving, jumping, running - Calculate the speed of detected movements The project will take place in an indoor environment. Ideal candidates should have: - Proficiency in Python - Expertise in computer vision - Experience with DVS 346 cameras would be a plus This is a unique project that requires attention to detail and an understanding of both human movement and computer vision principles. The ideal freelancer will be able to deliver accurate movement detection and speed calculations. I already have the DVS 346 camera for this project.