Find and resolve HTTP request bottleneck

ปิด โพสต์แล้ว 4 ปีที่ผ่านมา ชำระเงินเมื่อจัดส่ง
ปิด

We have a system which is checking proxy server uptime and experiencing an unexpected result after a recent server change. We need a server administrator that is comfortable with tuning PHP, Apache, PHP-FPM, MySQLi, and CentOS core. You as well need to be fluent with PHP multi-curl to understand how everything is working, in order to successfully resolve this issue for us.

Please note this issue is server config related, not software related.

The system uses PHP multi curl to select 20,000 nodes from the proxies and then process them in batches of 10,000. Requests are sent to our internal judge on the same server which returns information about the node that made the request.

The problem we are experiencing is that we are limited to the 10,000 batch. As we increase the batch amount, it's actually successfully checking less proxies. For example, with the 10,000 batch, the system might return 3,000 proxies that are currently up. If we increase that to a 20,000 batch, the system might find 500 proxies that are currently up, off the same exact data set which is surely not correct

On our previous server we could run batches of 100k without experiencing this type of issue but unfortunately, that administrator is no longer with us.

Any idea of what could be causing this issue for us? We are ready for immediate assistance!

PHP Linux HTTP cURL ผู้ดูแลระบบ

หมายเลขโปรเจค: #21844742

เกี่ยวกับโปรเจกต์

37 ข้อเสนอ โปรเจกต์ระยะไกล ใช้งาน %project.latestActivity_relativeTime|แทนที่%

freelancer freelancer 37 คน กำลังเสนอราคาในงานนี้ โดยมีราคาเฉลี่ยอยู่ที่ $34/ชั่วโมง

meet2amitvw

Dear employer hope you are doing well...Regarding project can we discuss more on this to get detail understanding about project ? As i am having some technical question on this so let me know when you get time to discu เพิ่มเติม

$35 USD / ชั่วโมง
(173 รีวิว)
9.3
devexpertsteam

Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Befo เพิ่มเติม

$50 USD / ชั่วโมง
(103 รีวิว)
8.7
tangramua

Hello, I got acquainted with your requirements, I am sure that I can help you with this. The fact is that I am a co-owner of a developer company and I myself am a PHP developer, and I also have administrators who can h เพิ่มเติม

$35 USD / ชั่วโมง
(242 รีวิว)
8.5
gursukh

yes sure I can help you right now

$27 USD / ชั่วโมง
(406 รีวิว)
7.8
skynatstech

Hello there, Thameem here from skynats Technologies to help you. We have read and understood your project requirement and are happy to help you with HTTP request issue. We can start the work now and would require a d เพิ่มเติม

$40 USD / ชั่วโมง
(418 รีวิว)
7.0
srajbr

Hello, My approach would be to first check output of all the request. That way, we can find the error response. From then we can move ahead and take necessary steps. BTW what was your previous server specification and เพิ่มเติม

$40 USD / ชั่วโมง
(34 รีวิว)
6.5
MyAwesomeTeam

Dear Sir/Madam, I checked requirement and i think what you need is : + you need a server administrator that is comfortable with tuning php, apache, php-fpm, mysqli, and centos core + you as well need to be fl เพิ่มเติม

$40 USD / ชั่วโมง
(55 รีวิว)
6.2
milliard

and I am an expert in skills and My experience is 18 years. My hourly rate:$21/hr for this project. I can easily handle it. and My rate negotiable after discussion I will give you my final rate. message me....

$38 USD / ชั่วโมง
(35 รีวิว)
6.0
techdevs

Hi! I`ve started from landing pages + seo 5 years ago. Than grew to a high-load big data solutions. I can do any complexity for angular, node or any other platforms (e.g. Laravel or yii 2). Please let me know when we c เพิ่มเติม

$34 USD / ชั่วโมง
(12 รีวิว)
5.2
jinridong19713

Hi thanks for your posting. I have read your post. I am a expert who have many experiences in web design&development. In particular, I had great experiences in laravel&codeigniter&Yii&Wordpress&node.js&react.js&angular เพิ่มเติม

$25 USD / ชั่วโมง
(17 รีวิว)
5.0
ancientb

Hello, Im experienced in Linux system administration including Server Security and optimization. Ill be able to identify the reason of the bottleneck (or maybe exhaustion of the socket/ports?!) in order to allow the sy เพิ่มเติม

$26 USD / ชั่วโมง
(41 รีวิว)
4.9
CX330

Greetings, The problem you are experiencing is possibly there due to two reasons: 1. Curl might be timing out on requests and not showing any errors 2. If you are on Linux, the kernel could be dropping connections B เพิ่มเติม

$30 USD / ชั่วโมง
(11 รีวิว)
3.8
Tomshon

Hello, ⭐⭐⭐How are you?⭐⭐⭐ I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I would love to work on your project and I'm confident that I can give the res เพิ่มเติม

$38 USD / ชั่วโมง
(3 รีวิว)
3.1
athminteam

Hi, This is Vipin, an alumnus of IIT Kanpur. I have 6+ years of experience in customized software, web and mobile app development and has expertise in Android, iOS, Python, Magento, PHP, HTML, Java, Angular and Ioni เพิ่มเติม

$38 USD / ชั่วโมง
(3 รีวิว)
1.5
achievers24

Hi, Thanks for sharing your requirements here. I’m an Experienced Freelancer with a demonstrated history of working in the internet industry. Skilled in Core PHP, MySQL, HTML, CSS, JQuery, JavaScript. I have worked m เพิ่มเติม

$25 USD / ชั่วโมง
(2 รีวิว)
1.5
CanvasInfotech10

Hello Sir, I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results with my team of developers, designers, QA and Project Manager an เพิ่มเติม

$38 USD / ชั่วโมง
(1 รีวิว)
1.6
jack536

Hi, client. I'm professional full-stack web developer who have got 5 of experience on various kinds of projects. I am a expert in Custom PHP, MYSQL, WordPress, Drupal, Magento, Codeignitar, Angular JS, Web Services, No เพิ่มเติม

$25 USD / ชั่วโมง
(0 รีวิว)
0.0
FastAnswerSrv

Despite the fact that I have a low rating and I have no reviews at all. Nevertheless, I am a highly qualified professional and I am not a robot. :) Despite the fact that I use copy-paste, nevertheless I am not an artif เพิ่มเติม

$25 USD / ชั่วโมง
(0 รีวิว)
0.0