在Linux系统下,开了200个线程分别curl同一个网站,结果程序爆错了,一堆。
出错信息:Couldn't connect to server
打开curl选项调试:
curl_easy_setopt(m_pCurl, CURLOPT_VERBOSE, 1);
也定位不了错误,后来发现200个线程,每次都有264个任务可以正常处理,而且程序的线程池会自动调度,空闲线程处理新任务,所以才会有264这个数字。
我访问的网站是在Windows创建的一个网站后台,经过询问,得知Windows的web服务器使用的是apache。
此时错误问题可以初步诊断为:apache的最大连接数导致的问题。
于是经过一番修改(修改方法还是国外的,google伟大):
原文:
It seems that the httpd-mpm.conf file holds the answer. But I'm not sure what settings should be changed or even what module apache is running as.
Answers:
The solution is to uncomment the MPM config include in httpd.conf
在httpd.conf文件中,打开该行注释,否则修改无效:
# Server-pool management (MPM specific)
Include conf/extra/httpd-mpm.conf
apache有2种模式:prefork和worker
通过执行:httpd.exe -l,结果里面没有prefork.c文件,说明本机的apache使用的是worker模式,于是就修改:
修改MaxClients值,重启apache服务,问题解决!
出错信息:Couldn't connect to server
打开curl选项调试:
curl_easy_setopt(m_pCurl, CURLOPT_VERBOSE, 1);
也定位不了错误,后来发现200个线程,每次都有264个任务可以正常处理,而且程序的线程池会自动调度,空闲线程处理新任务,所以才会有264这个数字。
我访问的网站是在Windows创建的一个网站后台,经过询问,得知Windows的web服务器使用的是apache。
此时错误问题可以初步诊断为:apache的最大连接数导致的问题。
于是经过一番修改(修改方法还是国外的,google伟大):
原文:
It seems that the httpd-mpm.conf file holds the answer. But I'm not sure what settings should be changed or even what module apache is running as.
httpd-mpm.conf:
- # prefork MPM
- # StartServers: number of server processes to start
- # MinSpareServers: minimum number of server processes which are kept spare
- # MaxSpareServers: maximum number of server processes which are kept spare
- # MaxClients: maximum number of server processes allowed to start
- # MaxRequestsPerChild: maximum number of requests a server process serves
- <IfModule mpm_prefork_module>
- StartServers 5
- MinSpareServers 5
- MaxSpareServers 10
- MaxClients 150
- MaxRequestsPerChild 0
- </IfModule>
- # worker MPM
- # StartServers: initial number of server processes to start
- # MaxClients: maximum number of simultaneous client connections
- # MinSpareThreads: minimum number of worker threads which are kept spare
- # MaxSpareThreads: maximum number of worker threads which are kept spare
- # ThreadsPerChild: constant number of worker threads in each server process
- # MaxRequestsPerChild: maximum number of requests a server process serves
- <IfModule mpm_worker_module>
- StartServers 2
- MaxClients 150
- MinSpareThreads 25
- MaxSpareThreads 75
- ThreadsPerChild 25
- MaxRequestsPerChild 0
- </IfModule>
- # BeOS MPM
- # StartThreads: how many threads do we initially spawn?
- # MaxClients: max number of threads we can have (1 thread == 1 client)
- # MaxRequestsPerThread: maximum number of requests each thread will process
- <IfModule mpm_beos_module>
- StartThreads 10
- MaxClients 50
- MaxRequestsPerThread 10000
- </IfModule>
- # NetWare MPM
- # ThreadStackSize: Stack size allocated for each worker thread
- # StartThreads: Number of worker threads launched at server startup
- # MinSpareThreads: Minimum number of idle threads, to handle request spikes
- # MaxSpareThreads: Maximum number of idle threads
- # MaxThreads: Maximum number of worker threads alive at the same time
- # MaxRequestsPerChild: Maximum number of requests a thread serves. It is
- # recommended that the default value of 0 be set for this
- # directive on NetWare. This will allow the thread to
- # continue to service requests indefinitely.
- <IfModule mpm_netware_module>
- ThreadStackSize 65536
- StartThreads 250
- MinSpareThreads 25
- MaxSpareThreads 250
- MaxThreads 1000
- MaxRequestsPerChild 0
- MaxMemFree 100
- </IfModule>
- # OS/2 MPM
- # StartServers: Number of server processes to maintain
- # MinSpareThreads: Minimum number of idle threads per process,
- # to handle request spikes
- # MaxSpareThreads: Maximum number of idle threads per process
- # MaxRequestsPerChild: Maximum number of connections per server process
- <IfModule mpm_mpmt_os2_module>
- StartServers 2
- MinSpareThreads 5
- MaxSpareThreads 10
- MaxRequestsPerChild 0
- </IfModule>
- # WinNT MPM
- # ThreadsPerChild: constant number of worker threads in the server process
- # MaxRequestsPerChild: maximum number of requests a server process serves
- <IfModule mpm_winnt_module>
- ThreadsPerChild 450
- MaxRequestsPerChild 0
- </IfModule>
Answers:
The solution is to uncomment the MPM config include in httpd.conf
在httpd.conf文件中,打开该行注释,否则修改无效:
# Server-pool management (MPM specific)
Include conf/extra/httpd-mpm.conf
apache有2种模式:prefork和worker
通过执行:httpd.exe -l,结果里面没有prefork.c文件,说明本机的apache使用的是worker模式,于是就修改:
- <IfModule mpm_worker_module>
- StartServers 2
- MaxClients 150 #最大连接数
- MinSpareThreads 25
- MaxSpareThreads 75
- ThreadsPerChild 25 #每个子进程的服务线程数目
- MaxRequestsPerChild 0 #单个子进程在其生命周期内处理的总请求数限制,当某个子进程处理过的总请求数到达这个限制后这个进程就会被回收,如果设为0,那么这个进程永远不会过期
- </IfModule>
修改MaxClients值,重启apache服务,问题解决!