Nginx – magento php-fpm too many process

magentonginxphp-fpm

in the last 2 days, suddenly the server is very slow.
we are running magento, and we have seen 40-50 php-fpm process being run, each taking a few % of cpu, making performance very slow.
we have 2 servers, each 4 GB ram, for web and db.

using apc already, with 100% hit rate.
php memory limit 256M

php-fpm using max_children = 100, and max_requests = 1,000

can anyone please help explain why suddenly magento have 40-50 php process running?
(basically once we restart nginx and php-fpm, the no. of php-fpm process just jumps to 40-50)

please help. thx a lot.

Best Answer

Well, actually there is not enough information in this post to make any conclusions. As a guess I would suggest that your database got too big and having trouble processing all the queries thus page load time has increased which in turn increased the number of processes. Another guess would be that you ran a marketing campaign, or that you are being DOSed or any combination of the above.

Related Solutions

100% CPU when doing 4 or more concurrent requests with Magento

Magento is horribly slow when you disable caching.. more so on a vps since it has to parse a ton of XML files. The way it renders a page makes it very easy to add new things all over the page but it also calls for some massive sql queries and also loading xml files.

So you disabling cache means magento has to read those xml files on every request coming in. So each process is now competing for cpu and disk IO. On a vps disk IO is where your bottle neck will be 90% of the time. So 4 concurrent processes all asking to read a lot of xml files causing a lot of CPU wait on the apache processes.

if you do a strace on one of the apache processes as it renders a page in magento you will see all the xml it has to render.

I haven't touched magento in over 2 years but it was a nightmare to run a site with traffic so my company at the time ended up building their own software.

Nginx – Magento, NGINX, PHP-FPM, APC, MEMCACHED, 16gb Ram CentOS, Spiking PHP-FPM to 100% CPU

Try to adjust settings in your magento/app/etc/local.xml

<config>
    <global>
        <session_save><![CDATA[]]></session_save>
        <session_save_path><![CDATA[tcp://127.0.0.1:11211?persistent=1&weight=2&timeout=10&retry_interval=10]]></session_save_path>
        <session_cache_limiter><![CDATA[]]></session_cache_limiter>
        <cache>
            <backend>memcached</backend>
            <memcached>
                <servers>
                    <server>
                        <host><![CDATA[127.0.0.1]]></host>
                        <port><![CDATA[11211]]></port>
                        <persistent><![CDATA[1]]></persistent>
                        <weight><![CDATA[]]></weight>
                        <timeout><![CDATA[]]></timeout>
                        <retry_interval><![CDATA[]]></retry_interval>
                        <status><![CDATA[]]></status>
                    </server>
                </servers>
                <compression><![CDATA[0]]></compression>
                <cache_dir><![CDATA[]]></cache_dir>
                <hashed_directory_level><![CDATA[]]></hashed_directory_level>
                <hashed_directory_umask><![CDATA[]]></hashed_directory_umask>
                <file_name_prefix><![CDATA[]]></file_name_prefix>
            </memcached>
        </cache>
        <remote_addr_headers>
            <header1>HTTP_X_REAL_IP</header1>
            <header2>HTTP_X_FORWARDED_FOR</header2>
        </remote_addr_headers>
    </global>
</config>

Best Answer

Related Solutions

100% CPU when doing 4 or more concurrent requests with Magento

Nginx – Magento, NGINX, PHP-FPM, APC, MEMCACHED, 16gb Ram CentOS, Spiking PHP-FPM to 100% CPU

Related Topic