Nginx – PHP 100% cpu usage

nginxPHP

One of my php scripts (setup with php-fpm 7.0 with nginx) needs high cpu usage (legitimately) to complete. I would like it to take more time to complete, but leave the cpu available for other requests. Currently the server is not responsive while that script is running.

I could create some delays with PHP sleep(), but is there a more appropriate method for load balancing?

Best Answer

You might be looking for nice command in Linux/UNIX. Basically, what it does is running a command with a modified scheduling priority. PHP sleep() might not help if running task is heavy by itself - without repeating.

Related Solutions

Php – Need help trouble shooting high CPU usage by PHP-fpm

Try using strace -p 26721 to see what the process is doing. To see which file handle is which use lsof -p 26721.

Nginx + php-fpm – Each php-fpm process 70-100% cpu when running

A couple of things to consider (apologies in advance if you have already considered these): First of all, make sure to optimize your nginx config and invoke php-fpm only when absolutely necessary. The last thing you want to do is let php handle things like static HTML pages (which it will happily do).

Secondly, since you're using php-fpm, I suggest to be more aggressive with how long php-fpm's children are allowed to live. You need to find the sweet spot between shortly lived threads/children and stability. The php-fpm defaults are way too generous for any production system, IMHO. The longer a worker is allowed to serve requests, the more unstable it will get. There's also a higher risk of memory leaks, and if this framework you refer to has bugs like infinite loops, which may be causing you grief with CPU load, this shouldn't hurt.

I'd reduce the number for pm.max_requests for your production pools. I think the default is 200. I'd start from 50 and see where that takes you.

Failing/complementary to that, you could also try these global options (AFAIK they are all disabled by default):

emergency_restart_threshold 3
emergency_restart_interval 1m
process_control_timeout 5s

What does this mean? If 3 PHP-FPM child processes exit with SIGSEGV or SIGBUS (i.e. crash) within 1 minute then PHP-FPM is supposed to restart automatically. The child processes waits 5s for a reaction on signals from master.

Here's a nice overview of all the config options I mentioned here, as well as others: http://myjeeva.com/php-fpm-configuration-101.html

Hope these tips help you! Remember to tweak and observe, unfortunately there doesn't seem to be a rule of thumb for all this, as you observed, there are too many variables that affect PHP's behaviour and stability.

Finally, the CPU limiting facility you inquired about is documented here, but I'd only resort to it if you exhaust every other option. If you do choose this path, I'd definitely watch out for possible interactions between PHP-FPM tweaks and your limits.conf configuration. At that point etckeeper may be a lifesaver! :)

Good luck!

Rouben