Consulting and Fix for Apache hanging once or twice a day

I'm running apache Apache/2.4.23 (Ubuntu) using worker mpm with php-fpm and occasionally apache will just hang for a few minutes. I will get a notification that the server is down and I will investigate and I don't see anything wrong. Error and Access logs don't show anything out of the norm. Server load is low, plenty of memory left, and if I run apachectl status on the cmd line to see the scorecard that will hang. Eventually it will load after a few minutes with the entire scorecard set to W, and the site will start loading again. This happens about once a day with a new server setup and I have a feeling its something to do with my mpm worker configuration. Does anyone know what could be causing this?