Re: Buildworld Taking Very Long Time

On 6/30/24 18:03, Horse Radish wrote:
> The drives in question are ssd
> 
> 
> On Sun, Jun 30, 2024, 5:26 PM Ralf Mardorf <ralf-mardorf@riseup.net <mailto:ralf-mardorf@riseup.net>> wrote:
> 
>     On Sun, 2024-06-30 at 11:48 -0700, Edward Sanford Sutton, III wrote:
>      > Disk I/O taking longer than expected
> 
>     Shingled Magnetic Recording vs Conventional Magnetic Recording
> 

So, we've discovered the apparent cause and I thought I share with the class.

This is an older 4 core i5 server and it was starving for resources because ...

We appear to be increasingly under bot scraping attacks.  This was made worse
because our apache config didn't implement the mpm module to limit apache
resource consumption.  In effect, apache would try to take on as much works
as the public network could throw at it .... which gave us load averages
in the 17s and up.

The fix involved several things:

- getting the apache mpm module in place
- tuning its settings to severely limit number of processes and theads it could use
- ipfw blocking some obvious scanning abusers (looking at you degenerates at Facebook..)

So far, much, much better.  We'll see.