On Thu, Nov 09, 2023 at 12:09:52AM +0100, Michael Niedermayer wrote: > Hi > > At around 8 o clock today there was heavy load on gitweb from the following > IP ranges > 27.44.204.*|27.44.125.*|27.44.122.*|14.17.95.*|14.17.85.*|120.233.114.*|120.233.118.* > > This caused eventually some process from our mail handling pipeline to be > killed and not automatically restarting. > Ive restarted the affected process once i noticed this a few hours ago. > > ATM it seems some mails are still missing, i hope they will all appear > within the next day or so > > If any server admins have seen similar, then suggestions to harden apache > and gitweb are welcome. > The user agent fields on these requests looked normal > And because these came from many IP ranges our per IP limit in mod_qos > did not stop it adequently Btw i like to remind people that we have more root admins than me, please ask Reimar and Alexander next time the server has an issue. Why? 1. load balancing and 2. if you look at MAINTAINERs i am not in the server emergencies category, i find this work quite stressfull thx [...] -- Michael GnuPG fingerprint: 9FF2128B147EF6730BADF133611EC787040B0FAB Concerning the gods, I have no means of knowing whether they exist or not or of what sort they may be, because of the obscurity of the subject, and the brevity of human life -- Protagoras