Prevent my RHEL 5.5 from going out-of-memory
I'm searching for a solution for that issue quite a time and didn't find any fulfilling one.
I've a couple of workstations running REHL 5.5 where several users work remotely using VNC or NX with local sessions.
Sometime some tools get crazy and start to consume all memory available resulting in the machine being not responsive or reachable any more.
Once the machine starts swapping - its over.
All solutions I've found so far limit the mem-usage per user.
And the oom killer seems not to be the right solution, because it kills random processes when running oom.
I'm searching for a solution which monitors the global consumption of physical memory and kills the process which is about to consume the last - lets say - 2 %.
Or something which preserves memory for the kernel so the machine stays reachable. Maybe its enough to prevent swapping?
Would be nice if I get some helpful advices.