Started to get paged overnight, but my phone doesnt get great coverage, woke up at 4am and noticed the pages, the website was down, the whole farm. fun.
logged in from home and tried all the tricks, nothing. the actual webservers and the radware farm controller all looked fine. so i figured it must be a switch or something wierd like that. showered, into work at around 5am.
poked and proded and finally figured out it was probably the database. i blame lack of sleep and no caffeine for not spoting this earlier. sure enough the archive partition on the oracle server was full. moved off some old archives and stopped/started the TNS listnerer but the CPU is still pegged as oracle tries to do a backup. knowing its a touchy beast i haven’t tried anything else, will wait until the dba or someone with more oracle-foo gets into work.
i need to find a hard drive monitor/alerter for NT4.