Omega Owners Forum
Chat Area => General Discussion Area => Topic started by: TheBoy on 23 November 2013, 17:26:20
-
Sorry for earlier... ...and for what is still to come.
Its running like a sack of shite, needing 100% attention to keep it up, and will likley need another reboot this evening (full hypervisor restart, so a huge outage :()
-
Does that mean ive got to watch crap on tv this evening :(
-
Does that mean ive got to watch crap on tv this evening :(
No mate just log in to youporn ;D ;D
-
Wondered why i posted earlier and it timed out on me.....but the post still appeared when i refreshed....still goto take HollyDog for her walk now.....then cook my dinner....so poss i wont be back tonight...
Keep up the good work Jaime :y
-
Don't forget it is the day of the Doctor TB 8) 8) 8) 8)
Get him to use his sonic screwdriver on beast! :D :D :D :D ;) ;)
-
Don't forget it is the day of the Doctor TB 8) 8) 8) 8)
Get him to use his sonic screwdriver on beast! :D :D :D :D ;) ;)
Lizzie Lizzie Lizzie... TB will be the first to tell you all Drs are Gay.
And in this care he's right, for once. ;D
-
Don't fret TB, we're all used to things not running right!!! ::) We're Omega owners after all!!!! ;D
Thanks for your efforts, as I'm sure you had better things to do today! :y :y :y
-
Thank you for all the effort you put in running the OOF server and the best of luck in quickly finding and fixing the problems. :y :y :y :y
-
I can't see anything wrong with the bloody thing, yet clearly there is.
Trying to minimise disk activity across all the VMs so hopefully it will run through the weekend without falling over, and I'll take another look one evening in the week.
Some things that were noticed, but need resolving:
Array card firmware is out of date, with a controller lockup fix in the new firmware
Hypervisor is out of date
Lights Out controller firmware is out of date, security related, but not vulnerable.
All these need full hypervisor outages, which are long ones, as it takes a fair while for all the VMs to stop, and restart afterwards. Although, none of these I believe are the cause, as nothing has changed at hypervisor/hardware level.
-
Bloody hell, its tettering on the edge of going over again, wtf
-
It me again. Isn't it. :(
-
Fast here. I'm on a crappy 3G connection too!
-
Fast here. I'm on a crappy 3G connection too!
When its good, its very good. But all of a sudden, disk latency goes through the roof for no apparent reason, processes back up, it starts to swap, then its only a matter of time before it falls over.
-
Fast here. I'm on a crappy 3G connection too!
When its good, its very good. But all of a sudden, disk latency goes through the roof for no apparent reason, processes back up, it starts to swap, then its only a matter of time before it falls over.
It's probably tired, like a computer slows down and eventually stops. It's just had enough.
-
Needs one of those new Redberry Pi thingy's in there. :-X
-
Needs one of those new Redberry Pi thingy's in there. :-X
RPi doesn't have the legs to run the site, due to lack of memory and cpu grunt.
(thats a slight lie, it can run it with a fast Class 10 card, but is too slow to be useful once traffic ramps up)
-
Trouble is on a busy server once processes start stacking up, taking even more resources, it is on a path to nowhere. :o :o :o :o
-
Seems to have settled down :y
...hopefully I haven't just jinxed it. :(
-
Trouble is on a busy server once processes start stacking up, taking even more resources, it is on a path to nowhere. :o :o :o :o
Indeed, Rods2, once a Linux server dives into swap due to a disk i/o loading, the system will die fairly quickly, and Linux has a god awful desire to swap before releasing buffers.
Trouble is, I'm not sure what is causing the i/o latency to spike for reasonably extended periods. Disk throughput seems to be about normal just as it starts (but drops off, obviously, during the problem period).
Across the hypervisor, our baseline latency on the HP Smart Array is single digit, but will spike to over 100ms for 15mins or more, which certainly kills all Linux VMs, as they swap rather than release disk buffers, compounding it (though the OOF main server swaps to SSD, so has less impact to hypervisor). The Windows and Solaris VMs cope better.
I think the problem lays at the hypervisor level, as I've halved the amount of ram that the OOF server is allocated, and it seems to be far more stable, with only one brief alert (a slow response) overnight. But nothing has changed at that level. Hardware has been up since the fire, no updates to firmware or hypervisor have taken place....
-
If you need help with it just let me know. :y ;D ;D
-
If you need help with it just let me know. :y ;D ;D
Got any steel toecapped boots? Mine melted.
-
Funnily enough, yes I have a pair. :y Can also access a 14lb hammer. :)
-
Funnily enough, yes I have a pair. :y Can also access a 14lb hammer. :)
I was thinking more a branch, Faulty style....
-
I'm sure I can recommend someone to puke all over it, they will leave no crevice unsoiled :-X
-
I'm sure I can recommend someone to puke all over it, they will leave no crevice unsoiled :-X
O-oh. Imagine that in the back of a vxr8 taxi :o
-
Have you tried switching it off and......................
Ill get me coat!
Really well done TB. All your effort is appreciated :)
-
I'm sure I can recommend someone to puke all over it, they will leave no crevice unsoiled :-X
O-oh. Imagine that in the back of a vxr8 taxi :o
Rest assured, the type of work that car will be doing is worlds apart from some of the shit I put mine through :y