Omega Owners Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Please play nicely.  No one wants to listen/read a keyboard warriors rants....

Pages: 1 [2] 3 4  All   Go Down

Author Topic: Archiving Video - any ideas  (Read 2762 times)

0 Members and 1 Guest are viewing this topic.

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107048
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Archiving Video - any ideas
« Reply #15 on: 28 September 2009, 21:18:35 »

Quote
Quote
External HDDs by nature aren't a good long term storage medium.
I'll assume you are talking single drives?
Portable disks are inherently unreliable, so even using likes of ADG/R6, its still a probability, moreso if disks are left unused for long periods.
Logged
Grumpy old man

KillerWatt

  • Guest
Re: Archiving Video - any ideas
« Reply #16 on: 28 September 2009, 21:37:42 »

Quote
Portable disks are inherently unreliable, so even using likes of ADG/R6, its still a probability, moreso if disks are left unused for long periods.
A single drive is inherently unreliable, regardless of whether it's portable or not.
Although, as you rightly say, portable is even more susceptible to failure.

For an equal balance of capacity, redundancy, speed, reliability, and features...I'd be looking at RAID 5 minimum....although the OP may not have that much money.
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107048
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Archiving Video - any ideas
« Reply #17 on: 28 September 2009, 21:47:46 »

Quote
Quote
Portable disks are inherently unreliable, so even using likes of ADG/R6, its still a probability, moreso if disks are left unused for long periods.
A single drive is inherently unreliable, regardless of whether it's portable or not.
Although, as you rightly say, portable is even more susceptible to failure.

For an equal balance of capacity, redundancy, speed, reliability, and features...I'd be looking at RAID 5 minimum....although the OP may not have that much money.
If I was forced down the portable HDD route, I'd be looking at a system that as a minimum could cope with 2 simultaneous drive failures.  I've never seen such a 'portable' device, and if made from seperate cheapo disks, would lack any kind of central controller, probably relying on OS level software fault tolerance.  The built in ftdisk.sys in Windows is a hugely, cut-down, limited version of Veritas Volume Manager. VxVM is around £3.5k iirc, so 'cheap' disk solutions end up expensive.
Logged
Grumpy old man

KillerWatt

  • Guest
Re: Archiving Video - any ideas
« Reply #18 on: 28 September 2009, 22:31:06 »

Quote
Quote
Quote
Portable disks are inherently unreliable, so even using likes of ADG/R6, its still a probability, moreso if disks are left unused for long periods.
A single drive is inherently unreliable, regardless of whether it's portable or not.
Although, as you rightly say, portable is even more susceptible to failure.

For an equal balance of capacity, redundancy, speed, reliability, and features...I'd be looking at RAID 5 minimum....although the OP may not have that much money.
If I was forced down the portable HDD route, I'd be looking at a system that as a minimum could cope with 2 simultaneous drive failures.  I've never seen such a 'portable' device, and if made from seperate cheapo disks, would lack any kind of central controller, probably relying on OS level software fault tolerance.  The built in ftdisk.sys in Windows is a hugely, cut-down, limited version of Veritas Volume Manager. VxVM is around £3.5k iirc, so 'cheap' disk solutions end up expensive.
So if £800 bought you 6TB of storage, with hot-swap disks, guaranteed 100% redundancy, Web server, FTP server, Print server, 3x USB 2.0 ports, 1GB of onboard RAM, and only consumed 55W in use (among other things), while measuring 8" high, by 5" wide, by 9" deep...you'd be interested then?  ;D
Logged

eddie

  • Intermediate Member
  • ***
  • Offline Offline
  • Gender: Male
  • Cardiff
  • Posts: 352
    • View Profile
Re: Archiving Video - any ideas
« Reply #19 on: 28 September 2009, 23:15:56 »

Storing a video file as one big lump is Dodgy. Any part of it gets corrupted etc then its knackered.

By using .Rar and splitting it up you can use 'par' files to rebuild the broken bits if the recombining complains.
http://www.techsono.com/faq/par.html

In all fairness its main use is for transmitting large files over the net.

I should warn though,using an external usb drive is not foolproof-I recently lost a couple of films this way.

I didn't check to see if the transfer was fully intact before deleting the original!

eddie
Logged

Martin_1962

  • Guest
Re: Archiving Video - any ideas
« Reply #20 on: 28 September 2009, 23:31:09 »

Raw is 5 times bigger than AVI - I have handled it in the past but DV is good enough, and easier to handle, all edit packages and also encoders drop it down anyway.

Virtualdub (I think does raw)

For now sitting on drive D of my PC, as long as I am not doing any editing I will be OK.

Now thinking that archiving is a nightmare and perhaps making sure I still have a working SLF1 is more important.

Perhaps short term on D drive, when work is better buy a couple of SATA 1TB one external and one internal
Logged

Martin_1962

  • Guest
Re: Archiving Video - any ideas
« Reply #21 on: 28 September 2009, 23:58:37 »

On my 5th tape now, 130GB already on HDD.

The F1 is enjoying its long run of playback, not bad for video recorder of the year 1982.

Some nice shots of a GWR Pannier tank on screen while typing this
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107048
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Archiving Video - any ideas
« Reply #22 on: 29 September 2009, 18:36:05 »

Quote
Quote
Quote
Quote
Portable disks are inherently unreliable, so even using likes of ADG/R6, its still a probability, moreso if disks are left unused for long periods.
A single drive is inherently unreliable, regardless of whether it's portable or not.
Although, as you rightly say, portable is even more susceptible to failure.

For an equal balance of capacity, redundancy, speed, reliability, and features...I'd be looking at RAID 5 minimum....although the OP may not have that much money.
If I was forced down the portable HDD route, I'd be looking at a system that as a minimum could cope with 2 simultaneous drive failures.  I've never seen such a 'portable' device, and if made from seperate cheapo disks, would lack any kind of central controller, probably relying on OS level software fault tolerance.  The built in ftdisk.sys in Windows is a hugely, cut-down, limited version of Veritas Volume Manager. VxVM is around £3.5k iirc, so 'cheap' disk solutions end up expensive.
So if £800 bought you 6TB of storage, with hot-swap disks, guaranteed 100% redundancy, Web server, FTP server, Print server, 3x USB 2.0 ports, 1GB of onboard RAM, and only consumed 55W in use (among other things), while measuring 8" high, by 5" wide, by 9" deep...you'd be interested then?  ;D
Personally, no. Others may be though.

As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
Logged
Grumpy old man

KillerWatt

  • Guest
Re: Archiving Video - any ideas
« Reply #23 on: 29 September 2009, 19:49:32 »

Quote
As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
It's not that large J, and while we both know that 100% isn't possible in real life no matter what,......what do you think the chances are of 4 independant hard drives failing all at once?
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107048
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Archiving Video - any ideas
« Reply #24 on: 29 September 2009, 20:22:23 »

Quote
Quote
As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
It's not that large J, and while we both know that 100% isn't possible in real life no matter what,......what do you think the chances are of 4 independant hard drives failing all at once?
Seen 2 simultaneously fail in a 5 disk Raid 5 when a 3rd disk was being replaced. They don't believe it was electrical issue during hot withdrawal, but flex in the drive bay as the old drive was stiff.

Believe it or not, the server stayed up, and due to Netware caching, we copied off all virtually all of the data :o.


Not had too much luck with hot plug - I once changed a 500Mb disk in a Proliant, and HOT plug was apt - bloody thing started smoking, and the NetWare server promptly abended.  Couldn't recover diddly squat off that one  :-[

Went through a patch in the early part of millenium when temps were more critical that any glitch on environment control would wipe out 30 odd disks a day, sometimes on same array.

So, yes, it does happen ;D.  But I agree, very rare :y


But in Martin Imber's case, I was under impression he wanted a long term archive, and in that case, I simply wouldn't use disks - if you leave on, there is significant risk of corruption, if you switch off, you run high risk of drive sticking.



As an aside, it is most definately possible for 2 disks in a 2 disk mirror to break  :-X
Logged
Grumpy old man

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107048
  • I Like Lockdown
    • Whatever Starts
    • View Profile
Re: Archiving Video - any ideas
« Reply #25 on: 29 September 2009, 20:25:36 »

Quote
Quote
As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
It's not that large J, and while we both know that 100% isn't possible in real life no matter what,......what do you think the chances are of 4 independant hard drives failing all at once?
As an aside, I thought the Netgear stuff could only do R0,1 and 5, and max of 1 online spare?  Must admit, not looked for a while (pay little attention to Netgear, as don't have much faith in their firmware writers)
Logged
Grumpy old man

Martin_1962

  • Guest
Re: Archiving Video - any ideas
« Reply #26 on: 29 September 2009, 21:14:50 »

Quote
Quote
Quote
As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
It's not that large J, and while we both know that 100% isn't possible in real life no matter what,......what do you think the chances are of 4 independant hard drives failing all at once?
Seen 2 simultaneously fail in a 5 disk Raid 5 when a 3rd disk was being replaced. They don't believe it was electrical issue during hot withdrawal, but flex in the drive bay as the old drive was stiff.

Believe it or not, the server stayed up, and due to Netware caching, we copied off all virtually all of the data :o.


Not had too much luck with hot plug - I once changed a 500Mb disk in a Proliant, and HOT plug was apt - bloody thing started smoking, and the NetWare server promptly abended.  Couldn't recover diddly squat off that one  :-[

Went through a patch in the early part of millenium when temps were more critical that any glitch on environment control would wipe out 30 odd disks a day, sometimes on same array.

So, yes, it does happen ;D.  But I agree, very rare :y


But in Martin Imber's case, I was under impression he wanted a long term archive, and in that case, I simply wouldn't use disks - if you leave on, there is significant risk of corruption, if you switch off, you run high risk of drive sticking.



As an aside, it is most definately possible for 2 disks in a 2 disk mirror to break  :-X


Hmm so what is the answer then?
Logged

KillerWatt

  • Guest
Re: Archiving Video - any ideas
« Reply #27 on: 29 September 2009, 21:41:03 »

Quote
Quote
Quote
As for the 100% redundancy claim, we both know that is rubbish, particularly if used as a portable device (though getting a bit large to be portable)
It's not that large J, and while we both know that 100% isn't possible in real life no matter what,......what do you think the chances are of 4 independant hard drives failing all at once?
As an aside, I thought the Netgear stuff could only do R0,1 and 5, and max of 1 online spare?  Must admit, not looked for a while (pay little attention to Netgear, as don't have much faith in their firmware writers)
I bought my NV10's BEFORE Netgear got involved  ;)
Logged

KillerWatt

  • Guest
Re: Archiving Video - any ideas
« Reply #28 on: 29 September 2009, 21:43:43 »

Quote
Hmm so what is the answer then?
Given the amount of physical data you want to store, hard disk really is the only viable option if you are like most of us (average man, average wage, average family, etc).

However, I'd be using a second disk as a sole backup to the first one as an absolute minimum.
Logged

Martin_1962

  • Guest
Re: Archiving Video - any ideas
« Reply #29 on: 29 September 2009, 23:15:00 »

Quote
Quote
Hmm so what is the answer then?
Given the amount of physical data you want to store, hard disk really is the only viable option if you are like most of us (average man, average wage, average family, etc).

However, I'd be using a second disk as a sole backup to the first one as an absolute minimum.


Another Samsung drive when funds permit then.

Half tempted to spread it over a large number of DVDs - but would that kill my burner?
Logged
Pages: 1 [2] 3 4  All   Go Up
 

Page created in 0.016 seconds with 17 queries.