Data hoarders unite

>come over to /hsg/
Thank you, you have saved my life.
I have found my people.

Attached: tumblr_nlwvck3niG1tbiv8po1_540.jpg (600x600, 56K)

I call it a NAS but really it's just this old C2D motherboard running an NFS server on Debian. 12 drives in 6 mirror vdevs (ZFS), four are 6TB, the rest are 3TB. I'd like to give it some beefier hardware, maybe once Zen 2 gets here I'll buy one for my desktop and bump its X58 board down to this machine.

I tried to switch to Btrfs RAID5 but got too alarmed at shit I was seeing in dmesg. (including one time where everything blew up on unmount) That said, though, it didn't corrupt anything or even go read-only, despite things like three drives on a chink-shit SATA card disappearing in the middle of a balance, and my pulling the power cord during the aforementioned attempted unmount. It probably works and I just didn't have the stomach to watch how the sausage gets made.

And yeah, it's just Japanese porn. Strange fetishes entirely optional, though recommended.

i really need 8gb ssd to become cheap so i can retire my hdd

Anime isn't a real world.

The real world doesn't need recording.

>but got too alarmed at shit I was seeing in dmesg. (including one time where everything blew up on unmount) That said, though, it didn't corrupt anything or even go read-only, despite things like three drives on a chink-shit SATA card disappearing in the middle of a balance, and my pulling the power cord during the aforementioned attempted unmount. It probably works and I just didn't have the stomach to watch how the sausage gets made.
Daily reminder
ZFS is not backup.
Btrfs is ( most certainly) not backup (Btrfs = GPL fag dumpster fire version of ZFS super ultra pre-alpha YOLO you are the alpha testers edition).
RAID is not backup.

I have 2x 8TB where anything can happen to the 1x8TB drive and I can experiment.
Daily reminder you need 2 NAS servers or you have no backup.

And with backups you can do whatever you want reformat do shit.

You want me to tell you how to backup? Want to know this rare secret of what these magical backups are? Or is everyone in the know here?

Attached: tumblr_lr0idkVOyJ1r1hnb3o1_400.jpg (400x550, 49K)

>ssd
Why? HDD transfer speeds are enough.
Also HDDs have the benefits of:
>Will actually make physical noise if something is wrong.

I don't think flash technology will ever catch up to spinning discs.
Considering that a spinning disc has the potential to store data on the atomic level (1 atom on the surface = 1 bit)
At this point we can expect laser use on these discs.

Meanwhile there are inherent limitations to stacking chips however I'm opened to someone explaining this to me away.

Attached: 541056-samsung-ssd-internals.jpg (810x456, 34K)

>4TB spinning rust is still 100 euros
fuck this

>The real world doesn't need recording.
So what are you keeping in these plain text files?

Meanwhile normal people want simply turn on the camera and record their party or make photos of things.

Basically for me recording video should be on the same level like making TXT files and notes.

So 1 ZB HDD is the minimum to hold a lifetime of HD videos.
1 ZB for video is the same like 1 TB for TXT.
youtube.com/watch?v=chfruZxjkEk

Attached: zettabyte.jpg (473x631, 40K)

Yeah yeah, I've heard the lecture before. I don't have enough money to throw at keeping "proper" backups of my porn hoard. I do keep proper backups of more important stuff (that takes up far less than 14TB). But for this, I'm perfectly satisfied with plain redundancy and protection from bit-rot and drive death. Especially since if you combine it with snapshots (to get the "history" of a true backup) you're pretty much all the way there, the only thing missing is resilience against lightning strikes, the building burning down, etc.

Won't happen soon, all the flash makers are preparing to cut production to try and keep prices up.

People are afraid of refurb drives but they're significantly cheaper and usually just fine.

>spinning rust
spinning rust is a derogatory word that only SSD shills use.
The preferred word is spindle or HDD.

Attached: YndqdTs.jpg (653x726, 46K)

you can't grep a video

What do you keep in these text files?
Meanwhile we like to press a button and archive our life.

Attached: maxresdefault.jpg (1280x720, 344K)

>People are afraid of refurb drives but they're significantly cheaper and usually just fine.
I have no idea where I can get those in europe.

>all the flash makers are preparing to cut production to try and keep prices up.
That's capitalism for you milking a technology for profit and not giving the fastest progress possible.

Attached: 1cfd27c4b0fa326310652082723bd745--political-economy-political-art.jpg (500x424, 77K)

Call me when 4tb ssd doesn't cost like a new car.

> existence of the cpu companies
That's capitalism for you

also fuck poor people

My text files contain entertaining stories and instruction on various subjects. They can be easily and quickly accessed by a wide variety of tools. If you record the world around you, chances are that nobody, not even you, will ever access that data; you're just putting a lot of money and effort into a silly hobby.

There progress is already on full throttle, it can't go any faster. Big biz upgrades faster than any richfag, and they're willing to shell out retarded amounts of money for it, this drives the progress at a much faster rate than consumers who, first, don't constitute majority of sales, and second, can't afford to upgrade their $10000 computers every 6 months, or even to buy one to start with.

>of more important stuff (that takes up far less than 14TB)
Tell me how this looks for you.
I'm interested and I will draw my setup.
>I don't have enough money
This is a common issue also for me.

>Especially since if you combine it with snapshots
depends of where it physically lands.
If you are making "snapshots" on the same HDD where the same data is you have ZERO safety.
>to get the "history"
I tell you I don't play with this gay shit. My setup is solid however I can not normally go back in full history.
>is resilience against lightning strike
Semi works for me, never did have this problem its solved with using surge protectors.
You can throw my PC (its my archive) out of the window or infect it with ransomware and it will not even affect me seriously.
Because I have backups.
A lot of people have no idea what a backup is.
>the building burning down, etc.
This is for the ultra paranoid. You can get this with my setup if you want however I don't even bother if my home starts burning down I grab my HD and exit the house with it.

>also fuck poor people
I don't think you get it.
After you see it you can not unsee it.
Its basically like some Star Trek scenario (Ferengin VS Federation) only no parody or caricature can even hold a candle how fucked the real scenario is.
>also fuck poor people
Its actually bad for everyone. Yes you are a king only you are a king of shit.
>Plebs have only 1 apple and are starving
>I'm the king and I'm the riches man alive so I have 4 apples
>Yes this is great success! I'm winning! I have wealth! I'm rich! 4 apples is more then any human can ever have!

So lets now see how this looks in reality SSD capitalist decides to milk the technology and stagnate to get more money.
The same capitalist uses CPUs from different capitalist who decided to do the same for CPUs.
So SSDs and CPUs are stagnated and both capitalists have a shit experience while trying to screw one another over (king of shit).
The same is true for other technologies DRM is an unnatural abomination who screws over the ones who are using software infested with DRM.
So the 3 capitalists are also fucking themselves over.

Capitalism is simply demonstratively harmful to everyone.
Its even more absurd then then some Star Trek story about how we all can achieve utopia working in building a house together and people (the ferengi) who literally steal from the work sight and are lazy around fail to build a house.

I mean you can simply understand it the SSD and CPU capitalists are not only fucking over the consumers they are fucking one another over.

Utopia is at hand and we are siting here fucking one another over for scraps, living in shit because some retards want to be kings of this shitpile.

Also remember I'm no marxist because fuck these idiots, my ideology is banned fro ever talking to marxists (instant ban me if I say it) and most other people so you can enjoy the false dichotomy of ancap/liberterian clown VS marxist clown.

Attached: UTOPIA.jpg (600x401, 32K)

I don't think you get it, its because the SSDs manufacturers are siting to milk the technology for every drop.
I mean if it was not for government intervention the cartel of RAM manufacturers would sit on their hands and keep RAM prices sky-high.

Instead of developing the technology to its maximal capacity its milked for every drop.
And I doubt simply inserting more chips into the SSD is a extremely advanced operation.
>There progress is already on full throttle,
I'm no SSD expert (I doubt anyone here is) However DRM has jaded me jaded to the fact that capitalists will fuck everyone over to get more money, even if it hurts everyone even if its unatural to the technology.

Attached: Sovietspaceposters-70.jpg (2020x1224, 892K)

Both of my hard drives got fried last week. No more data hoarding for me.

I lost my fucking emulator saves!! And my memes....

I horde my data on the cloud. Can access it from anywhere

Did you have a backup?
If you don't have a backup you did not really want to have this data in the first place.
I'm OP and I'm delivering my promise of showing my setup.

Attached: OP setup.png (4584x2792, 3.15M)

What about GBA roms?

4TB is still cheapest TB/dollar

That's the thing, you can't be a hoarder and have everything backed up. Pick one.

I backed up my important shit anything I could just redownload I decided it's not worth storing. (on the cloud)

>I horde my data on the cloud
Then you are paying 10 times for it. Simply do the calculations of you buying a HDD VS all of this time of having a """cloud""" subscription. Unless you have trivial amounts of data (1GB) or are tricking your way to milk free offers(have fun getting banned and your data deleted for this exploit) you will overpay for cloud instead of buying HDDs.

You are literally renting HDDs from some company and they are throwing a extra premium on you.

communist countries just stole computer tech from capitalist ones

>I lost my fucking emulator saves!! And my memes....
Why didn't you back up your essentials?

>communist
Oh we are back in the ancap/liberterian clown VS marxist clown show?
Marxists are literally idiots because marx wrote lots of crap like "Overproduction creates economic depressions" and you end up with marxists who don't overproduce food and then its back to the good old
>B-b-b-b-b-But comrade where is food?

>communist countries
Fun fact no communist country ever existed.
The USSR officially called itself "real socialism" shows the level of knowledge you have.
Not that the balls to the drug fueled fantasy land of Marxist communism is even possible.

telegram gives unlimited storage.
hoarding my animus/mangos

pls no, hoard threads are fun. ignore the bait

My face when I need to have the maximal capacity.
My face when I will need to build 2 NAS servers to go over the limitation of 1 HDD.
My face when the physical limitations of the servers will push me to buy the maximal capacity HDDs.
My face when the 8TB did not drop in price for over 2 years.

Attached: ffc.png (523x800, 246K)

>telegram gives unlimited storage.
Wait what?

>Pick one.
Na.
My plan was to wait it over. You know geometric growth VS linear growth see:
have 8 + 13 = 21 TB of data.
Buy 4x16 TB
16 * 2 = 32 TB
32 > 21
32 - 21 = 11 free TB left

And the other 2x16TB is for the backup.
All my data in the archive.
Only if these cock sucking faggots ever deliver on the 16TB HDD and its not some terrible MEME tech who destroys HDDs.
Or drop the price of 8TB HDDs!!!!!!

Want to post your setup?

Using 6 HDD's with 8 TB each in a Raidsonic HDD 10 bay enclosure.
Have the same setup mirroring my data as well as an LTO-7 device for long term backup security

I collect TV-series in HD whereas about 95% of them are in 1080p and the rest 720p

this is the enclosure i use:
raidsonic.de/products/external_cases/external_cases_35/index_en.php?we_objectID=3410

Bought 6 of these during Christmas sales for 160 CAD and ripped out the drives.
Read speed is ok but write turns to shit after 50-60GB.

Attached: seagate-8tb-3-5-expansion-steb8000100.jpg (600x600, 45K)

i have bought one backup hub + from seagate in 8TB and the write speed is about 110 and 80 mbps

>Have the same setup mirroring my data
So you have 2 Raidsonics?
>LTO-7
I don't know the biggest concern I have is that all my data rots away.
The archive keeps it fresh all the time.

>I collect TV-series
For me its (in the actual archive)
25% Movies/TV series/anime/manga/comics
20%Games (emulators and PC)
20% Porn
25% Other (Youtube videos other internet saved crap, for example the 1 TB Terry A. Davis full torrent archive)
9.999% Self generated data (Videos from vacations)
1% Important self generated data

All numbers are estimates.

i am going full seagate with all my disks (Seagate Archive 8TB) but the MAMR technology sounds technically more promising and less straining on the materal than Seagates HAMR technology.
But we'll see if both are good or if one falls back because of long term problems.

I for my part, wait for the Iron wolf pro 16 TB ones. I hope it doesn't take fucking ages for them to release them.
Then i will change completely to the 16 TB ones from my 8TB HDDs.

Are they Shingled magnetic recording? Because this would explain a lot.

>So you have 2 Raidsonics?
Yes, I have two of these towers with six 8TB Seagate archive HDDs in each of them.
So it's a total of 12 HDDs.

>I don't know the biggest concern I have is that all my data rots away.
The archive keeps it fresh all the time.

The good thing about LTO is that the recorder/players are layed out as long term devices that without any problem should survive at least 35 years or more as electronical devices if you don't massively fuck around with them.
They are rock solid built and there are no rubber rolls that transport the band. It is actually a Bakelit roll leading the band.
The LTO-7 bands are also long life and are (if you store them in the dark, with room temperature and under dry conditions) a very long lasting thing.
Big data centres use them for their archives also. And the iterations of them are backwards compatible to at least one previous generation both tape and reading/writing wise.

I be happy even if they reduce the price of 8TBs to the price of 4TB.
I can manage 8x8TB or 4x8TB (the other half is for the mirror) I still get my 32 TB.

> I hope it doesn't take fucking ages for them to release them.
The stagnation is also killing me.
Moore's law up my ass.
Doubling every 2 years up my ass!
I keep score they where supposed to have 16TB in a reasonable price of ~$200 in 2018. Its 2019 and we are still waiting.

Attached: Moore's Law .jpg (1280x720, 743K)

>The stagnation is also killing me.
Honestly, i feel battered, humilated and mass murdered every fucking day i thing about the TB stagnation.
According to the roadmap of BOTH WD and Seagate, they wanted to have released 20 TB HDDs in 2021 if i recall this right, but not a trace of it.
But on the other hand, i'd rather go for a reliable 16 TB HDD in 2020 or 2021 than a 16 TB HDD that comes out now and is literally death star 2.0.

Ever since i went fully Samsung and then Seagate, i didn't have a single crash.
Sure, my Archive 8TB's aren't the fastest exactly, but they run rock solid.

>Yes, I have two of these towers with six 8TB Seagate archive HDDs in each of them.
Thanks for the info this is why I encourage people to use pictures to show the setup its super fast while explaining in text can get super complicated super fast.

>are also long life and are (if you store them in the dark, with room temperature and under dry conditions) a very long lasting thing.
>if you store them
>if
The if is the problematic part.

>any problem should survive at least 35 years
The problem for me is that I don't trust the magnetism in the tape. Magnetic charge can be lost.
Meanwhile because I bounce the data every 30 days or so on my archive drives its kept safe.

PS: Is there something like ZFS RAID1 for tape? So instead of building a server with ZFS RAID1 I can slice the device in 5 and have 1 slice to regenerate corrupted data?

And if you don't have this even one flipped bit can be disastrous and corrupt important data.

>Honestly, i feel battered, humilated and mass murdered every fucking day i thing about the TB stagnation.
Thanks I also need to vent over this.

>According to the roadmap
>if i recall this right
The fun part is I clocked them simple ODS file and look up what prices are in that year.
It was 2 years for 2TB -> 4TB it was 2 years for 4TB -> 8TB and now we get ass and overpriced 10TB HDDs. I understand if the technology gets problematic however why not drop the price of the 8TB?

> but not a trace of it.
1) Don't trust ""jurnalist"" predictions see:
blog.architecting.it/dude-wheres-my-100tb-hard-drive/
2) If its some official stuff simply save the web page and URL to your archive into your HDD prediction tracking folder.
(and this is kids why having a archive is important) (these files are trivially small FYI)

>Ever since i went fully Samsung and then Seagate, i didn't have a single crash.
What did you use before this?

>Thanks for the info this is why I encourage people to use pictures to show the setup its super fast while explaining in text can get super complicated super fast.
BUT, allthough the brands name is "Raidsonic" the Towers are NOT RAID compatible. You have ten bays for 3.5 HDD's and you can each HDD turn on or off independently from the toher ones in the rig.
The tower has only one single USB connector that you can plug into your computer.

I decided to not go for RAID, because of the size of my collection and what time it would take to rebuild a RAID when one of the disks fails.
Now, i just have to replace the one that fails and simply write it over from the identical on in my second tower. Ha huge time saver.
I keep track on what is on which HDD by using an exel tabel where i list series name, size in GB, how many seasons , and if the series is discontinued or stiill running
I also save notices if needed (if for example one episode is missing. So i can randomly look if i find it at a later point.

>The problem for me is that I don't trust the magnetism in the tape. Magnetic charge can be lost.
A friend of mine has an old LTO-2 device and a bucket of tapes and he had no problem to read them you after all the years storing the tapes on his attic. My tapes are all stored in an Aluminium case in room temperature.

>PS: Is there something like ZFS RAID1 for tape?
Not what i know. Maybe other band tape formats offer such options but LTO does not to my knowledge.

>And if you don't have this even one flipped bit can be disastrous and corrupt important data.
LTO checks checksum while recording.
I have yet not encountered corrupt files or non working ones.
And if, the release was shitty and i loaded a new one to replace it.

>one single USB connector
This is impossible for me to use because of my setup.
At this point only a direct SATA connection to the PC or cool 1GB Ethernet cable connection is the only thing that can keep up with me (its the fake mirror).

>I decided to not go for RAID, because of the size of my collection and what time it would take to rebuild a RAID when one of the disks fails.
I like to see you draw it out for me I start to understand it; however.

>I decided to not go for RAID, because of the size of my collection and what time it would take to rebuild a RAID when one of the disks fails.
I was planning a different setup if I get multiple HDDs I simply RAID 0 all the HDDs in one NAS and treat them like one indivisible HDD in my fake mirror.

RAID 0 boosts write speeds and keeping the fake mirror backing up is the important part.
So the Alpha NAS will back up to Beta NAS the same way Alpha HDD and Beta HDD are doing it now.

>Thanks I also need to vent over this.
Belive me, may other people are also suffering huge. haha

>It was 2 years for 2TB -> 4TB it was 2 years for 4TB -> 8TB and now we get ass and overpriced 10TB HDDs. I understand if the technology gets problematic however why not drop the price of the 8TB?
my 8TB ones went from 250 Euro down to 209 euros per unit. But when i buy them in an enclosure, they tend to be about 20 to 30 euros cheaper.
I know that they are MUCH cheaper in the US and Canada. But that's not the prices i can get unfortunately. But OK, i am not exactly suffering from lack of money.

>1) Don't trust ""jurnalist"" predictions see:
It were press conferences where WD and Seagate themselves showed their roadmap. And both couldn't hold their promises even nearly.
I mean i hate paper launches, but future-paper launches are even worse.

>LTO checks checksum while recording.
(I'm of course talking about the ZFS scrub command)
Can it recover from corrupted data or will it simply discard the corrupted file?
Because the only way to get RAIDZ1 that I know of is to keep the data in a VM with multiple virtual HDDs who are configured for RAIDZ1 and then simply to copy all the VM files to any medium and do a check in the VM once its copied back to a HDD.

Sounds like overkill to get this functionality.

>LTO
How easy is it to get into tape?
What are the costs?

>What did you use before this?
WD and Maxtor.
WD's regularily failed on me, while the Maxtors worked rock solid. I have still some of them running without any problems.
The oldest i have, is an 40 GB Maxtor where i store desktop backgrounds on.
It's still IDE and i use it in an enclosure. Allthough i have to admit that my Maxtor One Touch 160 GB HDD from 2002 gave up last month. But my guess it's not the disk, it is the enclosure that failed.
I have to take it out and test the HDD on one of my other docking stations that provide an IDE connector.
But the lazyness kept me from doing so. :-D

>WD's regularily failed on me
Interesting.
I was mostly seagate and I did read peopel memeing online about seagate = seafate and how seagate fails all the time.
once one of my seagate failed I decided to get serious about backups.

>At this point only a direct SATA connection to the PC or cool 1GB Ethernet cable connection is the only thing that can keep up with me (its the fake mirror).
Yes, my USB 3.0 is not as fast as a direct SATA connection, no question, but for the purpose of what i am doing it is ok. I can live with it.

>I like to see you draw it out for me I start to understand it; however.
Yes, for me the decision fell on a non RAID setup, because of the sheer size and what it would take to rebuild if one drive fails and for the fact that not all disks have to run if you go for a non RAID.
I only have running the disk i read/write to/from. The others aren't running. A huge energy save also and the Seagate Archive disks are due to their SMR technology not RAID compatible anyway.
People who have raided them, got timeout erros and RAID crashes. And these Archive disks also lack the sensors and features to deal with the vibrations of more disks running.
In a single bay NAS, they are good, but multiple disks running is not their thing.

>I was planning a different setup if I get multiple HDDs I simply RAID 0 all the HDDs in one NAS and treat them like one indivisible HDD in my fake mirror.
I am considering to buy a Drobo 8-bay unit which has their "beyond RAID" technology. There you can replace disks even when the system is up and running and you mix different sizes and brands without any problem.
This can connect via Thunderbolt also, and i would have all my collection in one huge volume. Sounds teasing to me.

tfw all high capacity HDDs are noisy as fucking balls
even the WD red 8TB, 10TB

Least noisy one i found was the WD Red wd60EFAX but thats FUCKING SMR.

ReeeeeeEEeeeee

And Toshiba doesnt list active noise on their 14TB drive, thats actually NOT SMR, and has 10^16 error margin

Nothing FBI, not now and not ever, fuck off.

>Can it recover from corrupted data or will it simply discard the corrupted file?
I can't answer this because i simply don't know this.

>How easy is it to get into tape?
There are Standalone devices that you can put on your desk to operate it, so you don't necessarily need a 19" rack to mount it properly.

>What are the costs?
I paid 2000 Euros for the Tandberg recorder/player which also a program follows with to transfer the data with.
The tapes cost about 65 Euros per piece for LTO-7.
I can store 6 TB on each tape uncompressed and up to 15 TB on eaqch tape compressed.
I go for uncompressed, because .mkv files are already compressed files.

>I was mostly seagate and I did read peopel memeing online about seagate = seafate and how seagate fails all the time.
Yes, i heard the Seagate 3TB ones were terrible and failed regulary. But i never went for them and at that time Seagate had trouble with them, i was using Samsung SpinPoint disks which also none has failed on me.

When it comes to HDD crashes i'm a lucky bastard. All the disks i had over the years (may be well ovver 80 now, only three WD's and one Maxtor failed and my 160 GB Maxtor, i have yet not cleared up if it is the enclosure or the disk itself.

>There you can replace disks even when the system is up and running
This is really not interesting to me.
Because of my fake mirror I simply conclude the NAS is dead try to salvage it and see where the RAID 0 failed see if the HDD is under warranty etc.

The NAS will need a new HDD however after replacing it I simply copy from the mirror and everything is working once more.
Worst case scenario I lose 30 days of my work.

This is also why I need to have the ability to mirror my archive over night. This requires speed and all other meme raids are irrelevant I need to fuse these fuckers together and treat them like 1 HDD with boosted capacity and boosted speed.

Attached: internet-speed-gauge-MBPS.jpg (970x546, 190K)

Refurb drives are more expensive than shucking portables where I live, even refurb consumer drives.

5TB HDD
3TB HDD
2TB HDD
1TB HDD
128 GB SSD

I'm waiting for a sale for 10+TB HDD for ~$130 before going in.

>There are Standalone devices that you can put on your desk to operate it
I was interested in one of them.
>I paid 2000 Euros for the Tandberg recorder/player which also a program follows with to transfer the data with.
Here is the biggest problem for me.
I use a FM 2 (Fake mirror 2) and the only drawback to the FM2 is that during the copy operation there is a window and if one of the mirrors fails I lose all my data.
The alternative is to go FM3 or FM3+ (FM4 FM5 FM6) however FM3 avoids this copy window of danger.
>2000 Euros
is a real punch because I was thinking in using FM2-S (The S stands for Side ) where the tape will be a side copy of my FM and kind of work like a FM3.
Only for 2000 Euros I can make 3 NAS and simply run them in FM3.
I think the speed benefits of simply going FM3 and staying in pure FM are worth it.

I mean its like having a futuristic single HDD with great capacity (imagine a 1 EB HDD). All your files in one place no complicated looking up on what HDD the data is.

Attached: look up table.png (700x400, 46K)

>The NAS will need a new HDD however after replacing it I simply copy from the mirror and everything is working once more.
>Worst case scenario I lose 30 days of my work.
But how big is your RAID currently?

If i would go RAID, it would be 48TB and it would take ages to rebuild it with a mirror of the same size.
I also have easy to upscale due to the individual disks tactics.
I expand my collection with about 100 GB every day, so upscaling is also something i take into consideration.
If my 10-Bay enclosure can't harbour more disks, i simply go for one more pair of these and continue. Or they release THESE FUCKING 16 TB HDD's so i can free half of the slots in every tower.

>This is also why I need to have the ability to mirror my archive over night.
Even with SSD's on a direct SATA i couldn't archive over night. My collection is simply too big now.

only 1 HDD failed on me and it was the 3TB seagate.
>i heard the Seagate 3TB
I have lots of these 3TB HDDs one of them failed.
I hope I can get my data out before they rot away in them I hope they don't crash on me.

Can you tell me where to buy these tape drives and what you recommend?
Will I need to have special software to use them?
What OS is it on (I'm on linux)?
How long to back up to tape?
How long to copy back all the data from 1 tape?
How large are these capacities on the tape?
Can you split up 1 gigantic file on 2 or more tapes?

Attached: fot_024_A87.jpg (1920x1440, 443K)

I thought that they were starting to ship portable drives with special USB-only controller boards, instead of just sticking plain SATA drives in a USB enclosure.

I shucked some WD elements recently (shit quality drives, I know) and they were just normal sata drives. They might start changing shit where I live though like that.
To be honest, if they do, I'll just start hanging them off USB hubs.

>is a real punch because I was thinking in using FM2-S (The S stands for Side ) where the tape will be a side copy of my FM and kind of work like a FM3.
I understand, but honestly, i can't tell you if or how good this combo would work.
The problem is that a single cassette stores 6 TB, and if your RAID is bigger than that, you would need a multiple cassette device, which are available, but they are (even for me as a business owner) ridiculously expensive.
So during a backup, you would need to change the cassettes if one is full.
Old memories of "press play on tape" come up now hahaha.

Huge data centers use LTO to store their data and there are literally server halls full of cassette holders with robot arms, that take the tapes out of their storing location and put it into the LTO player/recorder when needed. Everything is fully auto. But it costs kingdoms to purchase such a system.

>I mean its like having a futuristic single HDD with great capacity (imagine a 1 EB HDD). All your files in one place no complicated looking up on what HDD the data is.
Indeed, this is what makes me consider about an 8bay Drobo.
I just exceeded the 450 tv series mark and it became quiet hard to know all details about every single series i have and how big they are and how many seasons i have. That's why i am running a tabel where i keep track on that information.

>i couldn't archive over night. My collection is simply too big now.
How big is your collection?

I can mirror 8TB overnight.
And if the RAID 0 is proportional in scaling RAID 0 on 2HDDs will give me 16TB and the ability to mirror overnight
Raid 0 on 4HDDs will once more give me the same mirroring over night ability.
Simply because the proportion should stay the same.

>But how big is your RAID currently?
I think I need to make a disclaimer.
I was planning this NAS RAID.
Its named inferno box.
I don't have a RAID or NAS I use 8TB HDDs in the PC see picture .
The Fake Mirror is a Fake mirror you can think of it like Raid 1 however its not raid 1 it has it benefits and drawbacks to raid 1.
I was planning to use RAID 0 to keep the transfer rates between the NAS identical to what I have with my HDD setup now.

>it would take ages to rebuild it with a mirror of the same size.
In my PLANED inferno box setup there will be no rebuilding raid 0 should not even be considered raid.
if 1 HDD fails in the inferno box in 95% of all scenarios the entire data is lost on it.
I will try to trouble shoot the problem in the inferno box:
1) Check if only the hardware failed if yes and only the connections or motherboard is dead the HDDs can be tried to be used in a different PC to run them as a inferno box (I was thinking of using ZFSs raid 0 because it can be plugged into other PCs to use it there).
2) Check if maybe the OS drive (yes the inferno box OS is on its own HDD) failed if yes simply insert a new OS HDD and use the data drives in raid zero
3) If one of the HDDs failed I check what HDD failed.
4) Go to shop and demand replacement based on warranty.
5) Get or buy new (identical) HDD before replacement ships.
6) insert new HDD to the failed inferno box
7) format the raid 0 HDDs together all data is lost in this inferno box (you see why these things are named inferno boxes)
8) Stress test the inferno box
9) Copy from mirror to inferno box.
10) all works

Attached: Official INFERNO BOX mascot.png (500x603, 148K)

>Can you tell me where to buy these tape drives and what you recommend?
I bought my Tandberg on a special offer when LTO7 came out. I updated from LTO 5, and sold the erased tapes and recorder/player after i was done with it.
It normally costs about 2600 Euros, but i got it for 2000 Euros.
I bought it from www.alternate.de
A german shop wich has reasonable prices and is (at least for me) scary fast on their delivery. I live in Germany also.
If i order something on monday and pay via paypal, at 10 o clock in the morning, i have the stuff the next day. Without express!!!

>Will I need to have special software to use them?
Yes, you do need a software, that usually follows with the player/recorder.

>What OS is it on (I'm on linux)?
I am using it on Win7 Ultimate 64bit but there should be Linux versions available also. Go see with the vendor and clear this up before a purchase.
But since Linux is the most wiidespread server OS, they were scary stupid to not have a Linux version. Because LTO is a professional storage solution used by governments and data centers.

>How long to back up to tape?
>How long to copy back all the data from 1 tape?
Theoretically, an LTO-7 tape can be read out with about 750 mbps and recording is almost as fast.
But most SATA SSD's, cant even reach their speed level. Not to talk about mechanical drives. So the bottleneck is definitely not on the LTO side.

>How large are these capacities on the tape?
LTO-7 tapes have 6 TB each uncompressed and up to 15 TB compressed (depending on the possible compression rate of the individual file).
If you backup ISO files with bootable OS's for example, they are compressable, but as i said earlier, .mkv, .mp3 files and all that stuff are already packed tight withing their containers (mkv). So no further compression possible.

>Can you split up 1 gigantic file on 2 or more tapes?
I can't tell you this, but you could cut it with a program and then tape it if needed.

>tabel where i keep track on that information.
Tel me about your tabel I like to know your system.

>ridiculously expensive.
This is also what keeps me away from tape.
I can play around with this or I can simply buy myself another inferno box.
>So during a backup, you would need to change the cassettes if one is full.
Minor inconvenience.
>Old memories of "press play on tape" come up now hahaha.
Is there a way to do this?
How fast are these 6TB recorded?
If 6TB are transferred in 1 hour its cool.

Thanks for all the info and great conversation.
I have to go in a while.

Ps: Are you interested in staying in contact?

My collection is now 48 TB big and contains 453 tv series in 1080p in .mkv, parted up in 6 HDD's with 8 TB each. Plus an identical setup for mirroring
I use Seagates Archive 8TB disks.
And as said, i use them in the Raidsonic USB towers i purchased, that are non RAID.
If i would go for a RAID, it would be 48 TB to be rebuilt. Not doable in one night. This would take me at least one week or more.

>Tel me about your tabel I like to know your system.
when i downloaded an episode or an entire Season/series, i will rewrite the file name like :
Breaking Bad - S03 E07 - Episode Name (1080p).mkv
then i open up the file in mkvToolnix and name the video file, the sound files and the subtitles after their codecs and bitrates and then i put that into my collection and update the my excel tabel.
Ongoing seasons, i temporarily store on a 2TB Samsung SpinPoint disk, until the season is complete and then i move it over to the Archive disks and update the excel tabel.

So i only update the excel tabel for complete seasons or entire series. Single episodes get temporarily stored until completion.

Attached: Tabelle.png (1498x1378, 345K)

>Is there a way to do this?
Not exactly, because everything goes via the buttons within the program.

>How fast are these 6TB recorded?
As fast as your HDD can deliver.
LTO7 can write with 750 mbps, so they are even faster than a SATA based SSD.

yes, why not.

>to be rebuilt.
There is no rebuilding with the inferno box.

>My collection is now 48 TB big
Hmm
4*16TB = 64TB

64 > 48

So you need to build 2 inferno boxes with 64 TB and if the manufacturers did not fuck something up with the HDDs this should mirror over night.

And I'm calculating in future growth.
I think 8TB for 2 years is good enough.
you have
64 - 48 =16 TB of free space.

Of course remember this is all on paper and using predictions the manufacturers can fuck us over hard.

great.
you can e-mail me to
[email protected]
its a temporary e-mail on tempmailaddress.com/
And I e-mail you back from my real e-mail so we can stay in contact.

~600GB used up this year so far.

Only have about ~650GB of space left.. I'm just gonna wait it out until Black Friday and hope to score a 10TB HDD for $145 or less.

Remember to get a backup (you are going to buy 2x10TB HDDs) or you don't really want to keep this data.

Attached: f15.jpg (766x883, 253K)

My collection grows with 100 GB per day (if i download stuff). Right now since three days i only download episodes to complete ongoing seasons. So its' between 15 and 35 GB only.

I have a share-online.biz premium account for four years that cost me 100 Euros.
And i have to renew it in the end of september.

>So you need to build 2 inferno boxes with 64 TB and if the manufacturers did not fuck something up with the HDDs this should mirror over night.
Are all HDD's parallel transfering data to their mirroring counterpart?
I mean like 5 disks mirroing with full speed at the same time to their 5 counterparts instead of only one data transfer?
Because mirroring 64 TB in one night would take ages otherwise.

Interesting thanks.
you rock for using OpenOffice and not MS crap.
I mean its perfect who needs more out of tabular data.

If I ever made a list like this (and god knows I need to) I think about these things.
Personally I think I gravitate into creating a SQLite database however this can be a stupid idea however I wanted to do more substantial things with SQLite.

I think I can make the series name a primary key so no duplication is possible and I think some browsers have some basic sorting if the data is in SQL.

i have sent you an email.

>you rock for using OpenOffice and not MS crap.
>I mean its perfect who needs more out of tabular data.
THIS!!!!
I mean there is Libre Office available, also for free and it is more updated as Open Office, but for the little i use the tabel function, it is fully working with no problems at all.
And Microsofts Office suite had it's last good version with Office 2002, but personally i prefer Office 97.
They bloated the shit out of their Office suite, it's not funny anymore.

They are, that's why he has dogshit performance

1 porn scene is literally 6.1 GB ... wtf bros

Attached: gdgdd.png (363x509, 18K)

>Are all HDD's parallel transfering data to their mirroring counterpart?
I don't understand what we are talking about.
The inferno box?
Think of the inferno box like about a HDD you plug in and don't think about its internal components.
Only inferno boxes work over Ethernet cables (not USB or SATA) and you need to install a 1GB network card to transfer data in the best of speeds.

>mirroring
Hard for me to understand.
The inferno boxes internally use RAID 0 and RAID 0 splits up the load on the HDDs so lets say you have 2 HDDs named Bob and Karl in Raid 0.
Only 50% of the data is written to Bob and the remaining 50% is written to Karl.
So the writing speed is 2 times faster since the HDDs split the writing between one another.
If manufacturers don't fuck us all over with some BS technology that fucks up RAID or RAID 0 this should hold true.

Raid 0 has restrictions like you can only have powers of 2 set ups so
2 HDDs
4 HDDs
8 HDDs
And the HDDs should be the same capacity.

Remember Raid 0 should not even be consider raid since its so drastically different from all other raids
see video
youtube.com/watch?v=U-OCdTeZLac
For explanation (this is simply how RAID 0 works).

Remember the name inferno box is no joke if one of the HDDs fails all data in the inferno box is lost forever.
This is why the inferno box should be treated like a closed system and mirrored.

You realize I managed to create a fake raid 1+0 with my FM2 setup.
Or more precisely Fake raid 1 + real raid 0.

Attached: RAID 0.png (910x641, 196K)

>Libre Office
I use Libre Office myself.
> last good version with Office 2002
I remember my office 2003 however its not worth the hassle to install it with the online verification BS to have something like LibreOffice.
Also ODT is a universal format.
>They bloated the shit out of their Office suite, it's not funny anymore.
MS has continued going to shit ever since Bill Gates left (XP was the last OS Bill Gates managed)
>it's not funny anymore
I mean they are terrible at this point, I think everyone is wishing them to go bankrupt, Win8 single handedly pushed me into learning linux and I did and its great (watch out for the 90 MEME distros out there).
The interfaces keep on getting worse and worse.