/hsg/ - Home Server General

It's never matters in the real world, until you get to $50,000 enterprise level servers.

Synthetic benchmarks show 50% more bandwidth in dual channel configuration. That's only applicable if you're reading large datasets, or caching large files, and you have so much CPU power that the ram is the bottleneck. It does nothing for latency, which is applicable to random small reads, such as running a database.

What backup software do people use here?
I used to use Acronis when I was only backing up desktops and really liked it, but it doesn't work with server OS's so that got dropped over the past 5-6 years.
now I use wangblows server backup for servers + veam for clients with some folder history on.
Mirror them over to freenas and use cloudberry to chuck it to backblaze

Feels pretty clunky a lot of the time, not efficient use of space, especially folder history, not that easy to test the backups either.
Redpill me on GOAT solutions /hsg/

Also, who /microserver/ here?

Attached: 1559185344269.jpg (864x1152, 352K)

You don't really need QoS 99% of the time, even when you think you do, you don't. Save your money for a nice switch down the road.

I spent an eternity tweaking nfs over 10gb and could never get good throughput.
Ended up just using SMB and it just werks. That might be my inexperience with ifconfig and freebsd, the amount of tunables is mind boggling.

freebsd.org/cgi/man.cgi?query=ifconfig
docs.oracle.com/cd/E19963-01/pdf/821-1450.pdf

These should put you to sleep

>What backup software do people use here?
Borgbackup - this is obviously even easier if your important data is on a BSD/Linux NAS.

Syncthing (staggered versioning) also is useful.

If you don't like borg, have a look at restic.

> bcachefs
It doesn't have RAID5/6 like erasure coding etc yet, right?

> I basically want the tiered storage of zfs, while being able to add drives and switch from raid0 to raid5 once I have enough.
How about mdadm + lvm?

Ceph is even better, but I'm warning that it still isn't a smooth ride. (It'll be smoothER if you can into orchestration like with rook/k8s or ansible and so on, if you can set it up as NPOF and drop and recreate things that have problem you kinda do dodge a bunch of bothersome instability).

I heard borgs encryption was pretty shit and development is pretty stale.

I tried to use syncthing with backblaze and it would sometimes say it's been synced but then when I open the folder on backblaze it was empty, it only happened a few times and i couldnt replicate it, but made me a little paranoid

Not looked into restic, if you've used it, whats your experience and use case with it?

As much as SMB is lmao microsoft, it works.

why do you have no low power amd on the list.

About to go and pick up my latest haul - five IBM X3200 M3s. They all have xeon x3450s, AKA first gen i7s, and 8-18 gb of ram. Not the most powerful or power efficient, but I wanted cheap nodes for playing around with stuff like oVirt, which really isn't so great on one or two hosts. Plus they were only $30 USD each.

Current homelab has a dell R710, and two other builds cobbled together out of old/free parts. An Athlon X4 860k based system, and a super old dual core Athlon II X2 that I paid literally $2 for a couple years ago, in a pretty decent AM3 motherboard that I got from a friend - this system has almost no cpu power so it just holds disks and runs the oVirt engine.
For my switch I have a brocade ICX7250. 24x1gb, 8x10gb. I got it brand new, in the postage box it shipped from Mexico to my country in for a pretty low price. Brocade doesn't have the best reputation from what I gather, but the syntax is like 90% the same as cisco, and it's still FAR more than what I need for home.

In theory your performance will be lower in single channel than dual channel, but honestly you probably won't notice a large difference, if any.

Please don't set up ceph as your main storage at home, you'll want to kill yourself.

rsync script on some stuff, but honestly most of my data is replaceable so while not an ideal solution, I currently don't back up very much of my data. Although backblaze looks like a good option.
How usable are the microservers? I've been interested in them for a while, but they're pretty expensive here, even old ones, and they seem really weak for their price. How much stuff can you realistically run on them?

ayo what cheap router could I get that supports linux or a linux with as many linux features as possible

>I heard borgs encryption was pretty shit
It's completely standard AES 256.

> development is pretty stale
Please check your eyes. On top of that, what do actually miss - more ASCII pony graphics?

> Not looked into restic, if you've used it, whats your experience and use case with it?
It's a variant on borg. Same kind of use case: Efficient backups. Various details vary, you may prefer one or the other.

Thank you friend

Raid5/6 is "done" but not "production ready" (patreon.com/posts/erasure-coding-22703995)
Everyone I've talked to said stay away from lvm. My first thought was to go with two mdadm arrays, since it looks really mature, but I couldn't find anything that made sense to put on top.

>Please don't set up ceph as your main storage at home, you'll want to kill yourself.
It was too buggy, else I'd have been pretty happy with it.

If I had planned an orchestrated NSPOF setup it might have worked okay.

So what's a nice switch ?

What do you mean by that? You mean a box you can install VyOS to? Or a box that happens to have a lot of ports and you want to install a regular linux distro like centos on it?

>Everyone I've talked to said stay away from lvm.
Wat. Who did you even talk to? LVM works beautifully.

Sure, I wouldn't use it instead of mdadm, but there is basically no downside in using it to do flexible "partitions" with possibly some caching layer on SSD or whatever.

Attached: image.jpg (4032x3024, 2.25M)

if i wanted a basic NAS until i upgrade to something better is it worth getting one of Synology's entry level models? Ideally i won't be transcording and just using direct play on Plex or whatever. My only concern is i won't be able to drop them into a proper server build without formatting them since as far as i know, Synology use a propitary filesystem?

Not the guy you tagged, but can you please explain why I should use LVM? And how I manage it? It's always been a bit foggy for me.

Anyone know of a nice, documented and mostly human-transactable file metadata recording standard that keeps track of checksums, mdate and possibly also custom fields (though that last one is not imperative) in a filesystem-independant way, without encapsulating said files? I'll explicitly mention that human-transactability excludes git-annex as a good solution. I could of course use the output of standard programs like the *sum and ls and whatnot and roll my own thing ad-hoc, but I just can't believe how barren this form of archival seems to be. BagIt comes pretty close to my needs but would need some extension, which the spec allows for, so it's my favorite candidate at this point. It's been a few months since I've started occasionally putting some thought and research into this, to no avail. As my project stack seems like it'll allow me to spend real time on the issue soon, and as I'd rather not reinvent the wheel, does anyone here have any pointers?

synology software is based on BTRFS over MDADM, but you can't transfer the disks to another system.
A used server will be cheaper than a synology system anyway.

> why I should use LVM
Because msdos/gpt partitions aren't as flexible as LVM:
en.wikipedia.org/wiki/Logical_Volume_Manager_(Linux)

This may be unnecessary if you just want one single full size filesystem over your array no matter what, and not use any tricks like snapshots/branching or SSD lvmcache and such, but in doubt it doesn't really hurt to have it.

> And how I manage it?
CLI or optionally with a GUI. I use CLI.

It's not really hard, you mostly just need to remember or look up what you have as VG, PV, LV - they each have simple tools to check/manage.

>you can't transfer the disks to another system
Eh? On all models where I tried this, it trivially worked.

I meant to a non synology system. Is that not correct?

something that looks and costs as much as a router but runs linux or linux related OS so I can ssh in and do linuxy stuff. I only need one ethernet port.

the n40l and n54l's are good for freenas storage, the n40l chokes a little with 10gbe. They can be had very cheap. Upgradable ram but has a low power AMD bga soc.(can flash the bios to upgrade the ODD sata port to 6gb/s)

Gen8's are amazing if you can get them sub £130/$150. Can upgrade them to cheap 4c8t ivy bridge xeons, 16gb ram(picky with modules) and have an expansion slot for 10gbe, single-slot vga or raid cards, I had mine originally crammed full of drives, 4x2.5" and 4 3.5" with some custom mounts. Good modding community around them.
Very quiet and power efficient

Stay away from the gen 10's they went back to using a low power, soldered amd chip and are pretty overpriced imo

Attached: 1540413088039.jpg (2024x1518, 988K)

So you’re not actually using it as a router? And what do you mean by “looks like a router”?
The PCengines APU2 and the case they also might be what you want.

I have 3 of this switch. Cheap, does the job.

Bought myself a i3 sandybridge laptop for $60. Finally got tired of hosting my various servers on my desktop. Going to be my personal game server + web server.

Wasn't a problem with muh Gentoo (/sysrescuecd).

well I need only one port but it can have many ports, I might use it as router, that's why I'm looking for a router that could run a linux distro or that could allow me to install a linux distro

Sounds like you want a raspberry pi

Odroid / Rock64Pro?

Maybe even just some Chinese router you can run OpenWRT on?

Mikrotik Routerboard hEX

iirc It uses a composition of aes and hmac which is poorly implemented, things may have changed recently(again, last time i checked the development was stale)

It's probably as good as current setup so I'm not dismissing it, no need to fanboy over it user.

total noob here
how do I figure if I want NAS software on my box like OMV or rather ubuntu server for example.
I just want to have the other computer to host files I plan to store for the long haul, seed and download torrents and maybe run a couple other things like pihole or nextcloud to boot. I'm looking to run it from a toaster, but a reliable one and headless, but not sure how in case of ubuntu server. So far I did a dry run of OMV and while the easy webgui is nice it has some downsides and for me as a person who haven't been much into linux before has some counterintuitive designs.
any advice?

rsync

why are pre-built nas units so expensive despite using completely outdated shit like molex?
most of their innards are ugly as fuck

If you want to RGB your guts, get a m-itx with a windowed case.
Molex just werks, easy to repin yourself, loads of cheap adapters for them.

They're made for people who don't know how to make it themselves so mark up is huge.

Take a look at UrBackup.

Although it has a shit documentation and UI, in my experience it just works.

You will suffer during the initial setup but after that it's easy.

consider freenas, reliable and fast storage. Can set up light VM's.
I would say try them all for a few months to get a taste of all the nuances.

I had an RS221RP+ fail at work. Took a while to figure out, since Synology DSM creates multiple partitions on each disk so it can set up multiple arrays (one for the OS, one for data, one more for something else), but I was able to assemble the data array with plain old mdadm. No reason to believe you could’t do it on another Linux box.

looked at freeNAS before trying OMV, but my mobo caps out at 4 of the recommended minimum of 8GB or RAM and the CPU is an /old/ xeon
will it still go? The OMV has issues but it works with few hiccups.

If I could get them for that price here I probably would, they look like fun little systems.
Thanks for the info

no too much trouble

I want it to come with its own case and everything

sounds good thanks I'll check it out

also is it an issue for freeNAS if I wanted to plug in drives with files formatted to ext4 or other file system intead of zfs?

> It uses a composition of aes and hmac which is poorly implemented
They use OpenSSL and Python hashlib/hmac.

But sure, I'll indulge you: In what situations is it a problem and who said so?

> last time i checked the development was stale
Was that before the project was published? Else this doesn't make much sense.

Ahh ok. Thanks. I didn’t know that.

> I want it to come with its own case and everything
Buy them, both the Rock64 and multiple Odroids (XU4Q and such) have them.

is the point of RAID more about performance or data integrity
it just sounds like a fucking awful idea to me because of the complexity

mate I'm too much of a lazy fuck to assemble circuit boards, connectors, and cases, that's why I said I want a router that could run linux.

They’re intended for businesses, and the people setting them up usually don’t give a shit. We’re using Qnap garbage for that reason, at least. Spent the time I saved playing mahjong with people from /jp/.

freenas can run on 2gb fine, you will just gimp yourself slightly in performance. for your use-case I can't imagine you will ever bottleneck it.

And old Cisco 3560G

>not having 5 figures worth of servers at home
you're in the wrong thread

Veeam

>Has anyone tried NFS vs SMB over 10gb?
pic related

>Brocade doesn't have the best reputation from what I gather
they're known for being completely bug ridden switches

Attached: 10GbE (S2D SOFS Rebuild).png (3360x2100, 533K)

How to setup a FreeNAS box and use it as a DAS? I don't want to have it on my home network because I don't want my family to see it on their computers

ty

bixnigger, do you have a commercial/volume royalts key? cbf downloading sandboxie to try out these keygens

what about ext4 though, I keep reading and it says freeNAS doesn't support it

follow up question:
can I install a PCI-e network card on my main computer and the FreeNAS computer and just connect them via ethernet cable?

Yes

But then again why not just plug the hard drive into your PC? The point of NAS is to provide sharing.

Are server grade ssd a meme or a valid option? These things allow for thousands of tbw with the added benefit of not having to think about mechanical failure. I'm thinking of making my own cloud and having to rely on disks makes me unconfortable.

afaik, you can mount ext2/3/4 from the console. I would tend to shy away from freenas if you are planning on using ext4.

some of them have an order of magnitude higher iops which makes 4k rw a lot faster. with regards to endurance, most chinese drives will outlast your nas and will be cheap to replace, so i wouldnt factor that in at all

> I'm thinking of making my own cloud and having to rely on disks makes me unconfortable.
Absolute nonsense.

Decent cloud setups are even more robust than RAID6, they got more constituent drives that replicate their content to more constituent drives upon detecting problems.

I have full drives (2+2+4TB) of data in ext4 and no chance to flip it to reformat so I'd default to something compatible too

Do what I done, but 2x10tb drives off amazon, mirror them and transfer all your data onto them, validate - Then wipe your current array/move it/upgrade/do whatever you need with it. Put the data back on and return the drives to amazon.

The benefits of being in YUROP

also being in YUROP I'd do this if I could be arsed to
I'll try ubuntu server for now I think

sorry for dumb question but what is this card actually called? HBA or SAS controller card?

Attached: 61fl9VImirL._SL1280_[1].jpg (1280x960, 108K)

Both. HBA is the generic term for this type of add on card/chip - that adapts things to the host bus. That is a SAS controller, but it falls under the category of an HBA

If I want two or three separate networks behind a main firewall and router connecting to the outside internet, and some of those networks should have internet access and some should not, and networks should not have access to eat other, does the single main router handle all of that, or does the router simply route traffic to the network, and then each network needs its own router to route to each device?

I feel like a retard but I also haven't been able to put this question into google in a clear enough way to get a meaningful answer.

yeah i have a key from work. they still havent upgraded to version 5 tho, if you find a keygen post it somewhere or give me the magnet link

they arent a meme, they have several orders of magnitude better URE rates, far higher endurance ratings, and sometimes have power loss protection. 480GB Seagate 600 Pros are cheap as shit

>a opaque storage system ran by a third party who wont explain how they're configured is far more robust than what you can setup
lel

One router can take care of that

*assuming said router also has firewalling capabilities

I just got an LTO-4 tape drive, and I keep getting Input/Output errors with mtx. What am I doing wrong?
Yes I took a picture of a screen.

Attached: IMG_20190809_174558.jpg (1920x1080, 1.25M)

Nigger any router can do ACLs

The drive is probably fucked. Every tape manufacturer has diagnostic utilities, run them and look through the logs on the drive as well. I had to buy 3 LTO5 drives off ebay before I got one which worked

Fuck me. I got two fucking LTO-3 drives that don't work either, I don't know what the fuck to do with these shits.

AAAAAAAAAAAAAAAAAAAAAAA

Attached: screamingtubepepe.png (900x900, 937K)

Suppose I want three PCI-E x8 slots. What's the cheapest hardware I can get to do that? Used is okay.

How are the "server motherboards" with bundled SoC? I have my eye on a SuperMicro itx board with AMD EPYC 8c/16t 50w SoC. It also supports registered ECC DIMMs. What's the dependability like?

Also, where are the utilities for IBM? Either I can't find them, or I'm a smoothbrain.

Here's my drive info.

Attached: IMG_20190809_192947.jpg (1920x1080, 1.15M)

Supermicro SSI EEB motherboard, first gen i-core.

here you go tard
ibm.com/support/knowledgecenter/en/ST9MBR_1.2.5/ltfs_itdt_download.html

I use an original google pixel as a server, but recently its wifi has been fucking up no matter what I do, known HW issue apparently.

How can I connect it to ethernet?

Clients - Macrum Reflect or Windows Backup

Servers - Replication & Rsync

Imo, it just works.

Uptime or Speed, for data integrity make regular backups

Also it looks like this is just a linux issue

access.redhat.com/solutions/58252

This always gets me:

Person builds a server for Freenas
They use Raid Z2 and good drives
They use a backup strategy
They use a UPS.
They install plenty of ram to run it effectively/handle the workload.

All good things

However a critical thing is overlooked; they used regular desktop grade ram.
Like why bother then? If you've gone to this trouble to build a bullet proof server why the hell skip out on using the required ram? It says it plain as day in the manual/website/forums.

Like driving a car with bald tires, sure it'll work but when the shit crashes don't blame the car, blame yourself for putting the bald ass tires on it.

Most people making their own nas use ecc ram right? RIGHT?

because everyone here except for me and a few other people are colossal poorfags. hell most the people here think some ARM shitbox is a server.

also you're wrong, few people here use enterprise class drives. they think NAS class drives are the same thing when really they only have multiple RV sensors.

I use Macrium Reflect to image Windows devices, raw (and then gzip'd) images of my server's and RasPi's SD cards and rsync for full data array backups.