Solved Hyper-converged infrastructure (I missed the storage part)
-
Hello,
I'm trying to wrap my head around this idea, which I know have existed for so long, but only recently I have understand it more.
As Wikipedia defines it :
Hyper-converged infrastructure (HCI, also called a hyper-converged integrated system. HCIS) refers to integrating virtualization of storage and computing in a data center.[1]
For me now, virtualizing computing is the easy part, cause I reckon they mean as VMs with CPU and RAM, ...etc
I played a little with iSCSI and understood more on how storage can be remotely allocated via Asustor As1002T NAS, which actually had this functionality which was surprising being an affordable NAS.
But I still dont know how the PROs do it, currently I use the storage build in the server to store the VMs (DAS) I reckon if I understood this correctly Hyper-converged infrastructure must be that the storage be residing on different server, and the VMs stored on the storage server ? is that what they call Hyper-converged infrastructure, cause it allows more flexibility .
And can I do this with a home build NAS, like bunch of cheap disks and on top of them something like FreeNas or Openmediavaullt or openfiler (what do you recommend), and be storage server, then another server be KVM server, and the KVM will have the VMs located on the storage server would that qualify as Hyper-converged infrastructure
Someone hit me with some sense
-
Well non-local storage can and does work, its slow in contrast with local hard-drives installed into a server.
You need redundant storage should any storage node fail. Plus many other things.
It adds complexity without the benefit in most cases.
-
Hyper-converged systems include everything you'd need. @scale would be great to explain it.
-
True HCI means it's all already configured, and you don't have to muck about setting up storage. From Wiki Pedia Hyperconvergence moves away from multiple discrete systems that are packaged together and evolve into software-defined intelligent environments that all run in commodity, off-the-shelf x86 rack servers.[6][7][8] Its infrastructures are made up of conforming x86 server systems equipped with direct-attached storage.[9][10] It includes the ability to plug and play into a data center pool of like systems.[11][12] All physical data center resources reside on a single administrative platform for both hardware and software layers.[13] Unifying all platform types to one, together with single vendor management, eliminates traditional data center inefficiencies and reduces the total cost of ownership (TCO) for data centers.[14][15][16][17]
So I'm a little confused where you think NAS is required for this. Shared storage doesn't ever imply NAS/SAN. You're local storage can always be shared with the other hosts via many different mechanisms. Gluster and @StarWind_Software are two quick examples.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
But I still dont know how the PROs do it, currently I use the storage build in the server to store the VMs (DAS) I reckon if I understood this correctly Hyper-converged infrastructure must be that the storage be residing on different server, and the VMs stored on the storage server ? is that what they call Hyper-converged infrastructure, cause it allows more flexibility .
No, hyperconveged replaces the old pyramid design of the storage being elsewhere. With HC, storage is normally on the same servers. ANd THAT is what makes it more flexible
-
-
Thanks, still watching it.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
Thanks, still watching it.
Hopefully it was useful!
-
Okay I am understanding more and more about this.
But can somebody answer me the following:
Is it normal for someone to install hyper-visor and virtualize storage on the same server ?
Why sometimes I hear about users running BTRFS or ZFS insides VMs and then allocating that storage to other VMs. Is this normal ?
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
Is it normal for someone to install hyper-visor and virtualize storage on the same server ?
Of course. Always has been normal. Since the day virtualization was invented. And in the SMB, this is realistically the only rational option, external storage has never been widely viable.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
Why sometimes I hear about users running BTRFS or ZFS insides VMs and then allocating that storage to other VMs. Is this normal ?
No, that is not normal nor sensible unless you are building high availability clustering within those VMs. But you would not likely use BtrFS or ZFS for this, but more typically a clustered file system like GFS2. More or less, anytime you hear of someone using ZFS it's for something incredibly stupid. ZFS is amazing and I've been working with it for twelve years, but the recent belief that it is magic is just another example of SMB IT people hearing a word and deciding that since they don't understand it, it must be magic.
There are good times to do what you describe here, it's called a VSA approach. Vendors like @StarWind_Software and @HPEStorageGuy do this, but they don't do it with ZFS, they have custom software that handles HA clustering, that they do it in a VM is just a limitation of their access to the underlying hypervisor. VMware used to do this, but has VSAN now. Starwind only does this on non-Hyper-V platforms, on Hyper-V they skip the VM and run right on the hypervisor itself.
Building your own HA Storage VMs on top of your hypervisor is certainly possible, but is most definitely an "expert level" process. And what is available to build for yourself is quite limited. For all intents and purposes, doing this in this manner will only be done with either Starwind or HPE VSA products, this is exactly what they are built for and they both do it very well.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
Why sometimes I hear about users running BTRFS or ZFS insides VMs and then allocating that storage to other VMs.
If you mean running a single storage server on top of the hypervisor and then providing iSCSI or NFS storage for mounting of other LOCAL VMs, this would border on the insane.
-
This is what I was looking for.
Cause when I heard about what they are doing and how this is done = دخلت بل Øيط
It is an arabic saying literary meaning that you ran into brick wall
I no longer was able to compute, Im aware that I dont know everything but this method of virtualization storage in VMs then sharing it to other VMs appeared to me very complex yet I was very curios and wished to attempt it.I reckon it is better to go back a step and focus on more realistic goals.
-
Are you familiar with DRBD in the Linux world?
-
I thought I saw DRBL, and I was like YAY I know that one cause I worked on CloneZilla project long time ago.
But alas it is DRBD, no I am not but reading about it more now.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
I thought I saw DRBL, and I was like YAY I know that one cause I worked on CloneZilla project long time ago.
But alas it is DRBD, no I am not but reading about it more now.
LOL
-
Then look at someone like @scale who implement their own storage system directly on the hypervisor itself. So the hypervisor is the only component that needs to be spread out to many nodes. It's kind of like DRBD, being in the hypervisor, but is scale out rather than just a two node mirror. The storage and the hypervisor and the management are all really one thing. Very tightly integrated.
-
@scottalanmiller said in Hyper-converged infrastructure (I missed the storage part):
node mirror. The storage and the hypervisor and the management are all really one thing. Very
Yeah I am, I like the fact that they use KVM, and explain it by saying stand alone ESXi truly became replaceable, and VMware knows that, that is why they are pushing in backup/replication/storage/network but not the core virtualization. Cause as I believe we reached the point where KVM/Xen can do just as good performance in running virtual machines.
But its the other stuff that is important now.
And we no longer can say stuff like ohh well I have ran ESXi for 10 years and I never have problem, cause the same will apply for KVM, it just people are not using it that much.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
But its the other stuff that is important now.
Like the storage and the management layers.
-
@msff-amman-Itofficer said in Hyper-converged infrastructure (I missed the storage part):
And we no longer can say stuff like ohh well I have ran ESXi for 10 years and I never have problem, cause the same will apply for KVM, it just people are not using it that much.
We've been saying that about Xen for even longer
