Connecting a NAS or SAN to a VMWare host
-
IOPS are throughput are only kind of tied together. But in practice, the higher the IOPS the higher the throughput. Each IOP, by definition, requires some amount of bandwidth, but it might be a pretty small amount.
Some workloads, like databases, typically are huge IOPS with very small throughput.
On the opposite side are fileservers which are typically tiny IOPS with huge throughput.
-
Sorry to sidetrack for a second, but I may be misunderstanding IOPS a little bit. Does the bit-size of an IO function vary, or is it 1-bit-per-I/O operation?
-
@art_of_shred said:
Sorry to sidetrack for a second, but I may be misunderstanding IOPS a little bit. Does the bit-size of an IO function vary, or is it 1-bit-per-I/O operation?
Correct, the "payload" of an IOP can be all over the place. An IOP would be a single SCSI or ATA command (operation) which might be really simple and tiny or it might be rather sizable. So while throughput could be roughly calculated as IOP x IOP Size, the IOP Size will vary per IOP so you would need to know the average size for a specific workload to have a good idea of the throughput.
-
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
-
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
LOL, that's correct obviously. It's pronounced that way, though, because people are thinking of "Input / Output Operation", the "Op" of operation makes the letters feel that way in your head. So people say IOP all of the time.
Here is the calculation as Wikipedia writes it...
IOPS * TransferSizeInBytes = BytesPerSec
-
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
-
@ajstringham said:
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
Sort of. IOPS is actually sort for "Input / Output Operations Per Second." So which letters stand for which words?
-
IOOP... Aye-Oop!
-
@scottalanmiller said:
@ajstringham said:
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
Sort of. IOPS is actually sort for "Input / Output Operations Per Second." So which letters stand for which words?
Never saw it with "operations" in there. And if so, where is the other "O"?
-
Something to think about....
Traditional hard drives have a transfer cap of ~6Gb/s from the media perspective. In reality no drive can deliver that. But they might push over 100MB/s which is not far off from 1Gb/s. But they rarely top 150 IOPS.
New SSDs are still capped at ~6Gb/s and while they will generally push a big more than 100MB/s, they can't push all that much more. However they routinely top 25,000 IOPS.
-
@art_of_shred said:
@scottalanmiller said:
@ajstringham said:
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
Sort of. IOPS is actually sort for "Input / Output Operations Per Second." So which letters stand for which words?
Never saw it with "operations" in there. And if so, where is the other "O"?
No idea, but it was always stated that way and I looked it up after I said it to make sure that it wasn't one of those things that I made up in my head and just assumed was true but it wasn't, it really does have "operations" in there.
-
@scottalanmiller said:
New SSDs are still capped at ~6Gb/s and while they will generally push a big more than 100MB/s, they can't push all that much more. However they routinely top 25,000 IOPS.
But that aren't good for DB storage even though you need fast speeds for SQL as you have a lot of transactional writes. and SSDs have limited writes.... hmm.
-
@thecreativeone91 said:
@scottalanmiller said:
New SSDs are still capped at ~6Gb/s and while they will generally push a big more than 100MB/s, they can't push all that much more. However they routinely top 25,000 IOPS.
But that aren't good for DB storage even though you need fast speeds for SQL as you have a lot of transactional writes. and SSDs have limited writes.... hmm.
Actually SSDs are ideal for databases. That limit write thing is a silly concept from a different era. Spinning rust have more limited lifespans than SSDs do. They just have different ways to measure and predict failure. Good SSDs have so many writes that their limitation is a positive, not a negative. SSDs + databases is the sweet spot. Nothing is better for a database. There is a reason that for the last five years nearly every high end enterprise database has been deployed to nothing except SSD.
-
@scottalanmiller said:
@art_of_shred said:
@scottalanmiller said:
@ajstringham said:
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
Sort of. IOPS is actually sort for "Input / Output Operations Per Second." So which letters stand for which words?
Never saw it with "operations" in there. And if so, where is the other "O"?
No idea, but it was always stated that way and I looked it up after I said it to make sure that it wasn't one of those things that I made up in my head and just assumed was true but it wasn't, it really does have "operations" in there.
I think you're making that up.
-
@scottalanmiller said:
@art_of_shred said:
@scottalanmiller said:
@ajstringham said:
@art_of_shred said:
OK, got it... but stop calling it an IOP. It's an Input/Output, not an Input/output Per. (sorry :P)
Lol Yup, it's either IO or IOPS. One is the actual thing, the other is a measurement.
Sort of. IOPS is actually sort for "Input / Output Operations Per Second." So which letters stand for which words?
Never saw it with "operations" in there. And if so, where is the other "O"?
No idea, but it was always stated that way and I looked it up after I said it to make sure that it wasn't one of those things that I made up in my head and just assumed was true but it wasn't, it really does have "operations" in there.
Probably because pronouncing IOOPS is weird, where IOPs (aye-ops) is easy to say
-
You're also going to need to know how read / write your environment is in terms of hitting the database, no?
-
@NetworkNerd yes, you need to know your read / write mix to know what IOPS you need and where you need them.
-
Would NIC teaming / link aggregation help at all from a VMWare standpoint (i.e. multiple uplinks from SAN / NAS to switch to host)?
-
@NetworkNerd said:
Would NIC teaming / link aggregation help at all from a VMWare standpoint (i.e. multiple uplinks from SAN / NAS to switch to host)?
Yes, but You usually use 10GB ethernet or fiber for it not your normal 1GB switch.
You also need switches designed for Iscsi/sans for the best performance.Granted it's been about 2.5 years since I've done a major SAN rollout so it could have change some since then..
-
@NetworkNerd said:
Would NIC teaming / link aggregation help at all from a VMWare standpoint (i.e. multiple uplinks from SAN / NAS to switch to host)?
If you are doing NFS (NAS) then yes. It increases the size of the pipe so improves throughput.
Keep in mind that you cannot team / bond an iSCSI connection. You have to use technologies like MPIO to improve throughput.
