Caching Needs and SSDs
-
Easy way to remember is that the H series are RAID with numbers like 6+ and are HBAs (non-RAID) with low numbers.
-
Double caching seems dangerous or at least slow things down a little.
Do you mean like this:
PERC Cache -> SSD Cache -> HDD Volume?
I'd rather go: SSD Cache -> HDD Volume... using write-through to the SSD Cache.
I can see going like this without issue:
RAM Cache -> SSD Volume
or
RAM Cache -> HDD Volume
or
SSD Cache -> HDD Volume -
@Tim_G said in Caching Needs and SSDs:
Double caching seems dangerous or at least slow things down a little.
Not dangerous or slow. We do similar things for high speed websites. But in the opposite direction, of course.
Double caching is no more dangerous than single caching, if caching is dangerous, it's dangerous. If it is safe, it doesn't matter how many times you do it.
As for latency, it's not an issue and all hardware RAID systems like this do it under the hood because it's the only good way to add the SSD layer. You always want a RAM cache on the front end, and you need disks on the back end. The question is, do you want SSD in the middle or not.
If you think about the performance leap from spinners to SSD, it makes total sense to have SSD in front of them for cache. Even a little SSD helps the spinners a LOT. Same difference from SSD to RAM. RAM is orders of magnitude faster than SSD, just like SSD is over spinners. So the gains are similar. And RAM doesn't wear like SSD does, so it doesn't just speed things up but allows for fewer and more efficient writes and that means longer SSD life which actually adds reliability.
Also, cache allows writes to happen faster allowing more data to be protected before a failure.
-
@scottalanmiller said in Caching Needs and SSDs:
@Tim_G said in Caching Needs and SSDs:
Double caching seems dangerous or at least slow things down a little.
Not dangerous or slow. We do similar things for high speed websites. But in the opposite direction, of course.
Double caching is no more dangerous than single caching, if caching is dangerous, it's dangerous. If it is safe, it doesn't matter how many times you do it.
As for latency, it's not an issue and all hardware RAID systems like this do it under the hood because it's the only good way to add the SSD layer. You always want a RAM cache on the front end, and you need disks on the back end. The question is, do you want SSD in the middle or not.
If you think about the performance leap from spinners to SSD, it makes total sense to have SSD in front of them for cache. Even a little SSD helps the spinners a LOT. Same difference from SSD to RAM. RAM is orders of magnitude faster than SSD, just like SSD is over spinners. So the gains are similar. And RAM doesn't wear like SSD does, so it doesn't just speed things up but allows for fewer and more efficient writes and that means longer SSD life which actually adds reliability.
Also, cache allows writes to happen faster allowing more data to be protected before a failure.
I have a main Hypervisor running with a PERC H730p (2gb cache), configured with write-back (uses the 2gb cache) for all volumes, even the SSD SanDisk DAS Cache slow HDD volume.
But if someone has a H330 (without a cache), you can still use an SSD cache (such as with SanDisk DAS Cache) perfectly fine. You don't NEED to have the onboard RAID card cache. You can even write-through to your SSD cache volume.
-
@Tim_G said in Caching Needs and SSDs:
But if someone has a H330 (without a cache), you can still use an SSD cache (such as with SanDisk DAS Cache) perfectly fine. You don't NEED to have the onboard RAID card cache. You can even write-through to your SSD cache volume.
Of course you can use software to create caching, but you are doing everything in software, the H330 is just a SAS controller, nothing more. You can do RAM cache too. But your SSDs aren't getting caching like they should in the SanDisk DAS Cache scenario, so you aren't getting good performance and are unnecessarily beating up the SSDs.
-
I WISH there was a built-in way in Windows Server to use RAM as cache. I think it's awesome that StarWind has it.
-
@Tim_G said in Caching Needs and SSDs:
I WISH there was a built-in way in Windows Server to use RAM as cache. I think it's awesome that StarWind has it.
Yeah, the reason it is not native, I would think, is because you need it lower in the stack. Putting it in a VM would be weird if individual VMs were doing loads on uncoordinated RAM cache syncs to partner VMs.
-
@scottalanmiller said in Caching Needs and SSDs:
Also, the need for the battery went away long ago. That's a 2000's problem.
Do what? This was a standard feature as recently as 2012 on the Dell T600 line.
-
@JaredBusch said in Caching Needs and SSDs:
@scottalanmiller said in Caching Needs and SSDs:
Also, the need for the battery went away long ago. That's a 2000's problem.
Do what? This was a standard feature as recently as 2012 on the Dell T600 line.
Standard as a cheaper downgrade, right?
-
@scottalanmiller said in Caching Needs and SSDs:
@Tim_G said in Caching Needs and SSDs:
But if someone has a H330 (without a cache), you can still use an SSD cache (such as with SanDisk DAS Cache) perfectly fine. You don't NEED to have the onboard RAID card cache. You can even write-through to your SSD cache volume.
Of course you can use software to create caching, but you are doing everything in software, the H330 is just a SAS controller, nothing more. You can do RAM cache too. But your SSDs aren't getting caching like they should in the SanDisk DAS Cache scenario, so you aren't getting good performance and are unnecessarily beating up the SSDs.
Good performance? You mean best performance. You're still getting much better performance than just having HDDs. Not everyone can afford or has a need for BEST performance. You still get good performance without a cache-cache. The whole point of the SSD cache is to speed things up. Without a cache on the PERC card in front of your SSD cache, you're not missing out on a ton of performance or life expectancy generally. Of course if your first goal is performance, then yes you'd get the H730p and not the H330.
You can have a really nice performing system with a H330, SSD cache, and HDD storage volume, that costs a lot less than your "best" performing system.
Enterprise SSDs have a crazy long life and you aren't beating them up at all on a system setup like that... if it was used for some really crazy throughput, it would look a lot different. Even using them as a cache (in normal use cases), they will still most likely out-live their life expectancy, or be replaced through your dell warranty if they do go early.
I've seen them used with and without a cache in front of SSDs, with very little difference.
Don't get me wrong, I do realize that an SSD used without a cache for it in an environment that has a lot of IOPS will perform less in performance and life expectancy. But under general use scenarios where a H330 would be used... no, not so much.
-
@Tim_G said in Caching Needs and SSDs:
Good performance? You mean best performance. You're still getting much better performance than just having HDDs.
If you consider HDDs a base line. But I don't, I consider SSD a baseline today. And by good performance, I mean reasonable performance for the investment. Just like straight HDDs are pathetically slow without cache by our modern standards, so are SSDs.
-
@Tim_G said in Caching Needs and SSDs:
You can have a really nice performing system with a H330, SSD cache, and HDD storage volume, that costs a lot less than your "best" performing system.
Why do you feel it will cost less? And more importantly, why do you feel it will be cost effective? And it's not JUST performance, it's also killing the SSDs.
-
@Tim_G said in Caching Needs and SSDs:
Enterprise SSDs have a crazy long life and you aren't beating them up at all on a system setup like that... if it was used for some really crazy throughput, it would look a lot different. Even using them as a cache (in normal use cases), they will still most likely out-live their life expectancy, or be replaced through your dell warranty if they do go early.
True, but it is still a lot of increased risk for almost no cost savings.
-
Things like databases feel the caching the most. Rapid small writes.
-
@scottalanmiller said in Caching Needs and SSDs:
Things like databases feel the caching the most. Rapid small writes.
That's why if you are running a database or other heavier IOP intensive applications, you wouldn't choose the H330. You'd put in some more money and do it right for the job.
it's also killing the SSDs.
It depends on the load, that's my point. I'm basing this on the fact that the engineer building the server is buying the right parts for the load, for the right costs.
But a H730p is a lot more money than a H330. That costs more than replacing an SSD 8 years down the road... which would have most likely needed replacement even with caching.
-
@Tim_G said in Caching Needs and SSDs:
But a H730p is a lot more money than a H330. That costs more than replacing an SSD 8 years down the road... which would have most likely needed replacement even with caching.
Haven't looked, what what is the price difference? It's bigger than just cache, though, one is hardware RAID and one is software, as well.
-
Just looked on xByte, the price delta is $230. And that's for the big 2GB cache model.
-
@scottalanmiller said in Caching Needs and SSDs:
@JaredBusch said in Caching Needs and SSDs:
@scottalanmiller said in Caching Needs and SSDs:
Also, the need for the battery went away long ago. That's a 2000's problem.
Do what? This was a standard feature as recently as 2012 on the Dell T600 line.
Standard as a cheaper downgrade, right?
Standard as in it was the "Dell Recommended" option at the time.
And it looks like it was 2011.
And it looks like the R720xd I purchased from XByte to replace that server has the PERC H710P with a battery.
-
I feel like our machines in the 2000s from HP started shipping with NVRAM. It was close to the 2000s at the least.
-
@JaredBusch said in Caching Needs and SSDs:
@scottalanmiller said in Caching Needs and SSDs:
@JaredBusch said in Caching Needs and SSDs:
@scottalanmiller said in Caching Needs and SSDs:
Also, the need for the battery went away long ago. That's a 2000's problem.
Do what? This was a standard feature as recently as 2012 on the Dell T600 line.
Standard as a cheaper downgrade, right?
Standard as in it was the "Dell Recommended" option at the time.
And it looks like it was 2011.
And it looks like the R720xd I purchased from XByte to replace that server has the PERC H710P with a battery.
This page here says it uses NVCache. Why does it have a battery?
