How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller
-
We have a RAID controller in a rebuild / resilver loop. It is RAID 5 and kicked off because of a hot spare being present. It is rebuilding over and over again. We need to stop it and just live with it degraded for now. But we can't find a way to tell it to just stop attempting the rebuild and live with the degradation.
-
Just pull the drive.
-
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. 
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. Maybe I misunderstood you. Drives are hotswap so it doesn't matter. If you pull the one that is rebuilding it will stop because there are no more drives to rebuild with. It will not affect anything.
-
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. Maybe I misunderstood you. Drives are hotswap so it doesn't matter. If you pull the one that is rebuilding it will stop because there are no more drives to rebuild with. It will not affect anything.
It'll remove the one that is rebuilding AND the one that is rebuild. Yes, they put two arrays on a single set of drives.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. Maybe I misunderstood you. Drives are hotswap so it doesn't matter. If you pull the one that is rebuilding it will stop because there are no more drives to rebuild with. It will not affect anything.
It'll remove the one that is rebuilding AND the one that is rebuild. Yes, they put two arrays on a single set of drives.
Wow. Didn't even know you could do that with hardware raid.
-
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. Maybe I misunderstood you. Drives are hotswap so it doesn't matter. If you pull the one that is rebuilding it will stop because there are no more drives to rebuild with. It will not affect anything.
It'll remove the one that is rebuilding AND the one that is rebuild. Yes, they put two arrays on a single set of drives.
Wow. Didn't even know you could do that with hardware raid.
Yeah, it's terrible, but you can.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@Pete-S said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Just pull the drive.
We had thought of that
Multiple arrays on it, though, and at least one is working. Maybe I misunderstood you. Drives are hotswap so it doesn't matter. If you pull the one that is rebuilding it will stop because there are no more drives to rebuild with. It will not affect anything.
It'll remove the one that is rebuilding AND the one that is rebuild. Yes, they put two arrays on a single set of drives.
Wow. Didn't even know you could do that with hardware raid.
Yeah, it's terrible, but you can.
Wow - I too had no idea you could do that.
-
If there is a command interface for the RAID card, you might be able to kick some command to tell it to stop..
-
@Dashrender said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
If there is a command interface for the RAID card, you might be able to kick some command to tell it to stop..
There is, but I don't know of any such command.
-
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
-
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
-
@wrx7m said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
System is currently available. In theory there are backups, but no capacity to test them and they are across the country. This isn't a managed customer, so we have no documentation, no visibility, no access. We just have to trust that they say that there are backups. But they confused their UPS with their NAS calling both their "backup" so we have literally no clue what they do and do not have.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@wrx7m said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
System is currently available. In theory there are backups, but no capacity to test them and they are across the country. This isn't a managed customer, so we have no documentation, no visibility, no access. We just have to trust that they say that there are backups. But they confused their UPS with their NAS calling both their "backup" so we have literally no clue what they do and do not have.
I'd burn a couple of billable hours at least doing some investigation into their things using Mesh Commander. That way you have a better idea of where they are on the we're screwed o'meter.
-
@dafyre said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@wrx7m said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
System is currently available. In theory there are backups, but no capacity to test them and they are across the country. This isn't a managed customer, so we have no documentation, no visibility, no access. We just have to trust that they say that there are backups. But they confused their UPS with their NAS calling both their "backup" so we have literally no clue what they do and do not have.
I'd burn a couple of billable hours at least doing some investigation into their things using Mesh Commander. That way you have a better idea of where they are on the we're screwed o'meter.
That'd be great. But their CIO doesn't like us doing anything.
-
@scottalanmiller I just checked this morning. Still at 6% / 100%. No progress on the rebuild. Stuck in a loop, or just simply stuck and still a de facto RAID 0 right now.
-
@CCWTech said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller I just checked this morning. Still at 6% / 100%. No progress on the rebuild. Stuck in a loop, or just simply stuck and still a de facto RAID 0 right now.
Could be either, the interface isn't clear any longer.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@dafyre said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@wrx7m said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
System is currently available. In theory there are backups, but no capacity to test them and they are across the country. This isn't a managed customer, so we have no documentation, no visibility, no access. We just have to trust that they say that there are backups. But they confused their UPS with their NAS calling both their "backup" so we have literally no clue what they do and do not have.
I'd burn a couple of billable hours at least doing some investigation into their things using Mesh Commander. That way you have a better idea of where they are on the we're screwed o'meter.
That'd be great. But their CIO doesn't like us doing anything.
It's even worse than that. CIO wants us to make the current situation work for 2-3 more years without spending any money.
CIO is completely out of touch with reality, Intentionally ignoring our advice and is allowing a meltdown to happen.
-
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@dafyre said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@wrx7m said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@scottalanmiller said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
@JaredBusch said in How to Stop an Ongoing RAID Rebuild HP P420i RAID Controller:
Shut the system down pull the failed drive and the hot spare turn it back on. You should be up and running on a degraded RAID array
We are terrified to turn the system off at this point.
I am guessing no backups? Is the system available at all?
System is currently available. In theory there are backups, but no capacity to test them and they are across the country. This isn't a managed customer, so we have no documentation, no visibility, no access. We just have to trust that they say that there are backups. But they confused their UPS with their NAS calling both their "backup" so we have literally no clue what they do and do not have.
I'd burn a couple of billable hours at least doing some investigation into their things using Mesh Commander. That way you have a better idea of where they are on the we're screwed o'meter.
That'd be great. But their CIO doesn't like us doing anything.
Then why are you still helping them?
