To follow up to an offline request for more info...
Why do you need to avoid splitting RAID duties between a controller, and ZFS?
First, this is a general rule and not specific to any of the tech here. The RAID system just need to be intact, wherever it is.
Now, why is this?
In order for the data integrity systems to be able to do their job and protect the data, there needs to be deep insight and coordination between logical levels and the hardware itself. This is so that components looking for hardware failure can verify higher up the chain if there is a way to reconstruct the data. The layer doing the scrubbing and the parity or mirroring needs to know if the hardware integrity is still there and, if not, what it needs to do to recover. Either layer can do this, hardware or software, but what it can't do is talk between the two.
So if you have all hardware RAID, physical and logical layers can communicate to verify integrity. If you have all software RAID, you can do the same. But if the hardware layer and the logical layer cannot talk to one another, and one of them detects a problem, there is no way to do anything about it. Your overall system has all this information and data protection, but no way to do anything about it - the left hand doesn't know what the right hand is doing.
Hence why it is so important to pick one or the other. Riding the fence and trying to leverage both is where problems arise.
thanks all for reply
so i need:
1- backup my vms and recreate raid on Hardware and just present one logical drive to ZFS.
2-disable S.M.A.R.T service.
3-just use file system and not software RAID system of zfs.