When I export the key, I want to export the private key as well?
That depends. If you are only ever going to have devices using the key to auth against the DC that you created it on, then no.
But if you need to install the cert on a device and then have another device auth to that first device, then that first device needs the private key.
Thank you for the explanation.