I finally found the GPO setting that caused this issue-
Computer Configuration>Policies>Windows Settings>Security Settings>Local Policies>User Rights Assignment
Load and unload device drivers - Enabled with Everyone and NT Authority\Authenticated Users listed.
I had to change it to Not configured.
0_1528315769936_2b6b6a24-bede-47d1-bd4d-3df40eb2c368-image.png