Okay so figured it out with this guide.
From Windows administrative Powershell
ssh-keygen
type C:\Users\<username>\.ssh\id_rsa.pub | ssh
[email protected] 'cat >> .ssh/authorized_keys'
Exit administrative Powershell
Open Powershell
ssh
[email protected]
Logged in.