So I found a quirk, not sure if it's an actual bug. For incremental backups to work you have to use the NFS syntax (BACKUP_URL="nfs://<server>"). If you mount the share, and then write to the local mount it won't do incremental.