Public and private key files were created but not removed when testing the Vault module. This was fixed by adding a task to remove them to Vault's env_cleanup playbook.
