Also, always raise even for 404 not found (should not happen now that we'll use GraphQL to find the exact set of versions)
