I installed Neo4j Desktop locally, as non-admin user. When there is a new version Neo4j Desktop would inform me to update, which I agreed.
However then a GUI prompts for entering an admin password. If not, update/install is aborted. This forces to manually remove Neo4j Desktop and install from scratch, which causes other problems, see the following link