Remove the entry for key. No-op if the key is absent.
Intended for tests and cleanup; production code rarely needs this.