Removes an element from the handle manager.
true if the handle was valid and an element was removed, false otherwise.
See Implementation
Removes an element from the handle manager.