never tried to but I would say that the metal part has barbs and the plastic slot digs into the barbs. Just try pulling on it with a little wiggle. Will be in the garage later might look at one.
If I'm not misremembering, there is an elongated U shaped piece of metal between the knob and the handle causing a really tight pressure fit. It takes a fair amount effort to remove it, plan on new knobs. Chuck