They are held in by a pin which goes through the handle, where it attaches to the spindle in the door. Push the plastic ring and door panel into the door, (away from the handle), and you'll see the end of the pin. push it out with something like a long thin punch, (a drill bit works, but be careful it doesn't shatter).