when you look down from the top of the grip do you see anything that might be blocking it like a pin, tape, glue?
normally you cant just push straight up, i normally just pull it out from the top then if it wants to be difficult i just jiggle it a bit and it works it self out.
