That's what I'm afraid of. Has anyone have any experience of having the gears pop out?

And yes it feels worse when I shift quickly. But not all of the time.