its probably being held on by some sort of gasket sealer. As far as i know solvents wont harm the valve cover. Maybe try a razor blade to get the rubber off and then some carb cleaner to clean up the surface