Close. What's supposed to happen is that when you strike a ferromagnetic material, you align the orbits of the electrons, thus creating a net magnetic field. The same effect happens when you bang two hammers together, head-to-head. Do that enough times, and you'll magnetize the hammer heads.
Sorry guys, I'm a solid state physicist.
Anyway, I can just press the pole piece out with a screw driver. I've never had to whack them.