Mine does this too but I think it's normal as I remember this happening on other cars I've owned.
it is its called "engine shunt" - it moves due to torque from the engine moving it on its mountings - and the gearbox moves along with it as they are bolted together - the gear change mechinism will also move becuase if it didnt it would pull/push it out of gear !