have you checked the mount bolts?
also, you want there to be free play, up and down atleast. otherwise, your clutch wont be fully engaging, and will cause it to slip. not good.
is there a spring on the pedal? sometimes that can help with it moving around.
but, id check the condition of the mount bolt, and bushings if its got any.