[gasgasman]

Is it the caliper its self moving, or the whole bracket?

If it is just the caliper, the mounting slide pins are worn.
The carrier bracket should not move at all, since it is locked down tight by the rear wheel axle bolt.