This only changes how Unity rotates an object. That selection doesn't actually change the pivot/anchor, its already at the correct position.
If you've got it set to center, then it will always rotate from the center, and position will change to compensate for this.