If I'm understanding this correctly, the actual canvas itself will remain in the center of the window, whatever you are doing, even if you change its size.
I'm guessing that your other layers are perhaps of a different size to your original canvas size? Or, you are zooming in or out?
If so, make them all the same size?