Yes, it is the contents of the layer. I have a small image that I was trying to double, and it expanded the size. I took the image and moved it to a new canvas, which was more than 10x the size of the image I was trying to double. It still doubles the entire canvas.