After a little more thinking, what I am actually looking for is a per-pixel "paste" that can apply the "V" value of the source image pixel's HSV to the same pixel in the destination image, without affecting the H or S values. Kind of like how you can copy/paste per-pixel alpha values with the "paste alpha" plugin.
Or maybe there is a blend mode that only adds that data? Does something like that exist?