Here's how you can do this more precisely using only the Curves+ plugin by pyrochild.
https://forums.getpaint.net/topic/7291-pyrochild-plugins-2017-12-04/
Original Image (Layer 1)
Duplicate to Layer 2
Switch to Layer 2
Magic Wand Select (Global, 0% tolerance) background
Delete
Adjustments -> Hue / Saturation
Lightness: -100
Magic Wand Select (Contiguous, 0% tolerance) portions of Layer 2 that are the same color as each other
Switch to Layer 1
Copy
Paste into new Layer 3 (or 4, 5, 6, etc.)
Repeat previous Step 2.3 for each distinct color in Layer 2
Switch to Layer 3 (or 4, 5, 6, etc.)
Adjustments -> Black and White
Magic Wand Select (Global, 0% tolerance) background
Delete
Use color picker to select the greyscale color of the portions in Layer 3
Expand Colors -> More
Adjustments -> Curves+ (by pyrochild) -> Advanced
In: Value / Brightness
Out: Alpha)
Invert the Curve, straight diagonal line from top left (0,255) to bottom right (255, 0)
Adjust the curve with a third point to the greyscale value (from the color picker) on the top edge (<value>, 255)
Note: if the original image background wasn't white
You'll probably need to set a fourth point on the bottom edge to the greyscale value of the background (<value>, 0)
Magic Wand Select (Global, 0% tolerance) background
Delete
Adjustments -> Hue / Saturation
Lightness: -100
Switch to Layer 1
Use color picker to select the color of the portions in Layer 3
Expand Colors -> More
Switch back to Layer 3
Adjustments -> Curves+ (by pyrochild) -> RGB
Select Red ONLY, adjust the curve to the R: value on the left edge (0, <red value from color picker>)
Select Green ONLY, adjust the curve to the G: value on the left edge (0, <green value from color picker>)
Select Blue ONLY, adjust the curve to the B: value on the left edge (0, <blue value from color picker>)
Repeat Steps 3.1 to 3.10 for each layer created in step 2.3
Note: If the different colors overlap with each other, you'll need to find a solution to fix the borders at the overlaps (e.g. use lasso select to copy from the original image).