Very simple trick, not much in accordance with the general theme of the blog, but I get frustrated enough when I run into this problem in GIMP that I wanted to register it here, so I can never forget
Right click the layer, add layer mask, transfer layer's alpha channel to mask, select layer mask, select everything there, fill with white, optionally apply the layer mask.