Solid gold weights would be even denser, and then you wouldn't have to have the refrigerator.
Of course, for the densest weights, you're going to have to go with plutonium, but come on, that's just silly.
ED: Actually, osmium and iridium are denser, but I still recommend plutonium.