Paul, the thing is that while he was above all a producer, he had such a signature sound that the records he produced are associated with him as much as--actually, probably more than--they are with the artists who play and sing on them. To say you've been listening to a lot of Phil Spector just makes more sense than to say you've been listening to a lot of the Ronettes, Crystals, Righteous Brothers, Bob B. Soxx & the Blue Jeans, etc. etc. records that Phil Spector produced.
BTW, I bought that "Back to Mono" CD box when it was released & thought it sounded like utter shit. Still can't listen to it, and probably won't be going back to vinyl. Have they done an upgrade?