I don't think someone like him at that time would necessarily perceive his actions as offensively racist. He'd feel it was all in good fun. Hell, when I was growing up, automatic, unapologetic racism was par for the course. Hell, kids happily chanted "Eenie meenie miney moe, catch a nigger by the toe" without most people batting an eyelash. My parents and their friends were very much in the minority when it came to this subject--and this was in upstate New York. It wasn't really till the late sixties that objections to racism became more widespread, at least as far as I could tell.