There's a category of expressions that are really lame but that I kinda like, and use occasionally, for that precise reason:
Cripes
Yeah, I use cripes a lot. I've started saying crumbs too.

Rhode Island-centric phrases that drive me batty:
"Not for nothin' but..."
"Side by each" (instead of side by side)
"Same difference" (this may be a not so local thing)
I also hate it whenever anyone says "irregardless."
I don't care for the term "wife-beater" as a term for a sleeveless tee-shirt anymore than I care for people beating their wives.
And finally, when people say "drive me batty." What the hell was I thinking?