You know, if you really don't want to torture him with a visit to the vet, you could just buy some Frontline (or whatever) and start treating him. If fleas are responsible, improvement will be speedy; if they're not, well, he almost certainly has 'em anyway, so getting rid of them will do him good regardless. If he's still mangy-looking after a month, then you can start thinking about the vet.