My amp makes a buzzing sound when it is supposed to be set too clean. Could I need to replace something in the amp? It is a little crate amp if that helps any
Is this when you turn the clean volume all the way up? That's most likely the cabinet vibrating, and that's something pretty much inherent in all cheap solid-state amps.

However, if you're talking about a buzz coming through the speaker, that's your hum which is inherent with playing electric guitar. What guitar do you use to play through? Chances are if it's a cheaper guitar with single coils, there will be a fair bit of hum, even on clean.
It is a crate amp, it is a buzzing coming from the speakers. I don't even have to play to get it.