I'm a guitar player but I love the drums, I just want to know what you guys would recommend for my first drum kit. I need something not overly expensive but a kit that won't break on me.
A little more information would be handy, so we know what to recommend. Things like:

Maximum budget?
For practice or for eventual live use?
Willing to buy used?

If you fill in the gaps for us, we should be able to help you out
I wont tell you what to buy, but I will tell you what not to buy.

Don't go to Guitar Center and buy a cheap Sound Percussion kit. Buy used! Go to Craigslist or ebay and find a nice used Pearl Export or Tama Rockstar. You can find them for fairly cheap and often times with hardware as well. Buying used is always the best option for a new drummer.