Simple recorder nothing too serious until I get good enough. My amp has a line-out in the back so I assume I need a splitter if I want to use my headphones as well.

Something like an 8-track I guess maybe even more basic. I plan on transferring the songs to my computer to then mess around with. Recommendations are appreciated.
Don't get an 8 track, get one of these: http://pro-audio.musiciansfriend.com/product/Line-6-POD-Studio-GX-with-POD-Farm?sku=250006

It plugs straight into your PC so you don't need to transfer your music afterward. Also, it comes with amp modeling software so you don't need to run things through the line out on your amp (which always sounds terrible)
Derpy Derp Derp Herp Derp