After about 2 weeks or so of having a new set of strings, my low E always breaks right at my saddle, I have an RG321 (hardtail) if it matters.

I'd bet on a bur in the saddle. These things happen.

Inspect the saddle and if it is indeed burred as I suspect, get a small file set and GENTLY clean it up.

You could always use this as an oppurtune excuse to switch to graphite saddles
我会关闭我的耳朵,和我的心; 我会变成一个石头
"I will close my ears and my heart and I will be a stone"