I've done this exact thing, and I left for a very long time due to same reasons.
It was one of the best decisions I had ever made. You're making a good decision, you'll have a better life when you decide to come back, or if you decide to eventually quit. Hopefully you decide to come back lol...