You should do what makes you happy but be aware that jobs that pay a decent amount are rare. I've had two that paid over 26kbut I used to do lots of overtime, take phone calls at all hours (1am to discuss fees plans) and the second I became the live in nanny/ chauffeur for two spoilt children.
Yes I miss the horses and some of the great people I met. But do I miss diva bosses and lack of job security? No way!
I now earn 3 times as much as I did working with horses (on average) I have my horse on livery, have a good pension and a house with my partner.