I was 32, broke, and asking my mom to cover my rent when I finally left teaching. A decade later I didn't have to work anymore. You're not starting from scratch; you're starting with experience, and that changes everything.
I left Wall Street and bet on Main Street in my 30s. The real assets I brought were the skills, relationships, and scars I collected in the decade before, not youth. At 32 you're just starting to have enough data on yourself to choose the right hard thing on purpose.
I was in my late 30s, running a law practice I had built, when I realized I was trading my time almost exclusively for money and my cup was emptying. The average age of a successful startup founder is 40, and I have seen people in their 50s, 60s, and even 80s still changing and evolving, so 32 is not too late.