Remember to forgive yourself. After the dust settles from leaving (insert cult/religion name here), there's a processing that occurs for anyone who put all their eggs in one basket, and part of it includes self-forgiveness.
The anger I had for losing decades of my life is still there somewhat; I'm a work in progress. But part of my healing was to realize that I was also subconsciously angry with myself for surrendering my life, my will, my friends and family for the sake of becoming a child of God.
The healing continues.
I am not really angry. My journey away from religion started early (in my teens). It was a process of freeing myself from the curses of the culture in which I grew up. To me, it was simply a matter of growing up -- intellectually, morally, and culturally. I chose my path, and I am glad I did!
Oh. When I let go of the whole concept of sin, the freedom I felt inside was life-changing. I've had some anger, too, about time lost. I'm dealing with it. And you're right. Forgiving myself has been paramount.