I Am Leaving To Spend More Time With My Family...

Have you ever noticed when an official resigns in disgrace or comprimising situations they always say "I am leaving to spend more time with my family."
I imagine that may be true sometimes but you have to wonder...