Caitlyn Jenner hasn't found complete happiness as a woman — and pals say the Olympic decathlon champ turned sex-swapper is boozing the blues away as she struggles with self-esteem issues!

"She's drinking a bottle of wine by herself every night