The 79-year-old married Haines when he was 22-year-old and accepts that he could not cope up with things after he became a father.
"Pat became pregnant and we had our wonderful daughter Dominique, who is now 56. But it was the wonderful straw that broke an already very weak camel's back," thesun.co.uk quoted Caine as saying.
"I walked out of the marriage. The marriage breakdown was entirely my fault. I was too young and immature to take on the poverty and personal and professional failure," he added.
Caine is currently married to actress Shakira Baksh. He was recently seen in, 'The Dark Knight Rises'.
Photos: 'Dangal' girls Sanya Malhotra, Fatima Sana Shaikh's dinner outing
Photos: Salman Khan, Daisy Shah spotted at the Mumbai airport
Photos: Rakhi Sawant to play Honeypreet in Ram Rahim biopic
Photos: Arvind Kejriwal asks Kamal Haasan to join politics
Photos: TV actress who played goddesses on the small screen