"The Dark Knight" star, who turned 38 last January, said he and Barrymore had a fling when they were teenage actors.
"We went to see some bloody awful horror film, and that was the end of it. She never called again," Bale said. Barrymore, 37, is currently expecting her first child with art consultant fiance Will Kopelman.
Bale, 38, who will be reprising the role of Batman in upcoming film "The Dark Knight Rises" said he misses his Bat suit. "I have been deeply honoured to inhabit this character. It was a massive undertaking.
Physically, emotionally, every way. But suddenly we were in the final throes. I sat down and asked for a little space. I stared at the cowl for a good long moment and thought, 'Man, this one really took on a life of its own'," he said.
Bale is happily married to a former model and make-up artist Sibi Blazic, and they have a daughter named Emmeline.
Photos: Raveena Tandon, Sohail Khan at Marathi film 'Bhay' music launch
SRK-Gauri anniversary: B-Town stars and their non-filmi better halves
Birthday special: Popular mothers and daughters in Bollywood
Spotted: 'Kaabil' star Hrithik Roshan with dad Rakesh Roshan
'Rock On 2' trailer launch: Farhan, Shraddha enthrall audience with live gig