Arsenal had fought back from behind to lead through a quick-fire pair of goals from Lukas Podolski and Kieran Gibbs in the last 10 minutes, only for Graham to pounce at the death to take a gripping tie to a replay.
Swansea had led through a 58th-minute effort by Michu but appeared to be heading out until Graham found the roof of the net with three minutes to play. Michu began on the bench for Swansea, with an eye on the League Cup semi-final against Chelsea, while Arsenal made three changes and deployed Olivier Giroud as a lone striker.
In pictures: Bollywood celebs who share birthdays
'Kahaani 2' trailer launch photos: Vidya Balan takes an auto ride
Photos: Priyanka Chopra's family, celebs watch 'Ventilator' at MAMI
Photos: Raveena Tandon, Sohail Khan at Marathi film 'Bhay' music launch
SRK-Gauri anniversary: B-Town stars and their non-filmi better halves