Arsenal had fought back from behind to lead through a quick-fire pair of goals from Lukas Podolski and Kieran Gibbs in the last 10 minutes, only for Graham to pounce at the death to take a gripping tie to a replay.
Swansea had led through a 58th-minute effort by Michu but appeared to be heading out until Graham found the roof of the net with three minutes to play. Michu began on the bench for Swansea, with an eye on the League Cup semi-final against Chelsea, while Arsenal made three changes and deployed Olivier Giroud as a lone striker.
Spotted: Alia Bhatt, Ranveer Singh, Neha Dhupia in Bandra
Photos: Salman Khan returns from Jodhpur to Mumbai
15 'peach' perfect photos of Priyanka Chopra at People's Choice Awards 2017
Photos: Tennis legend Andre Agassi meets Rahul Dravid in Mumbai
62 going on 16: These photos of Rekha prove she is 'forever young'