"Why are you interrupting him? If you want to create a ruckus, you can go out," Hazare told Rai. "It is not right to interrupt when someone is speaking," he added.
Hazare publicly rebuked Rai, asking him to leave the venue if he went ahead with disrupting the former Army chief's speech.
Singh, who was sharing stage with Hazare, said, "We should not split and form different groups in our fight against corruption."
The AAP leader raised some objections, which led to a heated argument between him and Gen Singh, following which the septuagenarian asked Rai to immediately leave the village.
"We have not asked you to fast, if you want to create such noise then you can leave Ralegan Siddhi," Hazare told the AAP member.
The anti-graft crusader, whose fast entered fourth day today, has parked himself near the Yadav Baba temple at Ralegan Siddhi village in Maharashtra's Ahmednagar district, under the banner of 'Jantantra Morcha'.
The 76-year-old Gandhian said he will not break his fast till the Jan Lokpal Bill is passed in Parliament.