The Swiss 17-time Grand Slam champion came into the match against compatriot Stanislas Wawrinka with an enviable 11-1 head-to-head record but struggled to impose himself and was forced to dig deep before winning 4-6, 7-6 (7/4), 6-0.
Earlier, Serbian second seed Djokovic looking to wrestle the World no 1 ranking from Federer barely broke sweat against Spain’s Feliciano Lopez, wrapping up a straightforward 6-3, 6-3 victory in front of enthusiastic fans.
In-form Djokovic, fresh from his third China Open title in Beijing on Sunday, struck 12 aces and took advantage of some below-par serving by the left-handed Lopez, breaking him three times.
US Open champion Murray, 25, proved far too strong for Ukraine's Alexandr Dolgopolov, serving consistently well and seizing on five out of six break points to win 6-2, 6-2 in just 57 minutes.
It was the first match of the tournament for the Scot, who had a walkover into the third round. The top eight seeds received a first round bye.
Spotted: Virat Kohli, Anushka Sharma and other celebs at Mumbai airport
Photos: Salman Khan's 'special friend' Iulia Vantur at a song launch
Photos: Hrithik Roshan, Anushka Sharma, other celebs dazzle at event
In Pictures: Sex scandals involving Indian politicians
Photos: Abhishek Bachchan and Farah Khan at Boman Irani's birthday bash