Sitaram Sethi allegedly committed the offence in a fit of rage following a quarrel with his wife at their house in Sorada on Saturday, said officer-in-charge of local police outpost BK Sahu said.
The baby was first admitted at Balipadar hospital and then shifted to the sub divisional hospital at Bhanjanagar and MKCG Medical College and Hospital here.
The condition of the baby was stated to be stable, medical sources said here.
Police said preliminary investigation suggested that frequent quarrel between the accused and his wife was the cause of the incident.
Sitaram who was virtually not doing any work, was depending on the income of his wife.
His wife maintained the family with the income as a daily labourer.
Spotted: Sridevi's daughter Jhanvi Kapoor in Bandra
Photos: Kajol, Sridevi, Raveena Tandon at Mumbai airport
Photos: Akshay Kumar, Anushka Sharma, Ranveer Singh at Umang 2017
Photos: Sunny Leone, Shah Rukh Khan on Salman Khan's 'Bigg Boss 10'
Birth anniversary special: Remembering Subhas Chandra Bose