Over a dozen people managed to swim to safety and some were rescued by local villagers.
The boat capsized near Balthighat under Bheja police station. "Search and rescue operations are on," a police officer said.
A district administration official said five bodies had been recovered. "Local officials launched rescue operations in the river," an official said.
The boat, with a capacity of 15, was overcrowded, police said.