Al-Qaeda chief Osama bin Laden's death will be a difficult time for members of his family, who even though had distanced themselves from the terrorist after 9/11, still considered him as their "brother," a relative of bin Laden's has said.