A judge declared a mistrial on Friday after a jury was unable to reach a unanimous verdict in the high-profile case of an American woman who killed her three young children.