The family also had a high fever and took another day off