This is impossible to answer. I've lost two brothers myself, but still have two remaining and a sister. So I usually say, "there used to be six of us, but now there are four" or some variation.