Seeing your baby birds leave the nest is always the most difficult part of downsizing, but even after they're gone, downsizing from a larger home is very demanding.