The Gemara says that any generation in which the Beit HaMikdash isn’t rebuilt, it’s as if it was destroyed in that generation teaches that it’s natural to have a beit hamikdash on Earth. If there isn’t one, that means that we are actively preventing it from being here.