Crying Over 2,000 Years Later – Why?

Chazal say that any generation that doesn’t merit to see the rebuilding of the Bet HaMikdash it’s as if they destroyed it. Why is that fair?