Thanks for your concern about this issue. The ability to view
revisions to a Site is intended functionality for both viewers and
collaborators. This includes files that have been deleted.

We are planning on giving Site owners the option to completely delete
files from their Sites, and preventing viewers from seeing earlier
versions. However, this functionality is not currently available.

Thanks again

Mike
The Google Sites Guide