The Tower of London.  And if that's not historic enough
for you, there's part of the Roman wall across the street.