Where have you been in Hong Kong? There is all kinds of history. Downtown Hong Kong island has a number of colonial buildings. There is the original courthouse or something in a plaza around Central. The old clock tower is at Admiralty. The Star Ferry has been around for decades. There are multiple active temples around the city. Tai-O village on Lantau still has wooden junks. If you wander around Victoria Peak there is Victoria Peak Gardens, which has a colonial building or two. The 100 miles of hiking trails in the county park system are there because a governor in the 60s or 70s reserved large areas from building. The city still has bilingual signs in English and Cantonese, which I can assure you is not the case in both Mainland China and Taiwan. They drive on the left side of the road--a very non-Mainland thing. There are double-decker buses all over, also very British. Even things like the ubiquitous public notices for comment on pre-construction sites is a very Western idea. The historic Jockey Club has it's name on a dorm in every university campus (and, of course, the famous race-track is still racing horses). Even the names of places are their British names, sometimes even in the Chinese version ("Admiralty" is "Golden Clock", since the clock was the key feature, since you'd set your chronometer by it). Beijing, for example, renamed much of it's pre-1949 names to something more revolutionary. Then there's the "socks" milk tea, a strong milk tea that is a localized version of colonial British tea + milk (much better than the original, I might add). There's even a HK culture museum. (There's a HK history museum as well, but it's been a little edited to support the Mainland ideology.)
But perhaps nothing says "history" quite like that most every day item: money. Back in the 1800s, banks issued money. Nowadays the State issues money, but HK notes are still issued by three banks (albeit with strict supervision of the State), which have their names on them. Personally, I find the ones from the Hong Kong and Shanghai Banking Company to be the most attractive. The coins bear more than a passing resemblance to British coinage, too.
I think Hong Kong is a great example of history being integrated into the culture.