The Fillmore has a long history of changing ethnic hands. Once upon a time it was a Japanese neighborhood. Once upon a time it was a Jewish neighborhood.
When people discuss the Fillmore and its history, that discussion tends to start at roughly 1945-1950 when there's just suddenly a black neighborhood. Like maybe it materialized out of the aether as a jazz center or something.