Yes, California's population is in slight decline, the reason is that California did not build nearly enough housing in the past decades, making it increasingly unaffordable to live there.
From what I gather by reading and listening to those who left California this is one of reasons why they left/leave but certainly not the only one and often not even the main reason.