"why didn't you spend your unemployment working on a project to flesh out your portfolio?"

Could the real answer be that you are just the kind of person who considers spending time on a reverse job application and then advertising it to be time better and more efficiently spent than working on a portfolio? And that is at least one of the reasons that you were probably hired by hopefully one of the better employers that were able to recognize that.