You'd just end up mistaking commits to my private repositories for work. Also, private contributions have to be enabled in order to show up there.
The other edge case would be an environment where every employee is super active in OSS.
Currently I have a separate ‘home’ account for personal projects and I never touch the work ID from my home.
Also, you could and probably should create a new SSH key on the company laptop or a personal access token for HTTPS access so that it can be easily revoked when you leave.