I think you're describing regedit (although not fuzzy)
Better starting point would be Group Policy, which is mostly a layer over the registry but containing pretty good descriptions of what a setting does. It has a Powershell module, so combining that with fzf and a preview pane which shows the description might ctually be pretty neat, but probably not very fast.
And it also lacks any visual cues, so if you're used to some icon in the main settings apps, you'll not see it in regedit