Ask HN: LLM Logic Programming Research?

Is there any research into using something like Transformer but for direct logical inference?

I have found papers which discuss using LLMs to transform natural language into something like Prolog and run logic as a separate and traditional symbolic engine.

I have a hunch that it would be more powerful to skip the generation step and somehow integrate symbolic reasoning at the attention-wordvec level.

Recommend any papers?