I've found with me that, after trying keto for ages and loving how I felt but hating the diet itself, I managed to pin point the issue down to grains. Any form of grain, be it rice, wheat, barley, oats etc, all seemed to mess me up big style. I'n now on a diet of mostly fruit, nuts, beans, seeds and tubers and I'm better than I was on keto on almost every measurable factor. I think cutting out the carbs initially improves the lives of most people because it's a group of food that contains the biggest offenders in terms of IBS related trigger, but it's rarely carbohydrate in itself.
In terms of reintroducing foods, don't go back to carbs and cut back! You're just setting yourself up to fail. Just reintroduce carbs slowly up. Start with tubers and root veg, as from what I've read they're often the easiest in terms of digestion. Then move on to fruits, then nuts, then seeds, then finish with grains. It could well be you're gluten intolerant so there are only a few types of grain you're sensitive to.