Probably a loaded question but how has your 70B model stood against the test of time? I would expect models like Qwen2-72B to outperform yours noticeably? (I get why you can’t simply fine tune that due to the restrictions on that license)
What do you think about its performance on your queries?