Show HN: Tarot Raven - Tarot chatbot using RWKV-Raven-3B on your iOS device
apps.apple.com
Backstory: Originally conceived as an augmented reality tarot app circa 2016, rebranded as an AI tarot reading app August '23 with on-device Vicuna-v1.5-7B but even with 3bit quantization the model required at least 4GB ram to run inference which limited the app to iPhone14 while still prone to out-of-memory crashes and chat functionality that was limited to devices with at least 8GB.
This most recent update/rebrand introduces RWKV-Raven-3b reducing the memory requirement to under 3Gb making the app with full chat usable on iPhone 12 and above at the cost of generated output quality. Given its size the performance of RWKV-Raven-3B is quite impressive.