Here's what a "little bit" of JavaScript can't do:
1. Manage subtle browser differences
2. Store and manage reactive state
3. Manage declarative updates
You can build a simplified version of React in under 100 lines of code, but that probably won't take care of subtle browser differences. A little bit of JavaScript can do a lot, but it can't do everything you need these days.