Ignore your co-workers. Don't wait. Just get started.
Waiting kills startups.
Put up a landing page, build 1.0, start figuring out if anyone would really buy your product/service. If you can't get anyone to bite, maybe the idea isn't ready. If you get any traction then you know the market is there.
Living in "small town" NS has some advantages. You probably have a decent internet connection and your current paycheque goes a LOT further than it would in the big city. If you decide to quit your job and dive into your startup full time you'll have a longer runway.
You are NOT alone. You ARE part of the world. You can make connections HERE (you've already started) or reddit or just about any other place where other people in the same situation as you hang out.