There are many facets to the problem, some of them are easily solved with the technology we have. We need to learn from the tools people already casually program with: VBA, Matlab, Excel, Turbo pascal in its days...etc.
They may have many defects as languages, but they got a lot of the 'casual' right; we could start from there.