"Conventional weapons are destructive enough"
No, they really aren't. Israel has been peppered with hundreds of rockets on the time frame of days or weeks, and at the national scale, they were basically an inconvenience. One nuke, by contrast, can take out an entire city. North Korea currently has at best the capacity to really badly hurt South Korea before they were rendered militarily ineffective, and even then, for all the death and destruction they could cause, most of Seoul would still be there afterwards. If they have nukes, though, most of Seoul could be destroyed in one fell swoop. Or most of anything they can reach, which also includes an awful lot of China.
It turns out that if you plot the destructive radius of even very large nuclear bombs, many cities are actually substantially larger than just one. But, still, between fallout concerns and the fact that there is now a total hole in your city's infrastructure, one nuke is still probably enough to kill an entire city, if not necessarily every person in it. There aren't any conventional weapons we can say that about.
There also aren't any chemical weapons we can say that about. Their effects are very mean and very nasty and very hideous, but they're also a great deal more limited than the common conception of them. For instance, one of the characteristics that makes mustard gas appealing is that it's heavier than air, which means that it tends to collect in below-ground-level fortifications, forcing the enemy out. This same characteristic renders it useless for destroying a city.
As for biological weapons, well, we do tend to speak of them in the same breath as nuclear weapons. However, their big problem is that it's difficult to create a really effective one that is also guaranteed not to kill the user. You've basically got the choice of things like smallpox, which are effective and contagious but you won't be able to stop hitting you (if nothing else, your enemy may well consider medieval warfare a source of inspiration and just start dropping infected bodies on you), or you have things like anthrax which are effective, but being not particularly contagious means that it's actually quite difficult to get them into people at scale.
Even now, nukes are a problem.