My guess is, you are doing enough and aren't enough of a troublemaker that your boss cares to do anything about it, but you're not fooling anyone either. In a structural downturn, they're getting pressure to downsize and you're at the top of the list. None of your colleagues who move on to better pastures will vouch for you anywhere else because they don't trust you to pull your weight. You find yourself pretty unsupported at that point.
At the end of the day, I personally choose to stay sharp at work because it's my personal ethic, but there's also a real risk component that you may want to consider, although as long as the industry is structurally growing you probably don't have to worry too much about it.