After a few days there I finally started to get the system. Because some areas have sidewalks and bike lanes at the same level, I noticed cyclists will often use the sidewalks to pass slower bikes. I realized then that just like in any other big city, you have to stand up for yourself and when a cyclist is on a pedestrian right-of-way and decides to get up in your face, you're completely within your rights to push back and kindly show them the edges of the bike lane they've left. It reminded me a bit of figuring out how to get around NYC.
Outside of the cramped shared spaces in Amsterdam the aggression levels are understandably much lower and the separation between bikes and pedestrians is more manageable, and I never once had an issue elsewhere in the Netherlands.