The kernel has a cache used for block devices.

If you want to be more targeted:

    blockdev --flushbufs /dev/sda