ISPs do not know as much as Google/FB thanks to SSL, but they know a lot more than you'd think by analyzing connection metadata.

Also many ISPs are also carriers, which makes things worse.

Source: worked for telecos, have seen a lot of shady stuff myself.