You can. Many people do. At least with the 7" Kindle.

But you see, Amazon has no particular interest in selling you a Fire if you don't want to use it for the intended purpose- a vector to deliver Amazon content.