I have been released twice from the Florida DOC, both times from a panhandle camp (Gulf C.I) that was approximately 9 hours from my home.
They definitely DO NOT give you the clothes "you were arrested in" as long ago those clothes were thrown away (at the "reception center" along with your cell phone, which was almost certainly stolen by the COs and/or convicts, and all other property you may have had)
My first time through, in 2004, my ex-wife actually sent me a beautiful set of clothes to be released in. They were of course "lost". She was so upset when she came to pick me up the assholes in release were actually threatening to lock her and/or me up because she was making such a stink about me having no clothes for release.
I ended up getting very ill fitting cheap-ass pants and a white t-shirt, and back then, a $100 dollar bill. That's it. Thankfully, I had her to pick me up and drive me home.
The second time through I wasn't so lucky. In 2014 I was given the same shit clothes, only $50 this time as they changed the release policy, and a bus ticket. That is it. No cell phone, no wallet...nothing.
It sounds like you are talking about jail, not prison.