Hacker News Reader

Comment by zaheerbaloch | Hacker News Reader

I have noticed the encoding issue. Working on it. The job posting is though not remote, but welcomes/prefers the people with disabilities.

View on HN

Here you go, if you're using python(?): https://ftfy.now.sh/

That's the web demo link above, but ftfy is a Python library you throw all your text through and it comes out magically perfect. I can copy Unicode text through (non-UTF-8 aware) VNC and completely destroy it, paste it into FTFY, and it just figures it out no matter how bad it gets.

Since I'm here, I _have_ to do this...

I copied a small piece of text back and forth through TigerVNC a few times, yielding this:

  YouÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂ¢ÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂÃÂve

What FTFY thinks I copied back and forth: "You’ve"

Note the â - err, sorry, ’ quote character :)

(Oh hey, I made my comment get a horizontal scrollbar, without using any code formatting! Nice!)

Plus one for FTFY: recently went through some pains converting shell output with some funky encodings to XML compliant UTF8. FTFY was the simplest and most effective solution I found for getting the desired outcome without mangling anything more than necessary.

This is very helpful. I am using Java so search SO for any answers. Nothing is working till now.

Reply on news.ycombinator.com