Hacker News Reader

Comment by atrilumen | Hacker News Reader

I'm not really ready to show people, but my 'modern' (conversation-driven) GUI is rocking the monochrome.

( edit: oh, with dark and light themes! )

Fuck it. Slater is magic software...

and it's interface is like a tiling 'window manager' for any number of screens (anything with a browser), for threads of interaction, that are modeled as a story, like a conversation... but composes natural language with rich controls, forms, and stateful widgets. and super monochrome... but also controls your browser and TV and stuff...

I'm really inspired by the design work on the LightPhone 2, btw.

Super lame, early video: https://youtu.be/_m1zEbQieYQ

View on HN

Was it also inspired by Samaritan UI from Person of Interest? Because your video reminds me a bit of this: https://youtu.be/cu-pnxgvA6s?t=216.

I'll watch in a minute, because I luuuuurv fantasy interfaces... but nope. I'm not really imitating anything here; just keeping it minimal.

I'll probably throw away the waveform. I'm just looking for ways to use the audio to pace the text output, and also to tie the speech and text together as much as possible, so there's never a gap between them for your focus to jump between.

Maybe you'll have more success with this idea than I have (way too many other things in the way sadly): something that may be fairly nontrivial but very cool to solve would be breaking words down into syllables, identifying the syllable boundaries in the speech (... xD), and then synchronizing the display on each syllable as it's presented.

How are you synchronizing to each word?

I wonder if Google would consider expanding their TTS a bit to provide syllable data and other rich breakdown information.

I like the waveform, btw.

Thanks :)

I'm using Polly for the moment, and it provides word and viseme boundaries. Enough to animate face poses. I'm not taking full advantage of the visemes here: it's only affecting the saturation of the waveform color. Too subtle to notice, with the way things kind of flicker with this one.

I have other ideas I want to play with, but don't really have time, and I may just have to drop that line of thinking, because I plan to move to one of the wavenet implementations, which don't provide speech marks data.

I was about to say this too wow this is almost the same.

Reply on news.ycombinator.com