HNHacker News
TopNewBestAskShowJobs

shpx

2,621 karma · joined December 15, 2013

submissionscomments
shpx··on Show HN: WikTok – A Recommendation UI for Wikipedia
Scrolling down after the article could load articles in the same category as the current article. This would work well for geographical articles, if I get a page about a water canal in Germany and I decide I want to read about every single canal in Germany (or every type of skin disease or every type of sorting algorithm or every type of butterfly, etc.), I would keep scrolling down instead of left, then after that category is exhausted it would start showing some broader category, i.e. canals in Europe and then the world and then waterways.

One way to choose which category to use would be looking at all the articles in all the categories of the current article and finding the category that has the most repeated articles (for example if a page belongs to 5 categories, use the category that has the most articles that also belong to all 5 categories), essentially the most specific one and then keep getting more generic. A second pass would be learn to throw out overly specific, uninteresting categories like "Canals opened in 1922". A third feature would be to magically figure out which category I'm interested in. Another feature would be to show the category I'm currently scrolling and what fraction of the articles in it I've read, this would also be a good place to make it a clickable drop-down that lets me choose to follow a different category, but that's antithetical to the TikTok idea.

P.S. love the name but TikTok's lawyers will probably tell you to change it if this gets any traction.

shpx··on Show HN: WikTok – A Recommendation UI for Wikipedia
I should've said "preload images for the next article", I realize now (after using it on a spotty connection) that you do preload multiple articles (you made a good choice for the amount that I didn't notice my spotty connection that much), but just not the images. Maybe you should preload multiple pages but only preload images for the next page to save data.

More thoughts after using it again today:

- try disabling the network, scrolling right to the end of the preloaded articles and then re-enabling the network, I think it won't load more articles you'll just be stuck on a white screen with no feedback. At least I managed to get it stuck in this mode somehow and I had to refresh the page manually

- remove the # from the url

- if it's not hard to do, make it multilingual. at least for the top, let's say, 12 languages. en.wiktok.org should just redirect to wiktok.org though

- I sometimes want to read a specific article while reading a recommended article, but there's no way to do that, such as an article search (I almost hesitate to bring this up because I like the clean interface without this feature)

- let me create an account to not lose my data (also, let me log in with my Wikipedia account specifically and extract the articles I've edited to gauge what I'm interested in, although careful here because I personally edit things I'm knowledgeable in or things I care about not being wrong, not necessarily interested in reading more about)

- I've seen the article for ISBN about 4 times now

- the recommender needs to be making more varied, exploratory recommendations. But obviously the recommender is the hardest, most important part of this whole thing.

- for long term users you can start showing articles they've already seen if you record a timestamp for when they saw an article

- Wikipedia really is nicer without the citations if you're trying to read a lot

- I end up opening multiple WikTok tabs when I open links on some article, it would be a nice detail to synchronize recommendations across tabs with that in mind. Maybe you do this already, but for example I might open a new tab, then swipe left for a recommendation, close the tab and go back to the first tab I came from and I shouldn't get the same article recommended there again, even though it might already be preloaded. Though here you will have to make sure you avoid preloading the same recommendation 10 times if I have 10 tabs open every time I view a recommendation in one of them that they might all have preloaded

Data sources:

- articles have a short description... on the one hand the short description could help me decide if I'm interested in an article faster, on the other if I end up reading the entire article reading the short description was a waste of time. Maybe it could be a totally separate "blitz" interface of an endless scroll of these short descriptions and I tap on articles I'm interested in

- Wikipedia articles are categorized (most articles belong to some Project and also have a list of categories they belong to) are you making use of that data? Though in my experience that data isn't that reliable and using it directly (instead of as a signal for the recommender and to seed the algorithm's learned categories) would not be the optimal recommendation. When you install TikTok it lets you scroll to start and to get the idea of the app, but when you create an account it shows a list of categories and asks which ones you're interested in to bootstrap, this could be good here too, there's some topics I'd like to read about but the algorithm hasn't started suggesting them yet

- Wikipedia publishes view counts of articles, you could also use this data point in your recommender

- user location: a large part of Wikipedia is geographical articles. These are largely useless, but while there's no chance I would be interested in learning about regions of Finland (what I was recommended once), I might be interested in the places around me, possibly all subdivisions of the country or state I'm in. The whole thing with tiktok is that users want (for some definition of "want") to give you all their data, as long as the recommendations are good.

As I mentioned before, when you detect that I seem to be interested in a certain group of articles, there could be a natural order to show those articles in, these "runs" could also be user curated or maybe use Wikipedia categories somehow.

If this is a project to help people read Wikipedia exhaustively, you could display some kind of time estimate of how long it will take to read everything I seem to be interested in

Another idea (related to my suggestion for doing this for books instead of Wikipedia) is to make this a kind of "jumping off point", where the article is the preamble for the topic. So when I scroll to the end of the article and then scroll even more, past the article, it would open some resource that's more in depth, like a book or a scientific paper or a webpage. Deciding which resource that would be is a complex editorial decision and a lot of work and there might not always be one, you could for example look at the sources of an article and somehow gauge which one is the most important one, you could look at the External Links section if it exists (but they usually suck because no one reads them so no one curates them), you could seed it using these methods but then ultimately let users curate the decision (now we're talking about of course reimplementing Wikipedia), you could have a list of options and choose somehow using what you know about the user and if you can determine why they're interested in this topic. If it's not a freely available paper/book (which it never will be), you could have a setting to open a Google search with the title or to just show the DOI or ISBN number (and users could choose to run some code that does something with that information). Ideally it would open a specific page in the book though, because I don't want to scroll past "this page intentionally left blank" and a book can be authoritative for multiple articles but be 1500 pages long.

shpx··on Show HN: WikTok – A Recommendation UI for Wikipedia
This is great. I had a similar idea recently as I was reading Python documentation: suggest to me random technical things I would like to read or would benefit from reading. We could even have this for all text on the internet (and books), or for all webpages really.

I read a few dozen articles on my phone on Safari, here's my feedback:

- implement some visual feedback like a swipe animation (the next/previous article pulling in from the side or something that lets me quickly evaluate the next article like a minimap or its Contents) and increase the cancel zone a bit (it should be relative to phone width), it feels brittle, I feel like I have to be careful when scrolling.

- I wondered whether the swipe direction is a like/dislike or if the direction doesn't matter. I assumed it didn't matter but turns out right goes back, but after you go back, left swipe gives you a new article instead of going back to the article you went back from, this is not good because I don't mind swiping a few extra times as much as I mind losing an interesting article, so doing it this way means I need to consider anytime I want to go back whether I'm okay with losing the current article instead of having "back" be a safe operation. Also, maybe make it scroll the same way as TikTok, down. So I can scroll down for the next article after I scroll through the entire article or up to go back to the previous one, that way left/right scrolls can be used for something else. This would make it hard to skip long articles, maybe make both left swipe and down swipe go to the next article? I'd have to test to see if it was a good idea.

- going back/forward should preserve scroll position

- the back button doesn't always work, I often lost articles I wasn't done reading because

- scrolling up can refresh the page and lose my current article

- scrolling sideways on a table or long formula triggers a swipe

- I experienced some jank where I sometimes get sent to another page, I'm not sure why it happens maybe I refreshed and it sent me to a new recommendation

- I like that you removed citations and other "cruft". I saw an empty Footnotes section header on "Sub-pixel resolution" that should've also been removed. Also, the articles have extra padding at the end from the last section that you should shorten

- sometimes when I click on an article while reading an article, I'll get the article I clicked on recommended soon after, sometimes more than once actually

- some articles have lowercase titles but on WikTok they are capitalized

- image previews are lower resolution than they are when I open the page on Wikipedia, you might need 2x srcset directives to the image elements

- tapping on an image should open the max resolution image file

- I was recommended some genetics article and clicked through a couple articles and the algorithm didn't start only suggesting those articles, which was good

- I got a place disambiguation page of some villages in Poland and then one of the villages, not very interesting

- improve the top text: drop the ".org", just "WikTok" (it's cleaner), make it the same sans serif font as the article or the serif of the headers and use an actual minimal shuffle icon and don't make it part of the hyperlink (if you keep it a hyperlink at all, it should really be a button)

- some articles are more fundamental than others and should be recommended first. some articles (especially for math) require prerequisite knowledge so it's less efficient to show me the more specific one first, I might waste time trying to understand regardless but it would be better to show me simpler articles first, I guess an advanced algorithm would have to try to intuit how much I know (simple heuristic: the average person doesn't know what Lie groups are) and have some kind of graph of knowledge dependencies that Wikipedia articles form, probably from how they link to each other. At that point it's more like teaching, you estimate what I know to guide me through the graph of concepts more efficiently

- preload the next page

- it seems like when I tab out you might not be tracking that and considering that as me still reading the article

- does the algorithm track how I scrolled the page, which words I dwelled on etc.? You could probably determine the level of my understanding of an article from how I scroll it and then re-suggest articles I didn't understand or read fully

- external links in infoboxes aren't clickable links, which is bad when the article is about a website and I can't click to go to it

- some long, important articles I want to read but not right now

You're solving a bit of a different problem than TikTok because there's only 6 million Wikipedia articles (much less useful ones) so your "power users" would be people trying to read it (or some section of it) exhaustively over a longer period of time, so you might want to cater to that by letting people see more of what you track, like what articles they've read and show them long lists of related articles for the current article, so that you can see that you're making progress instead of feeling that it's an endless pit of information. You could paint links purple manually because I bet the browser starts to lose that data, or just make a global percentage progress bar... I think Wikipedia has some metadata for which project an article belongs to that you could use here as well.

Will you open source this?

shpx··on Investigating the impact of HTTP3 on network latency for search
It is supported and randomly enabled for ~50% of Safari 16 users, according to https://github.com/Fyrd/caniuse/pull/6664#issuecomment-14934...
shpx··on FreeBSD spends 7% of its boot time running a bubblesort on its SYSINITs
Phones take a long time to boot (12 seconds on an iPhone SE) even though their hardware stays the same.
shpx··on FreeBSD spends 7% of its boot time running a bubblesort on its SYSINITs
You lack the imagination to come up with a use for some improvement off the cuff, that doesn't mean everyone else (some of whom are more motivated) does as well.

Why do we even need to waste any consciousness-seconds on watching electric circuits initialize? Computers should just start working

shpx··on Up next: a lawsuit threatening your YouTube watch queue
The recommender is actually trying to get you to scroll the recommendations for as long as possible, not show you a useful/good video. On mobile they show you an ad every 5 recommendations, which is more ads per minute than if you watch an ad then a long video.
shpx··on Sensenmann: Code Deletion at Scale
Noticing that this is a real issue with your service, finding who to email, writing an email and waiting for the fix to be made/deployed can be a non-trivial amount of work that you seem to expect all of your users to be willing to donate.
shpx··on Remove “This incident will be reported.” from user warnings
Next step is to remove users/groups/sudo from Linux/UNIX entirely. I'm one person using the computer, running software I trust. I don't need it.
shpx··on Ask HN: How many websites, apps or notifications do you look at to “catch-up”?
https://en.wikipedia.org/wiki/Portal:Current_events, GitHub notifications, Stack Overflow and HN.
shpx··on Office of the President of Mongolia: Top to bottom text on the web
But probably in the wrong direction, unless you've internalized that Arabic is written right to left.
shpx··on Giant SpaceX Spiral Appears Amid the Aurora Lights in Alaska's Night Sky
You would love pouring engine oil on a puddle. I recommend doing it when it's windy, it's more interesting when it's being pushed around.
shpx··on WebGPU Fundamentals
One big reason is that installing the software is one click (on the link) and it works every time. With native software, on phones you have to open the App Store, search for an app and usually wait to download hundreds of megabytes before anything happens. On personal computers it's much worse.
shpx··on AI Poised to Transform Video Compression Landscape
The other case I would worry about is over-compressing text changing the letters, but it's an old and known problem https://www.dkriesel.com/en/blog/2013/0802_xerox-workcentres...
shpx··on Tesla workers shared sensitive images recorded by customer cars
It's also used for pinging you when the light has turned green if you're texting while stopped at a red light.
shpx··on 15k inserts/s with Rust and SQLite (2021)
This is running on an AMD EPYC 7543 CPU, which has 32 cores that can each cycle 2,794,750,000 times per second. It's running with 3 threads (if I understand correctly), so as a rough estimate it's doing one insert every 500,000 CPU cycles (2,794,750,000 * 3 / 15000).
shpx··on Avoiding HTTP/3 (for a while) as a pragmatic default
Only bad or new software developers update software. Pin your dependencies, don't use new protocols, Snow Leopard was the last good macOS version. Library doesn't work on the newest Node or Python version? Who cares, it's only been out for half a year who's even using it yet? Some people spent hundreds of hours making something better, why would you want to use the result?
shpx··on The Three-Legged Stool: A Manifesto for a Smaller, Denser Internet
Creating an account is not free. It costs 1-2 minutes of your time (assuming no errors, I just tried it and never got the phone number confirmation code, in this case I paid with my time and got nothing, this risk also has a price) and that a record will exist between your name and a list of all the images you’ve viewed and liked, millisecond accurate measurements of when you opened the app for and how long etc. for the next century, probably more. I don’t know how to price such a record not existing and different people price it differently but it does have a price.
shpx··on Time to end the speed limit in US airspace?
> He was briefly startled but went back to fishing in under one second.

This was laugh-out-loud funny to me, something a character on the Silicon Valley show would say.

shpx··on GPT-4
I've chosen to re-interpret "Open" as in "open the box to release the AI"/"open Pandora's box"/"unleash".
shpx··on Why Python keeps growing, explained
$5 says this post was generated by ChatGPT.
shpx··on Dis This: Disassemble Python code online
I don't think so.
shpx··on Dis This: Disassemble Python code online
The user experience could be improved but this already exists:

https://godbolt.org/#g:!((g:!((g:!((h:codeEditor,i:(filename...

shpx··on Salesforce CEO took 10-day digital detox In French Polynesia after laying off 7k
A 10 day trip to Tahiti from San Francisco in March costs $600-$700 for the flights

https://www.google.com/flights

hotels cost anywhere between $100-$500/night

https://www.booking.com/searchresults.html?&ss=Tahiti%2C%20F...

finally, I'm guessing $100/day on meals should be enough.

So you are asking if sales people making $114K-$212K, or $3,174-$5,608 per month after California income tax

https://www.levels.fyi/companies/salesforce/salaries/sales

https://smartasset.com/taxes/california-paycheck-calculator

can afford a $3,000-$5,000 vacation. On the internet someone said they got 5 months of severance pay, if it's true and it's a lump sum payment then it seems like all of them have the money for it, unless they were spending more than they were making or need more than 4 months to find a job that pays the same.

shpx··on Ask HN: Laid off folks, are you getting hired?
As a counter example, I need about 100x what I have today.
shpx··on Transmission v4.0
That comment is 7 years old. I clicked around in Xcode for a bit and it doesn’t anymore.

I didn’t expect “I can’t click “Open Downloaded File” on a file downloading application because the scroll bar is in the way” would generate any discussion. It should be obvious to everyone that it’s an issue and should be fixed.

shpx··on Transmission v4.0
It's not Apple's issue to fix, I don't know what that person is talking about. On macOS the scroll bar is hidden and only shown when you scroll, over the window's content and gets wider if you mouse over it. It has worked this way since 2011 and it's not going to change. There's a setting to disable it system-wide but 1) I'm not going to enable something that permanently takes away 1% of my screen space systemwide just for this 2) this is the default scroll bar behavior, so most macOS users have this issue where clicking the most important "open torrent" button requires waiting a few seconds for the scroll bar to go away.

Transmission needs to add like 20 pixels of padding after the magnifying glass for the scroll bar if the user is on macOS and has this setting enabled.

shpx··on Transmission v4.0
I'll be honest, I'm glad people are working on this again but the most important change for me would be fixing this minor UI issue:

https://github.com/transmission/transmission/issues/261

shpx··on Ask HN: Is StackOverflow Dying?
I use uBlacklist. It supports 10 search engines.

https://chrome.google.com/webstore/detail/ublacklist/pncfbmi...

https://github.com/iorate/ublacklist

shpx··on 97% of American adults own a cellphone or smartphone (2021)
Googling "cellphone prison" I get a bunch of articles saying that "almost everybody has a phone" in prison.

https://www.nytimes.com/2011/01/03/us/03prisoners.html

https://www.forbes.com/sites/walterpavlo/2020/04/19/will-cel...

← PreviousPage 7 of 25Next →