HNHacker News
TopNewBestAskShowJobs

c5urf3r

60 karma · joined March 13, 2015

I don't know anything, but I do know that everything is interesting if you go into it deeply enough - Richard Feynman
submissionscomments
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Links please?
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Really nice links... Thanks! Will take a look at it and compare and contrast for better tuning. :) Feel free to do the same and raise some pull requests :)
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
That is sad :(. Please raise an issue with more details and I will try to fine tune it to work better.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Did you eventually get to try it out?
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
There are fork and star buttons which directly link to this repo on the website.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
That is sad :(. Please raise an issue with more details and I will try to fine tune it to work better.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Thanks for your suggestions. Will keep track of it and try including them in the next run. Raise it as an issue if it bothers you a lot.

Also, I have rectified the typo.

c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Thanks, I am using gensim package for LDA. In a nutshell:

1. Get descriptions of repos user is interested in 2. Cleanup/Filtering/Tokenization 3. Use LDA to generate Topics 3. Use the topics to search for repositories github can provide.

c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Some really good suggestions, can you please raise an issue on the repo so that we can keep track of the same.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Take a look at the repositories suggested, you may find it interesting after some digging or add a new liking to your list. After some more starring, the tool might actually start suggesting repositories to your liking.

Also if you find something strongly troubling feel free to create issues on the repo and I will try to see how it can be better tuned/filtered.

c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
That is a thought which indeed crossed my mind.

I personally play around with a lot of tools and languages and wanted to make sure that language barrier didn't make the tool limited. In the sense that if there are a lot of repositories out there in js for something I am starting in python I may wanna take a look at why so many people chose to do it in js instead of python and then make my decision based on it.

This definitely will be lost if I filtered based on languages. In the current form, it gives importance to the topic and not the language for this specific reason.

c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
https://developer.github.com/v3/search/#rate-limit
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Thats right, but one additional level of depth in fetching repositories increases the API latency by so much that almost becomes unusable for a web app at least for a hobby web app :P Hence the shortcuts. Open to ideas and suggestions.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Problem is this, the suggestions are generated by using the repo descriptions as the starting point dropping all references to language and non-English words. What this means is even if you have a lot of stars on ruby repositories, if the search on terms derived from the above process leads to non-ruby repositories that is what is shown. Will look into tuning it better.
c5urf3r··on Show HN: Using LDA to suggest GitHub repositories based on what you have starred
Please raise it as an issue. My UI knowledge is pretty limited but will try to make it a bit cleaner.
c5urf3r··on Dancing Links(DLX) Based Implementation of AlgorithmX in Scala
Abstracting the Sudoku class enough to be able to extend it to Sudoku of any dimension is next on the list followed by Pentominoes solving. Any comments and ideas welcome.