HNHacker News
TopNewBestAskShowJobs

gthompson1

35 karma · joined October 15, 2016

submissionscomments
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Yeh I get it. I appreciate the comment. Part of the reason I am considering open sourcing it would be to give the project more life than I can currently give it myself.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Thanks! Thats kinds of you to say. Appreciate that.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Hey! Yeh I did https://g6.antv.vision/en although I think I might try using this https://x6.antv.vision/en if I could start again. X6 wasn't as well built out when I started though but its probably more suited to my use case with its interaction support. If you have other libraries that serve this purpose let me know because I did a lot of searching and thats the best I found at the time.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
"If you think you were burned out before, becoming an open source maintainer probably won't help" - Ha yeh I believe that.

"That way a company that modifies it will have to contribute back to the project. If you do open source, I recommend moving your roadmap to a GitHub Project, put together a contributors guide/agreement." - Thanks for the advice

gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Oh this is very interesting, I had never heard of this. Yeh I could potentially use this. I do think using a third party library or provider makes sense to massively expand the input / output options. Seems like there is a standard schema for the different tap configs that I could pull and wrap in UI forms in a generalized fashion.

I don't know if you think these are fair comment about the state of the project? - https://www.youtube.com/watch?v=TBrSOPNEg-g&ab_channel=Resta...

gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Yeh I still appreciate the callout / opinion though. It's not obvious to me who is best to target. As a full stack engineer with analytics experience one of the main uses of the tool is scheduling, running pipelines remotely vs the UI for data munging which I can write pretty easily. But for non technical users the data munging piece might be really helpful (e.g. no code). Its a little hard to serve both a marketer and a developer given the needs are so different. But then on the other hand I assume a marketer is more likely to pay for the tool (and thus keep it going) vs a dev who might be a harder sell. I built this tool with the hope of being able to serve both which is where maybe I bit off more than I could chew.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
If you have other suggestions for the tool symbols let me know. With this project the right balance between technical and non technical is hard to hit.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Way too high. I haven't updated the landing page in a while. I need to. Sorry.
gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
I'm not totally sure what the question is but currently these are the inputs:

delimited, excel, json, feather, parquet, sqlite, postgresql, mysql, googleSheets

Outputs are the same (excluding databases currently). This is probably the most time consuming piece of the project if I was to expand this set dramatically given the quantity of possible connections, although here is where open source could help.

It's hard to know how technical or not technical to take this. e.g. could there be a python input e.g. arbitrary python script to pull in data? That would allow for basically any input or output. But for non technical users thats a harder sell... open to ideas.

gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Haha yeh... I have been told the branding / naming is bad for that reason which is fair. If you have ideas I'm all ears ;)

But yeh good points on SEO / stackoverflow.

gthompson1··on Show HN: Glue – Pandas as a DAG (Now a web app)
Hey guys,

I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way.

Since doing that I took a job and am pretty burned out on the project. I was thinking about open sourcing it and seeing if it gets more interest that way. Potentially as a self contained docker image that folks could pull down and run.

Glue is pretty similar to these commercial projects https://www.alteryx.com/, https://www.dataiku.com/, https://parabola.io/ and other DAG based data pipeline generators. I also saw this posted on hackernews within the last year or so https://datablocks.pro/ which is pretty cool too (also more of of an indie project).

Here is the current API. Probably needs some de-scoping so that its only the important endpoints but its a look under the hood if anyone is curious. - https://app.gluedata.io/docs#/

Anyway if anyone has any comments, suggestions / feedback please let me know. Happy to share any details or thoughts.

gthompson1··on I wrote one of the fastest DataFrame libraries
Pandas does seem to be on the out if I'm being honest, and thats coming from someone who has invested heavily in it (backend for my project http://gluedata.io/). JMO

I would happily adopt Polars if the feature set is expansive enough.

Pandas is great because its so ubiquitous but I have always felt that it was slow (especially coming from R).

One thing that is weirdly terrible in pandas is data types. The coupling with numpy is awkward. Its so dependent on numpy and if pandas isn't moving fast numpy isn't moving at all. I'd be curious to see how Polars handles this. e.g. Null values, datatimes etc.

gthompson1··on Azlo Bank announces intent to shut down
Got the same email. I became a customer through stripe Atlas. I started to get a little worried as I saw them try to add subscriptions. Signs that maybe it was bleeding cash. I guess cross selling into other products didn't work...? I know some people have complained about stripe atlas in general. This is another knock against the program as this was one of their default banks https://stripe.com/docs/atlas/next#bank-account

Hopefully Azlo can give more information on how long the service will still be useable... Seems like that is an obvious follow up. Appreciate the transparency but whats the plan guys?

gthompson1··on Ask HN: Is a blog clever marketing or just a waste of time?
I have done a decent amount of marketing for several companies, I've been a data scientist and now I'm a software engineer. I am currently trying to get traffic to my side project http://www.careerminer.co I have tried:

email marketing, social media posting, reddit posts / sub reddit comments

My last job I worked at a lending company and we would spend like $10,000 on a direct mail campaign and it would result in like 50 website sessions. We kinda shot down blogging and content SEO stuff as to vague with unpredictable results and the few blog posts we did had like 10 sessions. We focused on email marketing, cold calling, paid ads and direct mail. We would spend like $50 per session on paid ads.

But heres the kicker.

Before the company stopped operations we decided to give content SEO one last shot, we went after long tail keyword content pages, stuff like "what is a good apr" we saw our competitors doing this. All our previous blog posts were like "mini profile : meet joe blogs founder of joes coffee" which never really generated much traffic, it was way to specific and people just don't google that.

Its been a year and I still have access to GA. I looked at it and those long tail keywords pages that we went after are absolutely crushing it like one is generating 1000 new users every month (which I know is still not huge but for a small lending company (boring) its huge) and here is the double kicker, we got a text broker https://www.textbroker.com/ to write each post for like $50. So 1000 a month recurring for $50 or like 1 session for $50. Its just crazy.

I listened to https://www.indiehackers.com/podcast/038-dawson-whitfield-of....

>So our first like five months, our growth was 100% fueled, apart from Indie Hackers, by AdWords. We would spend $1.00 to acquire a customer and about four days later, we would get a $1.10

>Now-a-days about 55% of our new users come from organic SEO, we've really pushed hard on that

I feel like this has been my experience with so many companies and friends. But agree with the general sentiment that if you don't have a really clear strategy, keywords, topics etc it will be a "waste of time".