HNHacker News
TopNewBestAskShowJobs

iamtherhino

48 karma · joined February 25, 2015

submissionscomments
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
Thanks for the feedback-- I can say emphatically, that's not our intention in the least. We chose a lightning bolt to evoke speed, i.e., the "hyper" in Hypermode. I've asked design to take another look at the "H" logo.
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
updated our python example too!
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
I haven't seen one yet-- no reason we couldn't do that with Hypermode. I'll do some exploration!
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
I really like this approach.

I think there's a big advantage to be had for folks brining "old school" ML approaches to LLMs. We've been spending a lot of time looking at the expert systems from the 90s.

Another one we've been looking at is applying some query planning approaches to these systems to see if we can pull responses from cache instead of invoking the model again.

Obviously there's a lot of complexity to identifying where we could apply some smaller ML models or cache-- but it's been a really fun exploration.

iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
That's a good idea-- then give them a link to "replay last X inferences with model ABC" so they can do a quick eyeball eval.
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
We've been playing with that in the background. I can try to shoot you a preview in a few weeks. It works pretty well for reasoning tasks/NLP workloads but for workloads that need a "correct" answer, it's really tough to maintain accuracy when swapping models.

What we've seen most successful is making recommendations in the agent creation process for a given tool/workload and then leaving them somewhat static after creation.

iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
Not at all! I'm updating the banner now
iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
Signups are open: hypermode.com/sign-up

There's a waitlist for our prompt to agent product in the banner. That's a good call to update it to be more clear.

iamtherhino··on Hypermode Model Router Preview – OpenRouter Alternative
Hey! Co-founder of Hypermode here.

Agreed on swapping models for code-gen doesn't make sense. We're mostly indexed on GPT-4.1 for our AgentBuilder product. I haven't found it easy to move between models for code super effective.

The most popular use case we've seen from folks is on the iteration/experimentation phase of building an agent/tool. We made ModelRouter originally as an internal service for our "prompt to agent" product, where folks are trying a few dozen models/MCPs/tools/data/etc really quickly as they try to find a local maximum for some automation or job.

iamtherhino··on Show HN: Modus, serverless framework for intelligent APIs powered by WebAssembly
Hi Folks -- I'm one of the people who worked on this project along with the rest of Hypermode team. Happy to answer questions or hear your feedback!
iamtherhino··on Hashnode cuts AI bill with smaller models
Companies are starting with OpenAI, etc. to build version 1.0 of their apps then have to rewrite to use a smaller, more specialized model to improve outputs or improve costs.
iamtherhino··on Vercel, formerly Zeit, raises $21M Series A
Vercel/ZEIT is typically a bit cheaper in the long run for popular sites with the fixed costs. If your traffic is really light, then Netlify probably is.

If deploying a Next.js site, it makes sense to deploy on top of the platform made for it (ZEIT/Vercel)

iamtherhino··on ZEIT, creators of Next.js, launch new pricing plans
The primary driver here is moving from a hosting company to a workflow/developer productivity company. If you're using ZEIT for staging/test deployment previews or hosting SSG or hybrid SSR/SSG Next.js it all pencils out nicely. It definitely doesn't work for the original container-first model.
iamtherhino··on Has anyone evaluated Tray.io vs. Workato?
Workato does a really good of integration recipies for known use cases. Time to value is really short with them.

Tray does a really good job as a general purpose automation platform. It’s really extensible and allows technical users to pull the covers off and do a lot more and semi-technical business users to get by without code.

At a high level: I’d go with workato if I had an acute problem that I needed fixed quickly. I’d go with tray if I saw automation being a long term strategy at my company where I know I’m going to need lots of flexibility integrating legacy applications with SaaS, etc.

iamtherhino··on Ask HN: Who's hiring CS summer interns?
At Neo4j, We're always looking for great CS undergrads to join our developer relations engineering team for the summer.

neo4j.com

devrel at neo4j dot com

iamtherhino··on Benchmark Capital Sues Travis Kalanick for Fraud
I think you dropped a 0.

0.13*31BN = ~$4BN, still a 10X return if they've invested $400M.

iamtherhino··on Learn GraphQL with GitHub
Here's one using Neo4j (graph databse): https://neo4j.com/developer/graphql/
iamtherhino··on AMD's Future in Servers: New 7000-Series CPUs Launched and EPYC Analysis
Most enterprise database vendors now charge on a "per-core" basis. There are some OLAP / NoSQL vendors that are moving to a per XX GB Ram model.
iamtherhino··on What tools are you using for knowledge graph building?
We see Neo4j get used relatively frequently as the aggregate view of data pipelines, e.g., Roam Analytics uses Neo4j to spit out tables/views across many different data sources to perform ML enrichment on that they then pipe back into the graph to feed their app.

eBay (ShopBot) is a Neo4j powered ML chatbot. AirBnb also builds knowledge graphs with Neo4j.

Video from GraphConnect today talking about knowledge graphs: https://youtu.be/dqrlotzdUlo?t=3175

Transparency: I'm an employee at Neo4j.

iamtherhino··on Building a Real-Time Recommendation Engine
Would you mind sharing the query? If you're hitting OOM exceptions with a dataset of that size there may be a typo in the query that's doing some sort of traveling salesman operation.

e.g.,

//grabs literally EVERY node in your database

MATCH (Person)-[KNOWS]-(Friend)

//only the people who have a KNOWS relationship between them

MATCH (person:Person)-[:KNOWS]-(Friend:Person)

iamtherhino··on Building a Real-Time Recommendation Engine
6 of this, half a dozen of the other.

It's a single image database (no partitioning except in memory), so all nodes in the cluster will have the complete dataset (thus each node must be large enough to store it). However, because Neo4j doesn't rely on joins / table scans to operate-- traversals are O(1) not O(n). So there's an advantage to doing OLTP work on really really large datasets that have a specific starting point. Neo4j will do pointer arithmetic instead of scans / joins, such that regardless of dataset size a query will only access the fixed amount of data. The reason for this strategy has been that scale up hardware pricing has come down incredibly quickly in the last decade and having a trio of 64+++ GB memory boxes isn't out of the question for most mid-size and enterprise companies. Secondly, distributed systems are non-trival problems to manage both from a development but a devops perspective as well.

The philosophy of the Neo4j team is to conquer the world slowly. In order of priority Neo4j is designed around:

1.) data integrity and availability (ACID transactions, master-slave replication)

2.) rapid reads for graph traversals

3.) ability to store web-scale datasets (trillions++ of nodes)

4.) parallel operations (multi-master, map-reduce, global analytics, etc.)

The product has firmly completely 1 and 2, and is starting to work on 3 and 4 (4 mostly with a databricks / spark partnership).

It fights the same CAP problem that all databases do. We've chosen Consistency and Availability. Partition tolerance just isn't something inherent to graph databases. We can do some really smart math and duplicate nodes with high betweenness centrality (data nodes, not servers) or shuffle data based on access patterns to prevent introducing network latency into query plans that access nodes on multiple partitions. But doing that while maintaining 1 and 2 of the above is very not easy.

Disclaimer:

MATCH (rhino)-[:WORKS_AT]->(neo4j)

WHERE NOT rhino.opinions = neo4j.opinions

iamtherhino··on Building a Real-Time Recommendation Engine
To be frank, the way I submit conference talks is normally:

Understanding {buzzword pop culture / news topic} using {conference language} + {pick 3+ of [real-time, cloud, at scale, data science, docker, sentiment analysis, polyglot persistence]}

It works shamefully well.

iamtherhino··on Introducing OpenCypher, the open graph query language project
Neo4j does support Gremlin: https://github.com/neo4j-contrib/gremlin-plugin

Gremlin was originally developed by Neo4j co-founder Peter Neubaurer and Marko Rodriguez (Titan founder) while they were both working at Neo4j.

iamtherhino··on Graphing a Lesson-Learned Database for NASA Using Neo4j, RStudio, and Linkurious
A lot of it comes down to robustness. Neo4j has the advantage of simplicity and maturity when compared with multi-model dbs. Multi-models, as of now, are feature rich and reliability poor. Instead Neo4j has fewer features but just tries to do those things really really well.

It's been in mission critical prod. environments now for nearly a decade. I'm certain that in the future DSE, Orient, Arango, or someone like them will be big contenders in the space. However, for the time being, I wouldn't trust anything critical to them.

iamtherhino··on Graph your meetup.com group with Neo4J and some Go
Agreed. Gremlin was written for geniuses by geniuses-- Cypher is for the rest of us. That said, I'd much rather use Cypher for most of my queries, especially when I'm doing more exploratory probing into my information (simply because I'm lazy and would rather say what I want from my db than how to get it), and the Java API when I need more granular control with a complex traversal.