crawdog

Take a look at https://sbproxy.dev - I built it to address this very issue.

I have been working on a project that is built off of Cloudflare's pingora project - https://sbproxy.dev. This provides all of the features of a LiteLLM, but can also support your API traffic too. I worked on the edge infrastructure for Walmart, and took those learnings and build a fully open source gateway.

Take a look - should be able to address your needs.

Thanks I am finishing up some performance comparison work looking at rust vs golang and plan a deeper write up for that group. I hope to publish soon.

I wrote a similar golang gateway, with the understanding that having solid API gateway features is important.

https://sbproxy.dev - engine is fully open source.

Another reason golang is interesting for the gateway is having clear control of the supply chain at compile time. Tools like LiteLLM the supply chain attacks can have more impact at runtime, where the compiled binary helps.

SBproxy (https://sbproxy.dev) - An API and AI gateway as a single binary. Sits between your apps and LLM providers to give you more control. Think Cloudflare meets LiteLLM.

After the LiteLLM supply chain hack last month I feel pretty good about that choice. Your LLM gateway holds every provider API key you have. That probably shouldn’t be a pip install.

Worked on API gateway for a major retailer and incorporated my learnings into this platform.

Open source engine take a look!

Entropy is real. Microsoft has lessened the friction of purchasing vs their competitors. Public Sector this may be their only choice because they set the groundwork decades ago to do business with most organizations. It may not be the best solution, but it offers the least resistance to getting something up and running.

The supply chain impact on manufacturers in the US on contracts is overlooked in this tariff fiasco. For example - auto manufacturers enter into long term agreements as a fixed price for a product. The only negotiation point they may have to reset that price would be a government action, which a tariff checks the box. The genie is out of the bottle, lots of contracts will be negotiated and prices will go up.

I would like to think this is some kind of 4-d chess game to avoid rate hikes and to devalue the dollar, but on implementation it will accomplish none of the above with a sprinkle of recession.

This was a great throw back. My interest in Electrical Engineering was traced back to building out simple circuits on this device. Little did I know my day to day at school was going to involve even more complicated circuits on a bread board - I was in heaven!

This is an area that government subsidies could really influence change in urban planning and cutting oil demand. If there was a similar subsidy on bikes as there are on electric cars, I would expect the push back against bike infrastructure would become less. Right now in the Bay Area through poor design and aging infrastructure there is push back on bike lanes. An example is the Richmond bridge, which has a protected bike lane taking a 3rd lane of traffic that could see a larger number of riders if more ebikes become used. Likewise for the Bay Bridge, whose bike lane is a ghost town in the mornings when commute traffic is worst. This would be less of a problem if the lane went entirely to the city.

Curious if this applies to political ad senders.

This is a major pain point moving customers from Oracle to cloud services. PL/SQL encapsulates a lot of logic in legacy enterprise applications that handcuffs customers to the platform similarly to mainframe systems. Migration tools can get part of the way there but still requires a strangler type pattern when migrating.

You should look at Lucene core - they have incorporated vector embeddings in 9.4.x and it could provide you better scale than Redis with durability as well.

https://lucene.apache.org/core/9_4_2/demo/index.html

Word processors in the 70s had this as well. I remember the CPT 8100 having this as a selling point in their literature. There was no inline correction. Run the program, correct your issues then continue!

Anyone else remember Shift+F7? Bring out your Wordperfect templates.

my typo thanks for catching that

I have used card database files before with success. https://cr.yp.to/cdb.html

Have your process regularly update the CDB file from a blob store like S3. Any deltas can be pulled from S3 or you can use a message bus if the changes are small. Every so often pull the latest CDB down and start aggregating deltas again.

CDB performs great and can scale to multiple GBs.

It frustrates my partner to no end. I always ask for a discount. Worst case you end up paying the amount you expect, best case you open up a window to negotiations of a discount. It never hurts to ask.

I have been on a similar trend lately. Trying to first focus on low gluten/no gluten and nothing with processed sugar in it. Often hard to eliminate it all but even a dramatic cut back in processed foods has made a difference on my sleep.

I went with multiple small birds. I found < 14lbs easier to manage and the meat isn't as tough.

Some observations over the years:

1. Keep the humidity high in the oven. Add liquid to the roasting pan. I also added a tray of water to the BBQ when I used a rotisserie this year

2. Don't stuff the bird, or if you do, only use aromatics like orange/onion/bay leaf, and do it loosely

3. Add a fat to the skin

4. Brine your bird for 24 hours, dry it completely

5. Don't go directly from fridge to oven. Add some time outside of the fridge to come up in temperature

Now all you need is a license for ATG Dynamo and you can setup your own circa 1998 ecommerce website.

What a fascinating time for search companies. We saw 2 companies with huge accounting irregularities purchased by large enterprise software vendors. The story behind Fast's acquisition by Microsoft is just as crazy. It was called the "Enron of Norway" https://techcrunch.com/2008/07/03/did-the-enron-of-norway-pu..., and happened just 3 years prior!

Autonomy acquired Verity, they were the largest enterprise search company out there and HP had high hopes with their e-discovery solutions paired with storage. They didn't learn from Microsoft's mistake.

I wish you luck in finding a successful treatment plan.

Makes my day to see this company on HN. Their Barlow Pass tires in tubeless setup have been an excellent addition to my commute bike. Supple, great handling. There's an efficiency lost on a gravel setup vs road bike, but that's mostly the geometry than the tire.

Doing back of the napkin math you could accomplish this with 770 cloud instances in Google Cloud all running 8 attached GPUs. Now running lustre in the cloud is a pita so you would have to find out how to take advantage of cloud native storage. Running Rapids should be possible using Dataproc. Anyone have the budget to kick off the largest cloud native HPC workload?

Beware of the customer that kills the company...

This is really a team sport. There is a lot of strategy that goes into aligning the proper resources to win the race - From controlling the field, pulling in breakaways, supporting your teammates through mechanicals and still having the energy to finish out the final sprint. I would suggest catching the 30min breakdowns of the race on NBC Sports and the Latern Rouge on Youtube to better understand the race in a compressed format.

My bad! Quickly glanced - you are correct.

There has been a recent paper published around treatment of melanoma cancer with positive results as well. Interesting to see how the research in this area progresses. Hopefully making more of these devastating cancers more treatable.

https://science.sciencemag.org/content/371/6529/602

Through all of this, no one has received any jail time. That's the biggest crime.

Looks like they are using a blanket stop word list - "I, the, and" etc. Also looks like diacritical folding has been done for accent characters.

You could build a bloom filter with the profane words, then check your tokens for the page against that filter.