HNHacker News
TopNewBestAskShowJobs

3Sophons

325 karma · joined March 28, 2022

submissionscomments

KubeCon and CloudNativeCon and Open Source Summit and AI_dev China 2024

secondstate.io·1 pts·3Sophons·
1

Open Source LLM-Gemma Powered Agentic Research Assistant

llamatutor.gaianet.ai·2 pts·3Sophons·
1

LLM Tool Call Demo: Finetuned Llama3 Invokes Python Code& Manipulates Data on PC

llamaedge.com·1 pts·3Sophons·
1

Run Llama 3.1 on any device. Embed Llama 3.1 in any app

twitter.com·1 pts·3Sophons·
0

Run Llama 3.1 on any device. Embed Llama 3.1 in any app

secondstate.io·1 pts·3Sophons·
1

Embed LLMs in your app easily–each model tackles agentic tasks it finetuned for

secondstate.io·2 pts·3Sophons·
1

Can the New Mathstral LLM Accurately Compare 9.11 and 9.9?

secondstate.io·23 pts·3Sophons·
32

WebAssembly on Kubernetes: The Practice Guide

cncf.io·3 pts·3Sophons·
0

Run across devices open source LLMs like Phi-3 and get a API server in mins

github.com·1 pts·3Sophons·
1

Demo: Run the 314B Grok LLM on Pure CPU with WASM?

twitter.com·1 pts·3Sophons·
0

Efficient and Portable AI / LLM Inference on the Edge Cloud

2024.wasmio.tech·1 pts·3Sophons·
0

Create an LLM web service with LlamaEdge on MacBook, deploy it on Nvidia devices [video]

youtube.com·1 pts·3Sophons·
1

LlamaEdge 0.4.0 Released: Multimodal LLM support, RAG assistant API and more

github.com·2 pts·3Sophons·
0

Demo: Run LLava multimodal LLM with a 2M Rust app portable across GPU/CPU

twitter.com·2 pts·3Sophons·
0

Run Alicloud's Qwen LLM with a 2MB cross GPU/CPU rust app

secondstate.io·1 pts·3Sophons·
1

Self-Host Across GPU/CPUs Google's Gemma LLMs with a 2MB App

secondstate.io·3 pts·3Sophons·
1

Free Linux Foundation Training/ Certification for New Open Source Contributors

secondstate.io·1 pts·3Sophons·
0

Complete tutorial: Run Qwen LLM across your local machines without Python/C++

secondstate.io·3 pts·3Sophons·
0

Launched! WebAssembly System Interface WASI Preview 2 Discussion

youtube.com·1 pts·3Sophons·
1

Develop+Deploy RAG Bots with LlamaEdge: Across OSes, NPUs, GPUs Using Vector DB

github.com·1 pts·3Sophons·
1

Self-host any GUFF LLMs on Hugging Face and run across devices

secondstate.io·1 pts·3Sophons·
0

Run the leaked Mistral Medium, miqu-1-70B across GPUs CPUs and OSes

secondstate.io·3 pts·3Sophons·
3

Self-host StableLM-2-Zephyr-1.6B. Portable across GPUs CPUs OSes

secondstate.io·2 pts·3Sophons·
1

LFX Mentorship 2024 Spring LLM Projects: Build Open Source AI Inference Infra

secondstate.io·1 pts·3Sophons·
1

LlamaEdge 0.2.9 released. Now works with Hugging Face's 3000 GGUF models

twitter.com·1 pts·3Sophons·
1

Rust boosts LLM app development: Make a serverless Japanese Learning bot in mins

flows.network·1 pts·3Sophons·
1

Demo: Run LLM on your own devices. portable across GPUs/CPUs/OSes

thenewstack.io·1 pts·3Sophons·
1

Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge

youtube.com·2 pts·3Sophons·
6

Demo: Interact with open source LLMs via a web interface locally [video]

youtube.com·1 pts·3Sophons·
0

Single command to self-host open source LLMs on Mac, Jetson etc. portable

llamaedge.com·1 pts·3Sophons·
0
← PreviousPage 2 of 5Next →