thenameless7741

A recent example: a law firm hired this person [0] to build a private AI system for document summarization and Q&A.

[0] https://xcancel.com/glitchphoton/status/1927682018772672950

If you install llama.cpp via Homebrew, llama-mtmd-cli is already included. So you can simply run `llama-mtmd-cli <args>`

AFAIK, Phi-4-multimodal doesn't support TTS, but I understand OP's point.

The recent Qwen's release is an excellent example of model providers collaborating with the local community (which include inference engine developers and model quantizers?). It would be nice if this collaboration extended to wrapper developers as well, so that end-users can enjoy a great UX from day one of any model release.

> it'll probably take a year for the FOSS community to implement and digest it completely

The local community seems to have converged on a few wrappers: Open WebUI (general-purpose), LM Studio (proprietary), and SillyTavern (for role-playing). Now that llama.cpp has an OpenAI-compatible server (llama-server), there's a lot more options to choose from.

I've noticed there really aren't many active FOSS wrappers these days - most of them have either been abandoned or aren't being released with the frequency we saw when OpenAI API first launched. So it would be awesome if you could share your wrapper with us at some point.

it's mentioned in the main thread: https://nitter.net/athyuttamre/status/1899511569274347908

> [Q] Does the Agents SDK support MCP connections? So can we easily give certain agents tools via MCP client server connections?

> [A] You're able to define any tools you want, so you could implement MCP tools via function calling

in short, we need to do some plumbing work.

relevant issue in the repo: https://github.com/openai/openai-agents-python/issues/23

Interesting.. In the official API [1], there's no way to prefill the reasoning_content:

> Please note that if the reasoning_content field is included in the sequence of input messages, the API will return a 400 error. Therefore, you should remove the reasoning_content field from the API response before making the API request

So the best I can do is pass the reasoning as part of the context (which means starting over from the beginning).

[1] https://api-docs.deepseek.com/guides/reasoning_model

I've just started experimenting on an AI wrapper that blends companion and assistant into one (think Replika meets Claude), but with an anime-style avatar for the main interface.

As I'm still very early (still in the ideation and prototyping phase), I'd love to hear about experiences that have stuck with you, or any works that got you excited about the possibilities.

Before anyone reads too much into this, here's what an Anthropic staff said on Discord:

> i don't write the docs, no clue

> afaik opus plan same as its ever been

As a technical person who recently taught myself frontend from scratch, I found https://web.dev/learn way more structured and thorough. The CSS lesson covers all the essentials and actually made me enjoy working with CSS.

web.dev doesn't get as much love as MDN, but it totally should!

Blog updates:

- Introducing the Realtime API: https://openai.com/index/introducing-the-realtime-api/

- Introducing vision to the fine-tuning API: https://openai.com/index/introducing-vision-to-the-fine-tuni...

- Prompt Caching in the API: https://openai.com/index/api-prompt-caching/

- Model Distillation in the API: https://openai.com/index/api-model-distillation/

Docs updates:

- Realtime API: https://platform.openai.com/docs/guides/realtime

- Vision fine-tuning: https://platform.openai.com/docs/guides/fine-tuning/vision

- Prompt Caching: https://platform.openai.com/docs/guides/prompt-caching

- Model Distillation: https://platform.openai.com/docs/guides/distillation

- Evaluating model performance: https://platform.openai.com/docs/guides/evals

Additional updates from @OpenAIDevs: https://x.com/OpenAIDevs/status/1841175537060102396

- New prompt generator on https://playground.openai.com

- Access to the o1 model is expanded to developers on usage tier 3, and rate limits are increased (to the same limits as GPT-4o)

Additional updates from @OpenAI: https://x.com/OpenAI/status/1841179938642411582

- Advanced Voice is rolling out globally to ChatGPT Enterprise, Edu, and Team users. Free users will get a sneak peak of it (except EU).

duplicate of https://news.ycombinator.com/item?id=41658730

(moderator, please delete this post)

context:

Cloudflare joins OpenNext to deploy Next.js apps to Workers: https://blog.cloudflare.com/builder-day-2024-announcements/#...

> No system prompt support—the models use the existing chat completion API but you can only send user and assistant messages.

> No streaming support, tool usage, batch calls or image inputs either.

I think it's worth adding a note explaining that many of these limitations are due to the beta status of the API. max_tokens is the only parameter I've seen deprecated in the API docs.

From https://platform.openai.com/docs/guides/reasoning

> We will be adding support for some of these parameters in the coming weeks as we move out of beta. Features like multimodality and tool usage will be included in future models of the o1 series.

Context: https://x.com/devinjacoviello/status/1833521766146445830

i previously converted this tutorial to an interactive website when it was still in google sheets format and shared it on hn: https://news.ycombinator.com/item?id=40395057

i'm currently in the process of hard forking the repo and converting the remaining tutorials to typescript. just yesterday, i completed the conversion for the next part called "real world prompting", which you can find here: https://freya.academy/anthropic-rwpt-00

that's right, i've mentioned this on the first page of the tutorial. if you don't enable interactive mode, the experience is the same as reading the answer sheet.

i converted the content to a web-friendly format as a personal learning exercise. hopefully it improves the accessibility as well.