827 karma · joined June 26, 2014
hn684 [at] aryeh [dot] sent [dot] com
Jev input … > Unstructured data (e.g. text) with an emphasis on structured program state.
What pre-training data/model is Jev based on? Surely result effectiveness is dependent (outside of one’s own input as “state”) on that?
Isn’t “full” alignment and guardrails a task that can never be generally achieved? One will always discover and realize the need for new guidelines and guardrails? What about vague, incomplete, inconsistent nuances and generalizations - that make this a losing battle?
I suggest ultimate safeguards need to be outside the models?
https://www.reuters.com/business/meta-launches-ai-agent-that...
From the article:
- … rolled out … despite internal concerns that the technology mismanages its access to sensitive personal data
- The product will be available only in the U.S.initially
- A basic version of the agent will be available for free, while Meta will offer subscriptions priced at $20 a month and $100 a month for heavier usage
- People can opt out of their interactions being used to train Meta's AI models.
- Others flagged serious security flaws, like an agent routing around guardrails …
Albeit, that I view many of the things in the list as “ideals” or “values”, rather than “luxuries”. The greatest thing one can aspire to in terms of an ideal, is to have “peace of mind” in my opinion.
Sadly, I attribute this to a decline in having “good will” towards others, and an increase in cynicism, prejudice, and meanness.
Isn’t the question how to keep likely dependent modules separated from each other in a monolith? You say “single purpose”, but how does that admonition work in the reality of a complex problem domain?
It is that we are governed by those chosen by us to represent us. In a perfect democracy the government is (the majority of) us. Hence the saying … “in a democracy the people get the government they deserve”.
If only we knew how. All we seem to know formally given popular discourse is languages, frameworks, tools, protocols and algorithms.
Thinking about how to move beyond functional decomposition and structured design to enable those “blueprints” isn’t even on the agenda?
This is a problem with your instructions, your specification. An LLM isn't a mind reader. It will attempt to succeed regardless of missing requirements and ambiguity.
I thought hide just hid that particular entry. Have I been wrong all this time?
I also wonder. Is there no further design thought, research or discussion on how to better modularize a program to address complexity - in an LLM world?
Instead, we still can’t move beyond arguing about languages …
It made me wonder how many paid subscribers realize they are using the same 5.5 instant model as free users by default. A dark pattern or oversight?
A great alternative future to look forward to - 1 employee expected to do the work of 10-100. Those others fired to save money.
> Overall, I'd like to understand those who have a positive outlook on design and software engineering as a career.
I think until the market better achieves some equilibrium, there is no way general software programming (sorry “engineering”) should be considered as a career. That said, there will always be opportunities in particular markets or specialties.
In an industry that loves calling itself "engineering", it seems nothing further of value can be established?
But a lot of Managers (and the managed) think it is about managing people. Their real role is “Overseer” not Manager, and in that role their real task is to ensure you’re working harder.
Pursuing the intellectual mechanics of a system is obscuring the error of the wrong system!
Instead stock levels should take into account lead time, historical seasonal demand, and a subjective value. The observation and order frequency should be in months not days. While computing allows near “real time” everything, that doesn’t mean it should necessarily be applied.
Just-in-time thinking needs to take the reality of the system (in this case the supply chain) and other factors like hedging opportunities?
Unlike transformational software that can use mathematics as a conceptual framework, representational systems have no such thing.
Yet it is complex representational systems that allow the operation of our modern world.
Human coding effort without such a framework is problematic, and that is just exacerbated with AI generated code. Should we be surprised that for this type of software AI makes thing worse?