eb3c90

I think I disagree. When you get past AGI to where it can do things that humans can't, a lot of current safeguards haven't been designed with it in mind. So things might be vulnerable.

The kinds of things I'm thinking about are the various countries nuclear arsenals might not be safe from actors with very advanced AI. This I think is the potential source of existential risk, in my opinion. So it could hurt a hell of a lot.

So I'm of the responsible disclosure point of view. You ask "Would releasing AI advancement X mess up someones security/economy". If so, you help them patch it before releasing it to the general public.

The majority of advancements aren't like that and they won't be for a while.

They have got some adoption. Android security model is somewhat capability security based.

However it is used in an insufficiently fine grained way. It does highlight some ways that it may not work if used for desktop, programs would just ask for large-grained capabilities (can I access all your pictures/files etc) and you get back to ambient style authority.

I think expecting the user to be an intelligent judge of what capabilities a program needs, is not realistic. I think something like agoric auction of capabilities might force programs to provide useful features to get access to data, might work. I'm exploring it anyway.

Thought it worth pointing out that Cheri are giving hardware capabilities another go.

http://www.cl.cam.ac.uk/research/security/ctsrd/cheri/

So do I. Consider the technological extreme of open source manufacturing. A set of tools like repraps, that that can really make themselves (and computers etc)

I think we can make supply distributed (given micro manufacturing/recycling etc) so even if it is less efficient for a community to do it than something more centralised they still have some autonomy. See my profile for my website if you are interested where I am coming from.

My bet on this subject is a combination of evolutionary computing, agorics[1], deep learning style feedback and language learning.

I've got a repo[2] for a vm where the programs can act in that way. But I am at the early stages of programming initial programs with economic/learning strategies. So I don't know how promising it is. More details can be found spread out on my blog [3]

[1] https://e-drexler.com/d/09/00/AgoricsPapers/agoricpapers.htm...

[2] https://github.com/eb4890/agorint/

[3] https://improvingautonomy.wordpress.com/2017/08/13/introduct...

I'm interested if we can have our cake and also eat it. Use advanced technology/manufacturing to make our communities more self-sufficient. So we are less reliant on the state.

https://improvingautonomy.wordpress.com/

I have hope that general AI will be a democratizing force again.

Having something that can be taught by a human and trained with messy real world data, rather than vast data sets and specialized computer scientists, will make a huge difference.

I'd like it to general intelligence augmentation[1] so we aren't creating more agents with their own goals.

I'm not sure what the future looks like then. With my futurist monocle on you could imagine most SaaS being disrupted. You still want to send messages, but those can be encrypted and the IA manages the encryption for you, so you don't have to. Searching still seems pretty likely to be centralised although different communities might run their own if IA makes that sort of thing easy.

[1]: https://improvingautonomy.wordpress.com/2017/08/22/a-possibl... and obviously https://waitbutwhy.com/2017/04/neuralink.html

You can do this now. $work uses github and has it so that a bit of code has to have be reviewed before it can be merged to master.

This will be a big thing. We could give people an allowance of a certain amount of land that is tax-free (as we have in the UK for income).

In the longer term, government could also be self-sufficient. This might be unstable though, it might be better for there to be a contribution of materials/energy/information to the the government from self-sufficient communities. The government would still provide the value of protection/arbitration to the self-sufficient communities.

I know a bit about the transcendentalist movement of the early 19th century. I'd be interested to links to earlier stuff.

I think the birth of proper AI is a critical juncture for this idea (either enabling more self-sufficiency or reducing it). Which is why I'm bringing it up again now.

I hope when we get there that we have set up a Manufacturing Freedom Foundation, equivalent to the EFF.

One possible future we should think about is one where humans are more capable (through technology) and can provide for more of their needs. So work would go back to being owned by us.

It would be a more self-sufficient life style, but on a higher technology base than farmers.

I'm blogging about it here at https://improvingautonomy.wordpress.com . My post on universal basic income is probably the most relevant.

https://improvingautonomy.wordpress.com/2017/08/05/what-afte...

I hope this line of thinking can be part of our discussion about the future of work.

I'd be interested in what you think of my approach elsewhere in the replies.

In some ways it is a search through program space. But then I think we as intelligences do a guided search through program space as we develop. It seems important to use what information you can to guide you e.g. culture and copying other people who have already been navigating the space of programs to be.

Yep, while people have to worry about the memory/cpu usage of the programs inside a computer, we are probably going to be stuck with just narrow AI. General Intelligence needs the ability to trade off resources between different programs doing different things (these may be learning different things, processing data or doing other computational tasks).

Also we get malware because we expect the user to be a good knowledgeable authoritarian manager of a system and never run a bad program and be able to get rid of a bad program when it occurs. This just isn't realistic.

This is my plan https://improvingautonomy.wordpress.com/2017/08/22/a-possibl...

I'm aiming for General Intelligence Augmentation, rather than AGI, but I it could be adapted.

I think the trick we are missing is always developing AI systems that need external programmers/maintainers. If we get away from that mindset, I think we will be more successful, even if it is not my particular vision.

This might be a better link. It explains how we might get to IA. TL;DR It is a mix of machine learning with different parameters and inputs/outputs and language translation into programs with the economy acting as the force to guide this evolving set of programs.

https://improvingautonomy.wordpress.com/2017/08/22/a-possibl...

I'm working on a technology that I think might enable either IA or AI. Basically intelligences manage their own programs and the computational resources allocated to those programs. So I'm looking at doing that with markets.

With IA the user acts as feedback to the market about what is good or bad. Ideally it would act as an external brain lobe. More information on my approach is on this blog https://improvingautonomy.wordpress.com/2017/07/25/why-study...

I decided to put more effort into making a community, got a wordpress https://improvingautonomy.wordpress.com/ and a subreddit so far. https://www.reddit.com/r/improvingautonomy/

Feedback and/or participation would be great

I think we don't have enough people trying to improve human's autonomy, that is their ability to do something by themselves (or in smaller groups). I'm trying to build a community around this and this is an something I'd like feedback on

Cool. Glad you liked it. It was great to read your comments about similar ideas.

I think my next step is to see if it'll take on HN, so I've just submitted it. If not try and repackage it and get it on an interesting blog/website. Where would you expect to see something like that?

I've been thinking about this a bit. I think we need to get better intelligence augmentation. We are limited in what we can produce, because we are limited in what we can manage. So we need to improve how much we can manage.

I'm thinking about it in terms of improving autonomy

http://effective-altruism.com/ea/1cm/autonomy_a_search_for_a...

I've been trying to find a community. But it seems pretty diffuse.