The ultimate computer interface?

[spux]

Hi everyone, spüx here.

I've been giving this some thought. What would the ultimate computer interface look like? If I could have any features I wanted, what would they be? In what ways would I interact with it and how would it interact with me? LinuxForums, I figure, is a great place to get feed back on this idea as the linux os is so customizable. Seems to me that you guys and gals might have some more dynamic ideas than the locked down windows crowd. So, here's a short list of features that I wish my system had...

1. It would have two modes, user and administrator.
2. It would be an AI interface which responded to voice commands and would talk back.
3. It would be able to learn to use new programs so as to be able to accomplish tasks.
4. It would be able to act as a personal assistant, making notes on your calendar, reminding you of appointments.
5. It would be scalable, i.e. it can run your laptop or run your whole house.
6. It would be able to act as a finance manager, i.e. pay bills and such.
7. It would be able to handle your correspondences via email.
8. It would be able to make reservations for you either via internet or phone.
9. It would manage all your media like mp3s and movies and rss feeds.
10. it would be fully customizable down to the personality of the AI.

So, what features did I miss? Ideas?

[spux]

Upon reviewing my post, I forgot to say that I'm looking not only for ideas, but also for applications which have been developed or are currently being developed in linux which can do any of these things (except the first on, duh...). Any input is appreciated.

[techieMoe]

1. It would have two modes, user and administrator.

Are we talking about strictly the user interface here or the operating system itself? Pretty much every OS on the planet has regular user and administrator "modes." Elaborate on this please.

3. It would be able to learn to use new programs so as to be able to accomplish tasks.

Not sure what you mean by this one either. Learn to use new programs? Are we talking about artificial intelligence here or just the ability to install stuff?

4. It would be able to act as a personal assistant, making notes on your calendar, reminding you of appointments.

Blackberries and programs like Microsoft Outlook (not to mention Evolution Mail) do this to some extent.

5. It would be scalable, i.e. it can run your laptop or run your whole house.

Actually, a system that ran your house wouldn't need to be very large or very complicated at all. Quite the opposite. The interface and capabilities necessary to run your laptop are far more demanding than a housewide operating system.

6. It would be able to act as a finance manager, i.e. pay bills and such.

Most bank websites allow you to do this. You set them up initially, but after that point the bank pays your bills for you.

7. It would be able to handle your correspondences via email.

By answering them for you? Again, are we talking about AI?

8. It would be able to make reservations for you either via internet or phone.

See 7 and 1.

9. It would manage all your media like mp3s and movies and rss feeds.

What do you mean by "manage"? There are quite a few applications out there that "manage" RSS and multimedia on some level, and even offer suggestions based on what you have. What specifically are you wanting this interface to do?

[spux]

The idea here is to have one agent that does it all for you. sorta like J.A.R.V.I.S. in Iron Man. AI would feature prominently. So, your questions...
3. It would be able to actually USE programs. lets say I want to convert a wav to an mp3.
I say, "computer, take this Fleet Foxes track and turn it into an mp3."
Computer says "sure, just a sec" and opens the appropriate program, converts the song, closes the program.
Computer: "Would you like me to save this in the Fleet Foxes folder in the Music directory?"
I say: Sure
Computer: Done. I really love their vocal harmonies.
Me: Me, too.

Get the idea?

4. Sure there are programs that you can open, input appointments and set reminders... but what if the computer could do it for you?

Me: computer, I have a doctors appointment at 2 pm tomorrow.
Computer: (adds appointment to calendar) ok. would you like me to remind you?
me: sure
Computer: when would you like the reminder?
me: an hour before the appointment.
computer: ok, I'll let you know at 1 pm tomorrow.

6. wouldn't it be better if you had one agent to handle all of it centrally?

7. Not like that, though that'd be neato. more like this...
computer: you have a new email from Jenny.
Me: What's it say?
computer: (reads invitation to party)
Me: Add Jenny's party to my calendar.
Computer: based on the email, it looks like the party is at 3 pm on april 7th. is that when you would like me to add the entry?
me: yes. also, send jenny this reply "Jenny, I would love to come to your party. Is there anything I can bring?"
Computer: (sends email reply) Email sent.

8. I want it to be able to actually call the restaurant and make the reservation.

9. I want to say "play Pink Floyd's The Wall" and have it happen.

does this clarify what I'm trying to get at?

[spux]

So has anyone ever heard of something like this? Is it possible?

[oz]

So has anyone ever heard of something like this? Is it possible?

Welcome to the forums, spux!

Anything is possible with Linux if you have the progamming skills and the hardware needed to make it happen, or at least that's so in my own opinion.

Best of luck with your project.

[L4Linux]

The Minority Report OS could be a big step towards the Ultimate computer interface (whatever that may be...)
Oblong's g-speak: the 'Minority Report' OS brought to life - Engadget
I guess that what is demonstrated in that video can be accomplished in Linux, just need to get that interaction glove work with Compiz-Fusion!!

[ryokimball]

Hi! No time for a serious response right now (sorry), but I thought I'd put a couple of cents in...
I agree with TechieMoe about exactly what you're asking, but since I can't argue that issue...
Anyone play Halo, or especially read the books, and remember the AI's 'body'? Or maybe watched I, Robot and can recall the whole 'why do you give them a human face' thing?
I think it's not a 'big' issue, but still notably important that any AI have some specific physical manifestation, at least a 'human' voice to identify it with.
Hopefully I'll come back later for more

[elija]

Would it be too geeky to suggest that Str Trek get the interface about perfect.

General queries issued by voice with perfect recognition and vocal summary of responses. Detailed responses displayed on a screen, and for more specific commands a simple button press.

The perfect easy to use interface.

I'm only half serious but a few years ago there was a serious discussion on this and it was strangely compelling. I can't find it now though

[techieMoe]

I would love to see something like the LCARS system as well. Unfortunately Majel Roddenberry wouldn't be available to record responses anymore...

LCARS - Wikipedia, the free encyclopedia
LCARS - Memory Alpha, the Star Trek Wiki
Majel Barrett - Wikipedia, the free encyclopedia