The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.
Most presenters already have a remote next/previous slide controller that fits neatly in your hand.
Will that slide controller also allows you to mark the area in the screen and draw shapes? No sir!
And if your wife asks you if you want coffee? "Ah!" says the AC - hotter!
I will surely not raise my hand over my head to get it in Line of Sight with AC to say an AHA!
And how annoying if you don't mean the TV? Or if it's the wife knitting and her hands make the same gesture?
Hmm. Could be. I think I can tackle this odd scenario by simply making more sense to training data. Yes, you right correct to an extent! Wrong gesture could lead to malfunctioning. Like the way system used to get restarted with Win 98 when you pressed ctrl+del twice But then mankind seems to be adjusting to technology more than other way round.
nd how is it going to detect that? Lack of movement?
Nooooooo! By extracting marking your eyeballs, getting the radious of the circle of your balls, calculating the blink probability and detecting!
By the way, I am not trying to justify the work here. It's kind of fun to do some funny things like that. No harm to be a child for a day and enjoy our toys right? At least it makes us smile.
In simple terms alternative inputs and interactions are searched and researched and developed to replace conventional inputs where such inputs are messy. Would you really not like to use the features of touch embedded in you large TV screen which is your main display?
"Writing" way can not be altered. I find touch keyboards as useless as it can get. But they protect you from Keyloggers. So it's never a "all fun and game stuff".
Would you really not like to use the features of touch embedded in you large TV
screen which is your main display?
No. I hate dirty smeared screens. And over 30 years ago we had something called membrane keyboards. They shared a few 'features' with touchscreens and that's why they eventually disappeared. Why repeat the mistakes of the past?
But then, $149 for a camera that "may include known defects..." is a bit pricey...
Still, next time I hit a nice pot in the casinos, I might just have to order one. I'm not too interested in controlling a video game with it, but I certainly could use a decent input device for tracking intruders in my yard and selectively detonating the appropriate mines. Those things are expensive, so I'd rather not waste them.
You've got way better contacts at Intel than I do - good job!
It would be nice if you can also analyze the impact of the knock on the face through a deformation analysis
I can only dream of being that smart. Once, when I was a kid fresh out of college, there was no limit to what my mind could do, and it did some amazing things despite the alcohol. Now, at 58, life is a bit more complicated, and the opportunities for an occasional weekend of pure, creative bliss no longer exist. Too many commitments and collisions on the bus, and no time to truly concentrate.
Carry on in my place, lad, since you have the time, the energy, the brains and the interest to excel. Make us proud, then write articles to teach all of us how you did it. Best of luck to you!
Keep on truckin' Grasshopper: don't let the nattering nabobs of negative-visions deter you from your quest.
Today's strange experiment, that seems so impractical, is ... with luck ... with a strike of serendipity's lightning ... tomorrow's "why didn't we think of that" break-through.
I think what LeapMotion is doing with "gesture" is quite possibly a future "winner" (even if that's in a distant future). And, if speech-recognition ever "gets there," beyond such kindergarten incarnations as Siri: another future (one I will probably be too dead to experience).
I suspect that by 2020 the sixteen-to-thirty generation, then, will refer to those cantakerous clingers to old habits of input, by mouse and keyboard, with the pejorative phrase: "mouse-heads"
"What do humans depend on: words ! We're suspended in language: we can never say what's up: or, down.
We must communicate experience and ideas, but in ways that do not become ambiguous, and lose objectivity.
For parallels in human ideas to quantum theory: we must turn to psychology, or to the paradoxes of being thinkers like Buddha and Lao Tzu illuminated, when trying to grasp reality, as both observer, and actor, in human life's small-scale micro-cosmic drama."
Bill, thanks a lot for the encouraging words. I believe that if a thought is not big enough today should not deter us from thinking and pursuing. In a worst case scenario, it would be just another waste of time. But to think, try and fail is better than No-think, No-try, No-fail.
Because, at least we give ourselves an opportunity trying which would otherwise be surely absent.
However, I have no regret! I got a device for free. I had a buggy but working sdk to work with. I had about a weeks free time and I did what I wanted to do. If not anything, I have enough understanding of what it takes to take control of that mouse and play with it! Hand, voice, face, how it can work, what can work and what can not is right there with me.
Even if I don't succeed to make my research big (Which I have not so far in last ten years of running a startup) its fine. I enjoyed my time coding that little stuff, then making the video, then working with it.
For the naysayers, of course this isn't perfect for every application, but then, neither is a mouse...
I can give a real life example. Its our marriage. Never Perfect. An entire life goes by to figure out what keeps your girl happy and marriage smooth! But we keep trying and improving all days. However that does not stop us from sharing photos of our wifey
Even a trail of something is fun and lets just enjoy the lighter side of the life!
Thanks mate for constructive feedback. Yes I am fine tuning the movement of mouse to use it in existing OS environment. Problem is, if we keep the hand in air, its shaky and therefore cursor keeps moving. Therefore it is sometimes going out of control in actual OS. However with a solid ruleset in place, it can be countered. I will surely give an update about how the stuff is working in real OS environment.
About audio? Yes that is poor . Agreed .
I am real new to these recordings and editing. So far all I have been doing is coding and occasional shooting of my hobby projects. But your suggestion has given me some new thoughts. I have to absolutely learn video editing and mixing.
You should consider the ergonomical aspect of using desktops or any computer: holding up your arms for an extended amount of time is extremely tiring, and expansive gestures even more so! Using a touch screen on a 24 inch screen isn't feasible. You need a controller to record those motions rather than requiring touch, and you need to put the controller down, so you can hold your hands on top of the table or on your lap. This positioning will also prevent other people around you from accidentally triggering commands on your computer. You'll also need some feedback on the screen to see where your hands are, so you can move more precisely.
Another thing to consider is how to tell the computer you're done gesture-commanding it and the following gestures are not meant for it - e. g. when you stand up to get some coffee, or answer a phone call.
The next thing is how should your GUI look like? The mouse was codeveloped with the first GUIs. The two are inseparable. I agree it's about time to switch to a better type of input device, preferably one that defines 3D motion rather than just 2D. But at the same time, we need new interfaces: the standard 2D GUIs are not suitable for gestures of any kind: they need to be designed around the input method!
Thanks for your reply.
Trust me, tracking hand and synchronizing the mouse to even work for 30 seconds is quite tricky. Having done that , I am working on the other test factors.
ou need a controller to record those motions rather than requiring touch, and you need to put the controller down, so you can hold your hands on top of the table or on your lap.
I was actually considering a IR based system. I made one Arduino IR receiver (Others are too expensive for my fun quotient). I have made one IR transmitter wrist band. When you lift the hand remote receiver in PC picks up the signal like car keys and unlocks the mouse. When you put your hand down, receiver does not get signal from your wrist transmitter. So it locks mouse. It is done through adding a serial port listener as dependency property.
Therefore anybody else will not be able to interfere the working.
The next thing is how should your GUI look like?
The first thing that I worked into was GUI. If you see the design, it is not just simple tiles being placed randomly. So the tiles sizes are made in such a way that they accommodate hands and fists.
holding up your arms for an extended amount of time is extremely tiring, and expansive gestures even more so!
It certainly is. 10 days of vertically hanged hands lead me to go for couple of pain killers, before body actually got accustomed to this. However I have mentioned, this can certainly be a no use in desktops. I mean desktops are desktops. For example, Ultrabooks can not be your primary machine! ( At least, it cant be my primary machine) . But for a quick presentation or a fast meeting, or a fast travel in your car's back seat certainly demands a lighter device like Ultrabook.
Similarly Gesture computing will find it's use especially in Lectures, presentations and will one day be embedded in TV. When you see advertisement in the middle of a TV show, you may quickly want to see you mails. Gesture-> Mails-> back to TV.
It will find it's use in Industrial Automation. People will not seat in a Crane and operate, it will be gesture powered.
Even if it is not me, somebody with better monitory resources will take the project ahead and would take it to production level.
I am doing my best to do what best I can do! If not anything, it should give some idea and space to people who can do. However, I will not leave any store unturned to see it works for me. I love it. Believe me it is fun.
The subject said desktop, so I considered the ergonomical problems using those. I agree that other types of devices may be much more reasonable applications for gesture-controlling.
Regarding cranes, I doubt they will ever be controlled by gestures. For one, a faulty command interpretation bears too much risk of severe damage. Second, there is a reason the cranes are operated from top - if there wasn't, they'd already be controlled from the ground via simple wireless (or even wired) remote controls.
More generally, industrial automation already uses lots of ways to remotely control machines, but as with cranes, you'll always have to consider the risk of a faulty command. If anything like gestures would be used there, it would be more to the effect of having the machine stop or move out of the way rather than doing real work. For that purpose, it may not even require an actual gesture but simply detecting any unanticipated movements (i. e. not caused by the machine) within the working area of the machine. In fact I believe such mechanisms already exist.
But back to the topic: the mouse is the main input tool for desktops, and if we are to 'dump the mouse' as you suggest, we need both an ergonomical and suitable alternative input device, and a GUI adapted to that kind of input. To that end your prototype is not a good solution. It may be good in other areas, but it will certainly not replace the mouse.
I've followed the link to the Leap video, and that's much closer to what I'm thinking of. All they need is a good design concept for GUIs based on Leap input. something like that could revolutionize the desktop and indeed supersede the mouse as input device.