|
I'm throttling the events I get out of the gesture LoopFrames using Rx to bring it down to about 10FPS as it's fighting with voice for context. I will be fine tuning it as I go on. At first I was raw processing the gesture, so I was ignoring the pipeline, but the throughput was so fast that it overwhelmed the XAML renderer.
|
|
|
|
|
I don't know if I can pick one that I like the most. The FaceAnalytics was entertaining, but HeadRacing was fun and Ges3Draw is a topic that's close to my heart. You should be proud of yourself for your work - one package would be good, but 6 is outstanding.
|
|
|
|
|
Quote: You should be proud of yourself for your work
I am Pete. I have a wife and a Kid and a strt up ( which still is start up after 10 years). I lost my parents when I was less than 2 months old. Was brought up by orphanage. Had to work for 8 hours in my engineering days to raise money for my studies. Resigned from job after 15 days in work as there was no creativity. I have no relatives, not many friends. So I have made peace with my life. For last 10 years, all I do is work for 16 hours a day. I find creating new things, robotics, PI, Arduino, ECG, .Net, Image Processing and keep learning is a better way to keep my sadness aside than to drink out.
Not everybody's life is same . No complains, no sorrow. Learning is the best way for forgetting what I did not have in life. It felt so good when you appreciated the work. Thanks Pete. Actually I build 11 Prototypes .
Today morning ( My morning starts at 1 AM ) I finshed off the modlling. So I actually extracted the point cloud from RGB depth data and am able to render that model in 3d coordinate system. I want to develop it as a great modelling tool. So you dont have to spend two hours with blender to model a stone. Get a stone, hold it before my prototype, it extracts the 3d model. Now you rotate it in all directions. I get different 3d models of different view of same object. I then extract all the iso surfaces from all view and connect them through mesh to get a single 3d model and it's texture. Just use it readily with xna and other. So if you want a car in gaming project, buy a fancy toy car. Extract it's model and import it in your game.
I may not be able to complete it entirely by 20, but none the less, it is fun.
|
|
|
|
|
Hello Pete. How is it going with your work? Are you working with Images? I had built a complete set of Imaging functions in WPF for ImageGrassy. RGB, GRAY, Writing on Images, Convert between BitmapImage and GDI. Do let me know if you want any code on image processing ( though I feel stupid to offer the Pete' O a code help, I would rather be stupid than be of no use).
Your blog is awesome man. You are some programmer. It will take me another 5 years to reach a programming stage that you are right now in.
|
|
|
|
|
Don't put yourself down my friend. You have some serious coding chops. Thanks for the offer but I am okay with imaging functionality. The contest started last night so I have only just started the app proper. I like what you have done with your code. I never even considered the idea of controlling the mouse. That was a seriously cool idea.
|
|
|
|
|
Hello Pete. How are you doing? I am working with 2-D Augumented reality in perceptual computing now. I have used Dave Karr's card engine to build an augumented reality Solitaire where I put the depth map right in the scene and perform the play.
http://www.youtube.com/watch?v=wCOjuPdBooI[^]
And also I completed the preliminary prototype GesModello. Holding an object in front of the camera to extract it's 3d geometry.
http://www.youtube.com/watch?v=9WXYnDI6Nws[^]
Also I worked with Sacha's YouTube client. This has come out as a very funny and nice little good app.
http://www.youtube.com/watch?v=osvg38RZ4Pg[^]
When you get time, have a look at them and do let me know what you feel about the work.
Right now I am working on another theme in XNA. I call it GesPark. It is sort of a fun with gesture. So we have a 2-D park scene with waters, clouds, trees, apples on trees, fish on ponds.
1. I will hide the sun and slowly the scene will turn into evening scene. Stars will be visible. I can increse number of starts with some finger movement.
2. I will hit the clouds and it will start raining.
3. I will hit the tree for the apples to fall down.
4. Wave hands fast for a Storm.
5. There will be Baloons. If I cut the string with finger movement, they will fly. I can pinch a flying baloon for flowers to come out of it.
6. I can draw different particles .
7. I can wave hand in pond water and water texture effect will increase the water flow. Fishes will start jumping.
Actually I want to build something for my 21 months old kid. He loves spending time with my 6 year old Accer laptop and does funny things. I thought , I would tell you about this.
Also I am working with Volumetric Rendering to create 3-d skin model of medical image sequence like CT scan.
Put all my clients on hold till 20th
|
|
|
|
|
|
Nice. Have you managed to get your submissions in OK? There seem to be a lot of unhappy people having problems with the submission process.
|
|
|
|
|
Fortunately, Intel seems to be valuing my work. One lady by name Rebecca from the Competition team is in consistent touch with me. I had actually missed couple of youtube links in two submissions. She mailed me personally and got it corrected from back end.
As I see, probably I am the craziest of the lot and as it looks now will be accounted for more than 50% of the entries. So far it is 14 out of 27 valid submissions and I am on my way to submit another 3. So it will be 17 total submissions.
|
|
|
|
|
Good luck. I'm rooting for you.
|
|
|
|
|
Thanks Pete.
I just finished my 45 days of madness and 45 days of coding fun. wrapping it off with a work for my kid and for all those kids hidden in our hearts.
Please do watch this. Please.
http://youtu.be/AiRZ3spA0Z4[^]
And please tell me what you feel about the concept.
|
|
|
|
|
Looks very nice. Does your child enjoy it?
|
|
|
|
|
For last 5 hours all he is doing is sitting in front of my ultrabook park, and waving his hand. Prize or no prize, one day of his happiness is worth many such sleepless nights.
|
|
|
|
|
That's great. You have a winner when that happens.
Are you going to post the app on the AppUp store? I would, if I were you.
|
|
|
|
|
Intel had a pre condition that all the apps must be made freely available. So I guess they will be releasing it once the contest is over. Actually all the apps I tested with AppUp in mind only.
Anyways, even if they do not, I will share this entire work in codeproject any how.
You know what Pete, today out of no where I received a development kit from Leap motion. I had never applied. I do not know how they got my address in India and how they sent one without any mail or something.
The guys have created a great hardware, software. Even my wife is calling me with and wave signal. ha ha.
How about you? What kind of work are you into? it must be special. I did all sorts of things with SDK but failed to get FACE and Fingers working togather. Can you tell, why am I unable to get 20fps for face and finger both?
I have taken one session and querying it from two background processes concurrently. But it is so slow. Can you share some lights on this? If I can manage a face and hand togather, I can build some more stuff that were in my mind.
|
|
|
|
|
This[^] is what I'm building. There's no screenshots/video in there this week, but there will be a fair bit in there next week, plus a shout out to you for the idea of controlling the mouse cursor this way.
I don't do facial recognition yet, so I can't comment, but as I progress I should be able to get an answer for you. Once I've finished this contest, I'll be looking at the Leap device as well. My ultimate aim is to create an abstraction layer where you drop in the "pipeline" of choice, so you should be able to work with Kinect/Leap/Gesture without relying on a particular vendor. That's a way off yet.
|
|
|
|
|
Wow, An image that stores all the information. I am mad about image processing. So there is another reason to follow you closely.
A couple of years back I had done a little similar thing. Not as big as yours.
a) Framework: I used wavelet transform to save data behind images. So I was able to save a 2kb file behind a Png/Bmp image of size say about 60 kb.
b). Once succedded, I created a small xml based database system. So Ideas was to create data and save it in xml and put it behind the image. At the time of rendering, extract it, update of delete or whatever and put it back. It was fun. I had given it a name Icard. ( like vcard ). So you take a snap of a person and put all his information behind his image. Store and send that image to phone or wherever and decoder will display all the information.
Whether you want or do not want, I will send you the source code of my ImageGrassy project. Which has tons of algorithm and helper functions. And by the way I do take charges. I need a beer when you win .
So if and when it matters, kind of you can see if you find anything interesting and use it.
-----------------------------------------------------------------
By the way, I am on the verge of completing my 18th and mostly the final entry. "Morsify"
The idea is simple encode your gestures to morse code and decode it as text. Great for people with vocal limitations to communicate. American sign language is bit tough at this moment for sdk ( I tried that too, with hand segmentation and applying PCA but failed. )
So decided that morse code is the way to go. You got to be seeing the video once I complete.
Ok pete, wont prolong the comment. Take care I have to Morsify now. By the way, Can I have your mail ID? I have been replying to this thread only .
|
|
|
|
|
|
Being thirteen and half hours ahead of PST is turning out to be an amazing thing. I have completed my 20th Prototype and trying out a special thing with eyes. Dr Hawkins has been my scientific ideal for long and I am trying to build a text conversion from blink of eyes for assisting paralytic persons.
It has become a habit to send you a small note before and after working with a concept.
I know you have started coding madly and will go through the kind of madness that I experienced for last one month. There is no webcast of the contest from Intel. And not proper keywords are used by all contestants. So I managed to save a list through different searches. You can enjoy at your spare time. There are some good creative submissions.
=====================================A Gift for you=======================================================
Perceptual Computing works
==========================================================================
1. Klyuch Yuri Gesture Games http://www.youtube.com/watch?v=PRuxdmG6JcM
2.http://www.youtube.com/watch?v=hCWuGLlDW4s
3.http://www.youtube.com/watch?v=I4r1_Lwzk1Q
4.http://www.youtube.com/watch?v=XUqhcI_4nWo
5.http://www.youtube.com/watch?v=QirSHRYaCyg
6. http://www.youtube.com/watch?v=w-8HqV0ByHY
7. http://www.youtube.com/watch?v=K5Pket9BPD8
8. http://www.youtube.com/watch?v=y6779QOnh6A
9. http://www.youtube.com/watch?v=VZ9iXTfzMyo
10.http://www.youtube.com/watch?v=PRuxdmG6JcM
11. http://www.youtube.com/watch?v=0L6db9EM8zo
12.http://www.youtube.com/watch?v=izYlOchamb0
13. http://www.youtube.com/watch?v=ISFwJcDELk4
14. http://www.youtube.com/watch?v=EYhZAsKDHb8
15. http://www.youtube.com/watch?v=WV9K_z4l_J8
16.http://www.youtube.com/watch?v=yuMeKyhRpio
17. http://www.youtube.com/watch?v=vUWJYNDokY8
18. http://www.youtube.com/watch?v=EYhZAsKDHb8
19. http://www.youtube.com/watch?v=xgEHjHQGt-c
20.http://www.youtube.com/watch?v=3tKgbsDj_Dc
21. http://www.youtube.com/watch?v=TjenvLzfCog
22. http://www.youtube.com/watch?v=T9Fp1PanPXs
=====================================================
My Submissions
======================================================
1. http://www.youtube.com/watch?v=Xt_p44t5FRE
2.http://www.youtube.com/watch?v=AiRZ3spA0Z4
3.http://www.youtube.com/watch?v=6I3MS_Vu2ZI
4.http://www.youtube.com/watch?v=QTBJA5lbMhA
5.http://www.youtube.com/watch?v=-lVJjsW5pmk
6.http://www.youtube.com/watch?v=wCOjuPdBooI
7.http://www.youtube.com/watch?v=osvg38RZ4Pg
8. http://www.youtube.com/watch?v=osvg38RZ4Pg
9. http://www.youtube.com/watch?v=9WXYnDI6Nws
10.http://www.youtube.com/watch?v=QUtk97D_yR8
11.http://www.youtube.com/watch?v=vWOqr-w769k
12.http://www.youtube.com/watch?v=9jc9o1B7TlI
13.http://www.youtube.com/watch?v=WcuCKvT8bcM
14.http://www.youtube.com/watch?v=l2RAfDacsAA
15.http://www.youtube.com/watch?v=LHXhrTh99aA
16.http://www.youtube.com/watch?v=eN6PeYK3pEc
17.http://www.youtube.com/watch?v=-gFh7kJX4_w
18. http://www.youtube.com/watch?v=KxRGlkr0NGo
19.http://www.youtube.com/watch?v=tbA55znyGXA
20. http://youtu.be/E1gcUzI7AWo
======================================================
Take care mate.
|
|
|
|
|
Thanks. I'll have a look at them when I can.
As for contacting me, you can reach me at pete dot ohanlon. It's a gmail address.
|
|
|
|