Good day to all
Here am discussing about autonomous intelligent Home Assistant. It is a virtual Robot for you and your home. It will take care of all your Home needs. It will check your house hold groceries and order for you. It will speak to you and you can speak to the virtual robot. The robot will be able to recognize your commands and order what ever products you want to order.
It is helpful for all families in bringing the intelligent systems in their lives. There is no need to go for shopping malls and it is a new way of ordering things. The intelligent desktop app will make all the things for you. You can order directly or else it will order intelligently according to your needs.
You have heard about Richard Wallace Chat Bot the AIML based chatting application. The same AIML (Artificial Intelligence Markup Language) technology is used for background intelligence of virtual Robot. The App will have speaking robot as GUI and also it can work as background Task. It will use Google's speach engine for converting your speech into Text or Microsoft speech Engine. The AIML and WebServices are used for taking your order. A wide angle bar code scanner which can scan 4 to 5 items at a time can be used to scan the predefined tags on grocery bottles. The motor connected to scanner will scan all the grocery bottles and identify the quantity of product is less than 20 % or not. The scanner is Microsoft Kinect sensor itself. whenever your house hold items especially groceries are less than 20% then it will automatically order for the new products.
There are many other products which are of quantity based like Tooth Paste, Hair Oil, facial creams, Soaps and perfumes which are mostly constant for monthly basis. It will order for you every month depending on your usage. And also if you need to order something other you can order directly by your voice or using scanning. Daily orders like milk, curry leaves, and other items will be ordered daily basis.
EXAMPLE FOR VOICE ORDER:
The voice order will processed like this Example if you need a cold drink.
Human: get me a cold drink
Robot: I am ordering for you a coke from the WallMart Store. Is it ok?
Explanation: The process will happen like this It will take cold drink as key word from your sentence and it will pick your most frequent order i:e coke in this example and order from the nearest retailer shop wall mart as nearest store it will deduct from your account and make order. Then if you say yes or ok then it will get for you else it will ask questions depending on your criteria and order will be made.
Also if you want order some particular item from some particular shop then you are welcome
Human: get me pepsi from Reliance Mart.
Robot: Yes Sir Should i order?
Depending on your needs it will constantly monitoring you and ordering for you and make you feel happy.
If you need some other items like Dress or Jewelery you can dress virtually using Kinect sensor it will measure your body measurements and give you variety of options to choose and also change colors accordingly you fit into them. you can virtually wear Jewelery and check from home itself. This is new style of shopping the things. The Artificial intelligence and Powerful Computing Machine will make you a new style of living you can even monitor your home or children from your office by pinging to your robot address and you can virtually play with children and look after them.
When any product is completed You have a chance to renew new things by making voice commands or else scan and throw your waste wrappers it will order for you.
About the uploaded files:
The uploaded files are an intelligent chat system image, and a Robot which can stream video and audio and also it will make intelligent speech with humans which i am currently developing.
CATEGORY AND PLATFORM DETAILS:
My Category goes into Retail (The Way We Shop).According to category My platform goes to Tablet.But since i have to do video processing and Kinect barcode scanning I think the platform should be All in One(for good amount of run time memory). So i request for All in One.
- First step is to scan bar code using kine-ct sensor and get the bar code and process it to get the details on the bar code.
- Then from the back end the submission form of order will be filled with defaults depending on the users interest (He usually take 1kilogram quantity from wallmart store). The form will be filled accordingly and process the order.
- And whatever going on should be notified to user while billing time.
- Second step is getting voice commands from the user.Every time it will listen to you depending on the amplitude of your voice.
- If you are in conversation with others the application will listen for 10 seconds and it will delete the conversation.
- If you want to start conversation with robot you can ping it in two ways. Come into field view of robot and speak to robot. or you can start doing conversation by specifying it like "Robot what are you doing?"
- Then robot will be taken as keyword and it will give answer according to your question.
- Third step is to order taking from your commands. You say robo get me ice cream.
- The Robot will see the pattern of the sentence if pattern like "get me ***" take the star as keyword and search in the product list and its manufacturing list and then retailers list and order for you.
- It will order chocolate ice cream from vanilla brand from nearby retail store, and that to depends on users previous orders .
- Fourth step is video streaming from remotely. Talk to your robot from remotely and monitor your house and also through video streaming you can entertain your children.
Currently am working on AndroHumanoid Robot which is replica of virtual home Assistant. Now am working on real robot. The same robot which can be made virtually for intelligent homes as discussed above.
- Kinect sdk
- Java Script
- Zxing library for bar code scanning
- and other utils.
<iframe width="420" height="315" src="http://www.youtube.com/embed/BX4xT3WTeMc" frameborder="0"> </iframe>