Click here to Skip to main content
14,029,967 members
Click here to Skip to main content
Add your own
alternative version


13 bookmarked
Posted 10 Sep 2015
Licenced CPOL

Artificial Intelligent Home Assistant

, 10 Sep 2015
Rate this:
Please Sign up or sign in to vote.
An Artificial Intelligent Home Assistant

This article is an entry in our AppInnovation Contest. Articles in this sub-section are not required to be full articles so care should be taken when voting.

Good day to all 


    Here am discussing about autonomous intelligent Home Assistant. It is a virtual Robot for you and your home. It will take care of all your Home needs. It will check your house hold groceries and order for you. It will speak to you and you can speak to the virtual robot. The robot will be able to recognize your commands and order what ever products you want to order.

      It is helpful for all families in bringing the intelligent systems in their lives. There is no need to go for shopping malls and it is a new way of ordering things. The intelligent desktop app will make all the things for you. You can order directly or else it will order intelligently according to your needs.


You have heard about Richard Wallace Chat Bot the AIML based chatting application. The same AIML (Artificial Intelligence Markup Language) technology is used for background intelligence of virtual Robot. The App will have speaking robot as GUI and also it can work as background Task. It will use Google's speach engine for converting your speech into Text or Microsoft speech Engine. The AIML and WebServices are used for taking your order. A wide angle bar code scanner which can scan 4 to 5 items at a time can be used to scan the predefined tags on grocery bottles. The motor connected to scanner will scan all the grocery bottles and identify the quantity of product is less than 20 % or not. The scanner is Microsoft Kinect sensor itself. whenever your house hold items especially groceries are less than 20% then it will automatically order for the new products.

Remaining Products:

    There are many other products which are of quantity based like Tooth Paste, Hair Oil, facial creams, Soaps and perfumes which are mostly constant for monthly basis. It will order for you every month depending on your usage. And also if you need to order something other you can order directly by your voice or using scanning.  Daily orders like milk, curry leaves, and other items will be ordered daily basis. 


The voice order will processed like this Example if you need a cold drink.

Human: get me a cold drink 

Robot: I am ordering for you a coke from the WallMart Store. Is it ok?

Explanation: The process will happen like this It will take cold drink as key word from your sentence and it will pick your most frequent order i:e coke in this example and order from the nearest retailer shop wall mart as nearest store it will deduct from your account and make order.  Then if you say yes or ok  then it will get for you else it will ask questions depending on your criteria and order will be made.

Also if you want order some particular item from some particular shop then you are welcome

Human: get me pepsi from Reliance Mart.

Robot: Yes Sir Should i order?

Depending on your needs it will constantly monitoring you and ordering for you and make you feel happy. 


If you need some other items like Dress or Jewelery you can dress virtually using Kinect sensor it will measure your body measurements and give you variety of options to choose and also change colors accordingly you fit into them. you can virtually wear Jewelery and check from home itself. This is new style of shopping the things. The Artificial intelligence and Powerful Computing Machine will make you a new style of living you can even monitor your home or children from your office by pinging to your robot address and you can virtually play with children and look after them.

When any product is completed You have a chance to renew new things by making voice commands or else scan and throw your waste wrappers it will order for you.

  About the uploaded files: 

The uploaded files are an intelligent chat system image, and a Robot which can stream video and audio and also it will make intelligent speech with humans which i am currently developing.   





    My Category goes into Retail (The Way We Shop).According to category My platform goes to Tablet.But since i have to do video processing and Kinect barcode scanning I think the platform should be All in One(for good amount of run time memory). So i request for All in One. 




  •  First step is to scan bar code using kine-ct sensor and get the bar code and process it to get the details on the bar code. 
  • Then from the back end the submission form of order will be filled with defaults depending on the users interest (He usually take 1kilogram quantity from wallmart store). The form will be filled accordingly and process the order. 
  • And whatever going on should be notified to user while billing time.


  • Second step is getting voice commands from the user.Every time it will listen to you depending on the amplitude of your voice.  
  • If you are in conversation with others the application will listen for 10 seconds and it will delete the conversation. 
  • If you want to start conversation with robot you can ping it in two ways. Come into field view of robot and speak to robot. or you can start doing conversation by specifying it like "Robot what are you doing?" 
  • Then robot will be taken as keyword and it will give answer according to your question. 


  • Third step is to order taking from your commands. You say robo get me ice cream.
  • The Robot will see the pattern of the sentence if pattern like "get me ***" take the star as keyword and search in the product list and its manufacturing list and then retailers list and order for you.
  • It will order chocolate ice cream from vanilla brand from nearby retail store, and that to depends on users previous orders .


  • Fourth step is video streaming from remotely. Talk to your robot from remotely and monitor your house and also through video streaming you can entertain your children.





  • AIML 
  • C# 
  • Kinect sdk 
  • Xml 
  • Java Script 
  • Html,CSS,JSP 
  • Zxing library for bar code scanning 
  • and other utils.  

     Currently  am working on AndroHumanoid Robot which is replica of virtual home Assistant. Now am working on real robot. The same robot which can be made virtually for intelligent homes as discussed above.

The video link as follows        

<iframe width="420" height="315" src="" frameborder="0"> </iframe>


This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


About the Author

Gnanendra Kumar
Software Developer self employed
India India
I am android and Robotics developer. I love to do electronic projects. I can summarize my self in three words.
concise,creative and compelling.

You may also be interested in...

Comments and Discussions

QuestionHow's app development going? Will you be submitting on time? Pin
Kevin Priddle22-Oct-13 10:34
professionalKevin Priddle22-Oct-13 10:34 
AnswerRe: How's app development going? Will you be submitting on time? Pin
Gnanendra Kumar22-Oct-13 17:23
professionalGnanendra Kumar22-Oct-13 17:23 
QuestionYou lost me at 'u'. Pin
DanielSheets29-Aug-13 9:23
memberDanielSheets29-Aug-13 9:23 
AnswerRe: You lost me at 'u'. Pin
Gnanendra Kumar29-Aug-13 17:46
professionalGnanendra Kumar29-Aug-13 17:46 
GeneralRe: You lost me at 'u'. Pin
DanielSheets30-Aug-13 1:14
memberDanielSheets30-Aug-13 1:14 
GeneralMy vote of 5 Pin
ThatsAlok31-Jul-13 23:55
memberThatsAlok31-Jul-13 23:55 
GeneralRe: My vote of 5 Pin
Gnanendra Kumar1-Aug-13 0:06
professionalGnanendra Kumar1-Aug-13 0:06 
Questionreduce the width of chat image Pin
ThatsAlok31-Jul-13 23:55
memberThatsAlok31-Jul-13 23:55 
AdminThanks for your submission! Pin
Kevin Priddle31-Jul-13 7:54
professionalKevin Priddle31-Jul-13 7:54 
AdminRe: Thanks for your submission! Pin
Kevin Priddle2-Aug-13 3:52
professionalKevin Priddle2-Aug-13 3:52 
GeneralRe: Thanks for your submission! Pin
Gnanendra Kumar2-Aug-13 5:20
professionalGnanendra Kumar2-Aug-13 5:20 
GeneralRe: Thanks for your submission! Pin
Kevin Priddle2-Aug-13 5:39
professionalKevin Priddle2-Aug-13 5:39 
GeneralRe: My vote of 5 Pin
Gnanendra Kumar28-Jul-13 6:36
professionalGnanendra Kumar28-Jul-13 6:36 
GeneralRe: My vote of 5 Pin
Gnanendra Kumar31-Jul-13 23:05
professionalGnanendra Kumar31-Jul-13 23:05 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

Permalink | Advertise | Privacy | Cookies | Terms of Use | Mobile
Web02 | 2.8.190419.4 | Last Updated 11 Sep 2015
Article Copyright 2015 by Gnanendra Kumar
Everything else Copyright © CodeProject, 1999-2019
Layout: fixed | fluid