Click here to Skip to main content
Click here to Skip to main content

Tagged as

Kinect for Windows: Find User Height Accurately

, 23 Jan 2014
Rate this:
Please Sign up or sign in to vote.
Kinect for Windows - find user height accurately
View original article

Introduction

Some people ask me if there is a way to determine the height of a user standing in front of a Kinect device. The answer is definitely positive: We can detect the user's height regardless of her distance from the sensor! We only need some very basic math knowledge. Let's find out more...

Prerequisites

The algorithm of finding the user's height

Kinect provides you with the coordinates (X, Y and Z) of 20 skeleton joints. Someone might think that a person's height is the distance from the head joint to a foot joint, right? Wrong! Your users might stand in bended knees, they might lean a bit to the left or to the right. If you try to calculate the distance defined from the head joint to one of the foot joints, you'll get a far from accurate result.

Another point of interest is that Kinect gives you the center of the head joint. This means that you'll need to add 9 - 12 centimetres to the calculated height. You won't be able to calculate the total height with 100% accuracy. If you need more accuracy, you'll need to detect the end of the head using the depth stream. Not that difficult, but let's focus on the skeleton stream right now.

If you examine the human skeleton joints a little more carefully, you'll notice that the height is the sum of the lengths of the following line segments:

  • Head - ShoulderCenter
  • ShoulderCenter - Spine
  • Spine - HipCenter
  • HipCenter - KneeLeft or KneeRight
  • KneeLeft / KneeRight - AnkleLeft / AnkleRight
  • AnkleLeft / AnkleRight - FootLeft / FootRight

Here is a comprehensive picture illustrating the above segments:

First of all, we need to calculate the length of the line defined by two joints in the 3D space. This is quite easy Mathematics. Simply find the square root of the sum of squared differences of the coordinates:

public static double Length(Joint p1, Joint p2)
{
    return Math.Sqrt(
        Math.Pow(p1.Position.X - p2.Position.X, 2) +
        Math.Pow(p1.Position.Y - p2.Position.Y, 2) +
        Math.Pow(p1.Position.Z - p2.Position.Z, 2));
}

And here is a way to find the length of more than two joints:

public static double Length(params Joint[] joints)
{
    double length = 0;

    for (int index = 0; index < joints.Length - 1; index++)
    {
        length += Length(joints[index], joints[index + 1]);
    }


    return length;
}

Pretty straightforward till here. But, wait a second! How will you determine which leg corresponds to the most accurate user height? Since we suppose that both of the user's legs have the same length, we need to choose the one that is tracked better! This means that no joint position is hypothesized. Here is how to find out the number of tracked joints within a joint collection:

public static int NumberOfTrackedJoints(params Joint[] joints)
{
    int trackedJoints = 0;

    foreach (var joint in joints)
    {
        if (joint.TrackingState == JointTrackingState.Tracked)
        {
            trackedJoints++;
        }
    }


    return trackedJoints;
}

We can now safely decide on which leg to use:

int legLeftTrackedJoints = 
	NumberOfTrackedJoints(hipLeft, kneeLeft, ankleLeft, footLeft);
int legRightTrackedJoints = 
	NumberOfTrackedJoints(hipRight, kneeRight, ankleRight, footRight);

double legLength = legLeftTrackedJoints > legRightTrackedJoints ? Length(hipLeft, 
  kneeLeft, ankleLeft, footLeft) : Length(hipRight, kneeRight, ankleRight, footRight);

And here is the final method:

public static double Height(this Skeleton skeleton)
{
    const double HEAD_DIVERGENCE = 0.1;

    var head = skeleton.Joints[JointType.Head];
    var neck = skeleton.Joints[JointType.ShoulderCenter];
    var spine = skeleton.Joints[JointType.Spine];
    var waist = skeleton.Joints[JointType.HipCenter];
    var hipLeft = skeleton.Joints[JointType.HipLeft];
    var hipRight = skeleton.Joints[JointType.HipRight];
    var kneeLeft = skeleton.Joints[JointType.KneeLeft];
    var kneeRight = skeleton.Joints[JointType.KneeRight];
    var ankleLeft = skeleton.Joints[JointType.AnkleLeft];
    var ankleRight = skeleton.Joints[JointType.AnkleRight];
    var footLeft = skeleton.Joints[JointType.FootLeft];
    var footRight = skeleton.Joints[JointType.FootRight];


    // Find which leg is tracked more accurately.
    int legLeftTrackedJoints = 
    NumberOfTrackedJoints(hipLeft, kneeLeft, ankleLeft, footLeft);
    int legRightTrackedJoints = 
    NumberOfTrackedJoints(hipRight, kneeRight, ankleRight, footRight);


    double legLength = legLeftTrackedJoints > legRightTrackedJoints ? 
      Length(hipLeft, kneeLeft, ankleLeft, 
      footLeft) : Length(hipRight, kneeRight, ankleRight, footRight);


    return Length(head, neck, spine, waist) + legLength + HEAD_DIVERGENCE;
}

Finally, you can use this extension method within a custom application easily:

void Sensor_SkeletonFrameReady(object sender, SkeletonFrameReadyEventArgs e)
{
    using (var frame = e.OpenSkeletonFrame())
    {
        if (frame != null)
        {
            Skeleton[] skeletons = new Skeleton[frame.SkeletonArrayLength];
            frame.CopySkeletonDataTo(skeletons);

            var skeleton = skeletons.Where(s => s.TrackingState == 
                  SkeletonTrackingState.Tracked).FirstOrDefault();

            if (skeleton != null)
            {
                double height = skeleton.Height();
            }
        }
    }
}

You can now integrate this code to your own applications and find out the user's height! Consider downloading Vitruvius for the complete source code and examples.

Enjoy kinecting!

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

Vangos Pterneas
Product Manager LightBuzz
United Kingdom United Kingdom
Vangos Pterneas is a Microsoft Most Valuable Professional in the Kinect technology. He helps companies from all over the world grow their revenue by creating profitable software products. Vangos is the owner of LightBuzz Software agency and author of two technical books.
Follow on   Twitter   Google+   LinkedIn

Comments and Discussions

 
GeneralMy vote of 3 Pinmembercodeprojectvien21-Sep-12 15:20 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web04 | 2.8.140827.1 | Last Updated 23 Jan 2014
Article Copyright 2012 by Vangos Pterneas
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid