如何找到关节坐标(X,Y,Z),以及如何绘制被跟踪关节的轨迹?

时间:2012-11-11 22:59:13

标签: kinect gesture kinect-sdk

我正在尝试开发一个逻辑来识别由用户右手制作的圆圈,我得到了从示例代码中绘制骨架和跟踪的代码,

private void SensorSkeletonFrameReady(object sender, SkeletonFrameReadyEventArgs e)
    {
        Skeleton[] skeletons = new Skeleton[0];

        using (SkeletonFrame skeletonFrame = e.OpenSkeletonFrame())
        {
            if (skeletonFrame != null)
            {
                skeletons = new Skeleton[skeletonFrame.SkeletonArrayLength];
                skeletonFrame.CopySkeletonDataTo(skeletons);
            }
        }

        using (DrawingContext dc = this.drawingGroup.Open())
        {
            // Draw a transparent background to set the render size
            dc.DrawRectangle(Brushes.Black, null, new Rect(0.0, 0.0, RenderWidth, RenderHeight));

            if (skeletons.Length != 0)
            {
                foreach (Skeleton skel in skeletons)
                {
                    RenderClippedEdges(skel, dc);

                    if (skel.TrackingState == SkeletonTrackingState.Tracked)
                    {
                        this.DrawBonesAndJoints(skel, dc);
                    }
                    else if (skel.TrackingState == SkeletonTrackingState.PositionOnly)
                    {
                        dc.DrawEllipse(
                        this.centerPointBrush,
                        null,
                        this.SkeletonPointToScreen(skel.Position),
                        BodyCenterThickness,
                        BodyCenterThickness);
                    }
                }
            }

            // prevent drawing outside of our render area
            this.drawingGroup.ClipGeometry = new RectangleGeometry(new Rect(0.0, 0.0, RenderWidth, RenderHeight));
        }
    }

我现在要做的是跟踪用户右手的坐标以进行手势识别,

以下是我计划完成工作的方式:

  1. 开始手势
  2. 绘制带圆圈的手势,确保存储开始的坐标,然后记录每次从开始的45度移位的坐标,对于8个八分圆,我们将获得8个样本。
  3. 为了确定绘制圆圈,我们可以检查八个样本之间的关系。
  4. 此外,在深度图像中,我想要显示绘制手势的轨迹,因此当手持点移动时,它会留下一条痕迹,所以最后我们将得到一个由用户绘制的图形。我不知道如何实现这一点。

1 个答案:

答案 0 :(得分:4)

每个SkeletonFrameReady事件期间,每个跟踪骨架的坐标都可用。在foreach循环内...

foreach (Skeleton skeleton in skeletons) {
    // get the joint
    Joint rightHand = skeleton.Joints[JointType.HandRight];

    // get the individual points of the right hand
    double rightX = rightHand.Position.X;
    double rightY = rightHand.Position.Y;
    double rightZ = rightHand.Position.Z;
}

您可以查看JointType枚举来拉出任何关节并使用各个坐标。

要绘制手势线,您可以使用示例中的DrawContext或使用其他方式在视觉图层上绘制Path。使用x / y / z值,您需要将它们缩放到窗口坐标。 “Coding4Fun”库提供了预先构建的功能;或者你可以自己编写,例如:

private static double ScaleY(Joint joint)
{
    double y = ((SystemParameters.PrimaryScreenHeight / 0.4) * -joint.Position.Y) + (SystemParameters.PrimaryScreenHeight / 2);
    return y;
}

private static void ScaleXY(Joint shoulderCenter, bool rightHand, Joint joint, out int scaledX, out int scaledY)
{
    double screenWidth = SystemParameters.PrimaryScreenWidth;

    double x = 0;
    double y = ScaleY(joint);

    // if rightHand then place shouldCenter on left of screen
    // else place shouldCenter on right of screen
    if (rightHand)
    {
        x = (joint.Position.X - shoulderCenter.Position.X) * screenWidth * 2;
    }
    else
    {
        x = screenWidth - ((shoulderCenter.Position.X - joint.Position.X) * (screenWidth * 2));
    }


    if (x < 0)
    {
        x = 0;
    }
    else if (x > screenWidth - 5)
    {
        x = screenWidth - 5;
    }

    if (y < 0)
    {
        y = 0;
    }

    scaledX = (int)x;
    scaledY = (int)y;
}