如何使用libfreenect2设置OpenNI2和NITE以在OSX上进行骨架跟踪?

时间:2016-08-24 21:56:42

标签: macos kinect openni kinect-v2 libfreenect2

我刚刚在OSX 10.11.5上设置libfreenect2并且我可以成功运行显示RGB / IR /深度流的Protonect演示,但我也想使用OpenNI / NITE进行骨架跟踪。

我已按照repo的README文件中的说明进行OpenNI,但当我尝试运行NiViewer时,我得到了这个:

NiViewer 
openDevice failed:
    DeviceOpen using default: no devices found

Press any key to continue . . .

我目前正在github上查看libfreenect2问题并记录我正在尝试的内容和结果here。任何提示/提示都很有帮助。

<击> 在OSX上使用Kinect v2使用libfreenect2设置和测试OpenNI / NITE的最简单方法是什么?

当我应该使用NiTE2.2时,我正在使用NiTE 1.5 我只是将libfreenect2-openni2.0.dyliblibfreenect2/build/lib复制到NiTE-MacOSX-x64-2.2/Samples/Bin/OpenNI2/Drivers/,然后运行SimpleUserTracker示例,它就有用了!

还有一个问题:只打印到控制台的样本运行,但打开窗口和渲染的样本不起作用。没有窗口呈现,好像该线程以某种方式被阻止。 那是我使用集成的Intel GPU的时候。如果我使用离散的nVidia GPU,应用程序崩溃:

./UserViewer 
   124095 INFO       New log started on 2016-08-30 20:32:19
   124114 INFO       --- Filter Info --- Minimum Severity: VERBOSE
   126001 VERBOSE    No override device in configuration file
   126029 VERBOSE    Configuration has been read from '/Users/George/Downloads/Grouped/Projects/code+libs/NiTE-MacOSX-x64-2.2/Samples/Bin/OpenNI.ini'
   126034 VERBOSE    OpenNI 2.2.0 (Build 21)-MacOSX (May 29 2013 14:03:30)
   126038 VERBOSE    Using '/Users/George/Downloads/Grouped/Projects/code+libs/NiTE-MacOSX-x64-2.2/Samples/Bin/OpenNI2/Drivers' as driver path
   126042 VERBOSE    Looking for drivers in drivers repository '/Users/George/Downloads/Grouped/Projects/code+libs/NiTE-MacOSX-x64-2.2/Samples/Bin/OpenNI2/Drivers'
   161329 INFO       New log started on 2016-08-30 20:32:19
   161447 INFO       --- Filter Info --- Minimum Severity: VERBOSE
   161457 VERBOSE    Initializing USB...
   166761 INFO       USB is initialized.
   286714 INFO       New log started on 2016-08-30 20:32:19
   286762 INFO       --- Filter Info --- Minimum Severity: VERBOSE
   286781 VERBOSE    Initializing USB...
   286804 INFO       USB is initialized.
[Info] [Freenect2Impl] enumerating devices...
[Info] [Freenect2Impl] 7 usb devices connected
[Info] [Freenect2Impl] found valid Kinect v2 @20:16 with serial 500722542042
[Info] [Freenect2Impl] found 1 devices
  5380695 INFO       Found device freenect2://0
  5380723 INFO       Driver: register new uri: freenect2://0
  5381065 INFO       Device connected: Microsoft Kinect (freenect2://0)
  5381101 INFO       Device state changed: Microsoft Kinect (freenect2://0) to 0
  5381115 INFO       Driver: register new uri: freenect2://0?depth-size=640x480
  5381123 INFO       Device connected: Microsoft Kinect (freenect2://0?depth-size=640x480)
  5381132 INFO       Device state changed: Microsoft Kinect (freenect2://0?depth-size=640x480) to 0
  5381139 INFO       Driver: register new uri: freenect2://0?depth-size=512x424
  5381149 INFO       Device connected: Microsoft Kinect (freenect2://0?depth-size=512x424)
  5381157 INFO       Device state changed: Microsoft Kinect (freenect2://0?depth-size=512x424) to 0
[Info] [Freenect2Impl] enumerating devices...
[Info] [Freenect2Impl] 7 usb devices connected
[Info] [Freenect2Impl] found valid Kinect v2 @20:16 with serial 500722542042
[Info] [Freenect2Impl] found 1 devices
 10381916 VERBOSE    Trying to open device by URI '(NULL)'
 10381940 INFO       deiveOpen: freenect2://0
 10381948 INFO       Opening device freenect2://0
[Info] [Freenect2DeviceImpl] opening...
[Info] [Freenect2DeviceImpl] transfer pool sizes rgb: 20*16384 ir: 4*128*33792
[Info] [Freenect2DeviceImpl] opened
 12312037 VERBOSE    Initialize: Already initialized
 12314810 INFO       Device: createStream(depth)
 12314892 INFO       Freenect2Driver::Device: start()
[Info] [Freenect2DeviceImpl] starting...
[Info] [Freenect2DeviceImpl] submitting rgb transfers...
[Info] [Freenect2DeviceImpl] submitting depth transfers...
[Info] [Freenect2DeviceImpl] started
2016-08-30 20:32:31.847 UserViewer[7575:4995528] GLUT Warning: glutInit being called a second time.
[Info] [VTRgbPacketProcessor] avg. time: 19.633ms -> ~50.9346Hz
[Info] [VTRgbPacketProcessor] avg. time: 19.6306ms -> ~50.9408Hz
[Info] [VTRgbPacketProcessor] avg. time: 19.0744ms -> ~52.4262Hz
[Info] [DepthPacketStreamParser] 417 packets were lost
Segmentation fault: 11

我怎样才能解决这个问题?

1 个答案:

答案 0 :(得分:5)

以下是作为aswer的上述说明供参考。 这就是我用libfreenect2和它的OpenNI2驱动程序进行OpenNI2 / NITE2.2骨架跟踪的方法。我有:

  1. 根据github repo's readme instructions
  2. 通过自制程序编译已安装的OpenNI2并编译了具有OpenNI2支持的libfreenect2
  3. 已下载NITE2.2(替换之前我错过的Nite1.5)
  4. 将libfreenect2 OpenNI2驱动程序(ibfreenect2 / build / lib / libfreenect2-openni2.0.dylib)复制到我需要运行NITE2的/news/full/354985850 /film/full/74808409409 文件夹(例如Drivers)。
  5. 我通过在OpenNI.ini中将日志级别设置为详细来找出路径错误:

    NiTE-MacOSX-x64-2.2/Samples/Bin/OpenNI2/Drivers

    Symon Kaliski跟随笔记并使用Kinect 2 on OSX with skeleton tracking写了一篇精彩的OpenFrameworks帖子,请务必查看!

    OpenNI2 OpenFrameworks Skeleton tracking with Kinect v2

    此外,一旦使用openni2支持编译libfreenect2,它甚至可以在Processing中使用,只需删除[Log] ; 0 - Verbose; 1 - Info; 2 - Warning; 3 - Error. Default - None Verbosity=0 LogToConsole=1 LogToFile=1 [Device] ;Override="" [Drivers] ; Location of the drivers specified by a relative path based on OpenNI's shared library or an absolute path. ; Path separator "/" can be used to be portable for any platforms. ; Default - OpenNI2/Drivers Repository=OpenNI2/Drivers 中的libfreenect2-openni2.0.dylib(在OSX上):

    Kinect2 SimpleOpenNI Skeleton tracking