Question

我正在使用视觉API进行人脸检测，现在我想实现眨眼但是当一只眼睛熄灭时，仍然可以检测眼睛。

请帮我解决如何实现眨眼功能。

Answer 1

脸部的“睁眼概率”值是检测眨眼的关键。此外，您可以使用追踪器跟踪眼睛状态，以检测指示闪烁的事件序列：

双眼睁开 - ＆gt;闭着双眼 - ＆gt;双眼睁开

以下是一个示例跟踪器：

public class BlinkTracker extends Tracker<Face> {
  private final float OPEN_THRESHOLD = 0.85;
  private final float CLOSE_THRESHOLD = 0.15;

  private int state = 0;

  public void onUpdate(Detector.Detections<Face> detections, Face face) {
    float left = face.getIsLeftEyeOpenProbability();
    float right = face.getIsRightEyeOpenProbability();
    if ((left == Face.UNCOMPUTED_PROBABILITY) ||
        (right == Face.UNCOMPUTED_PROBABILITY)) {
      // At least one of the eyes was not detected.
      return;
    }

    switch (state) {
      case 0:
        if ((left > OPEN_THRESHOLD) && (right > OPEN_THRESHOLD)) {
          // Both eyes are initially open
          state = 1;
        }
        break;

        case 1:
          if ((left < CLOSE_THRESHOLD) && (right < CLOSE_THRESHOLD)) {
            // Both eyes become closed
            state = 2;
          }
          break;

        case 2:
          if ((left > OPEN_THRESHOLD) && (right > OPEN_THRESHOLD)) {
            // Both eyes are open again
            Log.i("BlinkTracker", "blink occurred!");
            state = 0;
          }
        break;
    }
  }

}

请注意，您还需要启用“分类”，以便检测器指示眼睛是否打开/关闭：

FaceDetector detector = new FaceDetector.Builder(context)
    .setClassificationType(FaceDetector.ALL_CLASSIFICATIONS)
    .build();

然后将跟踪器添加为处理器，用于随时间从检测器接收面部更新。例如，此配置将用于跟踪视图中最大的面是否闪烁：

detector.setProcessor(
    new LargestFaceFocusingProcessor(detector, new BlinkTracker()));

或者，如果您有兴趣检测所有面（不仅是最大面）的闪烁，则可以使用MultiProcessor而不是LargestFaceFocusingProcessor。

Answer 2

此答案假设您已经拥有检测正在运行的面部的代码。

Face类有函数float getIsLeftEyeOpenProbability()和float getIsRightEyeOpenProbability()，你可以在每一帧上使用它们来查找其中一只眼睛是否眨眼，如果其中一个函数返回一个大值而另一个则返回一个较小的值。

可以找到Face课程的官方文档here

Answer 3

here是我使用FaceDetectorAPi（）的眼睛检测器应用程序的实现，其测试时的准确率超过90％

private double leftEyeOpenProbability = -1.0;
private double rightEyeOpenProbability = -1.0;

private boolean isEyeBlinked(){

    if(mFaces.size()==0)
        return false;

    Face face = mFaces.valueAt(0);
    float currentLeftEyeOpenProbability = face.getIsLeftEyeOpenProbability();
    float currentRightEyeOpenProbability = face.getIsRightEyeOpenProbability();
    if(currentLeftEyeOpenProbability== -1.0 || currentRightEyeOpenProbability == -1.0){
        return false;
    }

    if(leftEyeOpenProbability>0.9 || rightEyeOpenProbability > 0.9){
        boolean blinked = false;
        if(currentLeftEyeOpenProbability<0.6 || rightEyeOpenProbability< 0.6){
            blinked = true;
        }
        leftEyeOpenProbability = currentLeftEyeOpenProbability;
        rightEyeOpenProbability = currentRightEyeOpenProbability;
        return blinked;
    }else{
        leftEyeOpenProbability = currentLeftEyeOpenProbability;
        rightEyeOpenProbability = currentRightEyeOpenProbability;
        return false;
    }
}

使用Google Vision API检测眨眼

3 个答案: