Question

我目前正在尝试为项目开发ArUco立方体探测器。目标是在不使用大型ArUco板的情况下进行更稳定和准确的姿态估计。然而，为了使其工作，我需要知道每个标记的方向。使用draw3dAxis方法，我发现X轴和Y轴并不始终出现在同一位置。以下是展示此问题的视频：https://youtu.be/gS7BWKm2nmg

Rvec检测似乎存在问题。 Rvec的前两个值有明显的变化，在轴交换之前将保持相当一致。当这个轴交换发生时，值可以在2-6之间变化。 ARuco库确实尝试处理旋转，如Marker.calculateMarkerId（）方法所示：

/**
 * Return the id read in the code inside a marker. Each marker is divided into 7x7 regions
 * of which the inner 5x5 contain info, the border should always be black. This function
 * assumes that the code has been extracted previously.
 * @return the id of the marker
 */
protected int calculateMarkerId(){
    // check all the rotations of code
    Code[] rotations = new Code[4];
    rotations[0] = code;
    int[] dists = new int[4];
    dists[0] = hammDist(rotations[0]);
    int[] minDist = {dists[0],0};
    for(int i=1;i<4;i++){
        // rotate
        rotations[i] = Code.rotate(rotations[i-1]);
        dists[i] = hammDist(rotations[i]);
        if(dists[i] < minDist[0]){
            minDist[0] = dists[i];
            minDist[1] = i;
        }
    }
    this.rotations = minDist[1];
    if(minDist[0] != 0){
        return -1; // matching id not found
    }
    else{
        this.id = mat2id(rotations[minDist[1]]);
    }
    return id;
}

并且MarkerDetector.detect（）会调用该方法并使用getRotations（）方法：

    // identify the markers
    for(int i=0;i<nCandidates;i++){
        if(toRemove.get(i) == 0){
            Marker marker = candidateMarkers.get(i);
            Mat canonicalMarker = new Mat();
            warp(in, canonicalMarker, new Size(50,50), marker.toList());
            marker.setMat(canonicalMarker);
            marker.extractCode();
            if(marker.checkBorder()){
                int id = marker.calculateMarkerId();
                if(id != -1){
                    // rotate the points of the marker so they are always in the same order no matter the camera orientation
                    Collections.rotate(marker.toList(), 4-marker.getRotations());

                    newMarkers.add(marker);

                }
            }
        }
    }

ArUco库的完整源代码位于：https://github.com/sidberg/aruco-android/blob/master/Aruco/src/es/ava/aruco/MarkerDetector.java

如果有人有任何建议或解决方案，我会非常亲切。如果您有任何疑问，请与我联系。

Answer 1

我确实发现了问题。事实证明，Marker Class有一个旋转变量，可用于旋转轴以与标记的方向对齐。我在Utils类中编写了以下方法：

protected static void alignToId(Mat rotation, int codeRotation) {
    //get the matrix corresponding to the rotation vector
    Mat R = new Mat(3, 3, CvType.CV_64FC1);
    Calib3d.Rodrigues(rotation, R);

    codeRotation += 1;
    //create the matrix to rotate around Z Axis
    double[] rot = {
            Math.cos(Math.toRadians(90) * codeRotation), -Math.sin(Math.toRadians(90) * codeRotation), 0,
            Math.sin(Math.toRadians(90) * codeRotation), Math.cos(Math.toRadians(90) * codeRotation), 0,
            0, 0, 1
    };

    // multiply both matrix
    Mat res = new Mat(3, 3, CvType.CV_64FC1);
    double[] prod = new double[9];
    double[] a = new double[9];
    R.get(0, 0, a);
    for (int i = 0; i < 3; i++)
        for (int j = 0; j < 3; j++) {
            prod[3 * i + j] = 0;
            for (int k = 0; k < 3; k++) {
                prod[3 * i + j] += a[3 * i + k] * rot[3 * k + j];
            }
        }
    // convert the matrix to a vector with rodrigues back
    res.put(0, 0, prod);
    Calib3d.Rodrigues(res, rotation);
}

我从Marker.calculateExtrinsics方法中调用它：

        Utils.alignToId(Rvec, this.getRotations());

ArUco Axis交换，同时绘制3dAxis

1 个答案: