如何将UIImage添加到AR Kit中的场景

时间:2018-05-16 13:21:24

标签: ios swift arkit

我有AR会话,它也添加了SCNText和3D对象。而现在,我想从Image Picker添加UIImage并且不知道如何做到这一点。有没有解决方案?

func insertImage(image: UIImage, width: CGFloat = 0.3, height: CGFloat = 0.3) -> SCNNode {
    let plane = SCNPlane(width: width, height: height)
    plane.firstMaterial!.diffuse.contents = image
    let node = SCNNode(geometry: plane)
    node.constraints = [SCNBillboardConstraint()]
    return node
}

let image = insertImage(image: addedImage)
node.addChildNode(image)

1 个答案:

答案 0 :(得分:1)

我确信你知道SCNGeometry有一个materials属性,只是:

  

用于材料视觉之一的颜色或纹理的容器   属性。

因此,您可以使用例如漫反射属性将UIImage渲染到SCNGeometry

这是一个完全正常运行且经过测试的示例。这会在5秒后加载UIImagePickerController,然后创建一个SCNNode,其SCNPlane Geometry的内容已设置为所选的UIImage

代码已完全注释,因此应该很容易理解:

//-------------------------------------
//MARK: UIImagePickerControllerDelegate
//-------------------------------------

extension ViewController: UIImagePickerControllerDelegate{

    func imagePickerController(_ picker: UIImagePickerController, didFinishPickingMediaWithInfo info: [String : Any]) {

        //1. Check We Have A Valid Image
        if let selectedImage = info[UIImagePickerControllerOriginalImage] as? UIImage {

            //2. We Havent Created Our PlaneNode So Create It
            if planeNode == nil{

                //d. Dismiss The Picker
                picker.dismiss(animated: true) {

                    //a. Create An SCNPlane Geometry
                    let planeGeometry = SCNPlane(width: 0.5, height: 0.5)

                    //b. Set's It's Contents To The Picked Image
                    planeGeometry.firstMaterial?.diffuse.contents = self.correctlyOrientated(selectedImage)

                    //c. Set The Geometry & Add It To The Scene
                    self.planeNode = SCNNode()
                    self.planeNode?.geometry = planeGeometry
                    self.augmentedRealityView.scene.rootNode.addChildNode(self.planeNode!)
                    self.planeNode?.position = SCNVector3(0, 0, -1.5)

                }
            }

        }

         picker.dismiss(animated: true, completion: nil)
    }

    func imagePickerControllerDidCancel(_ picker: UIImagePickerController) { picker.dismiss(animated: true, completion: nil) }

}

class ViewController: UIViewController, UINavigationControllerDelegate {

    //1. Create A Reference To Our ARSCNView In Our Storyboard Which Displays The Camera Feed
    @IBOutlet weak var augmentedRealityView: ARSCNView!

    //2. Create Our ARWorld Tracking Configuration & Session
    let configuration = ARWorldTrackingConfiguration()
    let augmentedRealitySession = ARSession()

    //3. Create A Reference To Our PlaneNode
    var planeNode: SCNNode?
    var planeGeomeryImage: UIImage?

    //---------------
    //MARK: LifeCycle
    //---------------

    override func viewDidLoad() {
        super.viewDidLoad()

        //1. Setup The Session
        setupARSession()

        //2. Show The UIImagePicker After 4 Seconds
        DispatchQueue.main.asyncAfter(deadline: .now() + 4) {
            self.selectPhotoFromGallery()
        }

    }

    override func didReceiveMemoryWarning()  { super.didReceiveMemoryWarning() }

    //-------------
    //MARK: ARSetup
    //-------------

    func setupARSession(){

        //1. Run Our Session
        augmentedRealityView.session = augmentedRealitySession
        augmentedRealitySession.run(configuration, options: [.resetTracking, .removeExistingAnchors])
    }

    //---------------------
    //MARK: Image Selection
    //---------------------

    /// Loads The UIImagePicker & Allows Us To Select An Image
    func  selectPhotoFromGallery(){

        if UIImagePickerController.isSourceTypeAvailable(UIImagePickerControllerSourceType.photoLibrary){
            let imagePicker = UIImagePickerController()
            imagePicker.delegate = self
            imagePicker.allowsEditing = true
            imagePicker.sourceType = UIImagePickerControllerSourceType.photoLibrary
            self.present(imagePicker, animated: true, completion: nil)
        }

    }


    /// Correctly Orientates A UIImage
    ///
    /// - Parameter image: UIImage
    /// - Returns: UIImage?
    func correctlyOrientated(_ image: UIImage) -> UIImage {
        if (image.imageOrientation == .up) { return image }

        UIGraphicsBeginImageContextWithOptions(image.size, false, image.scale)
        let rect = CGRect(x: 0, y: 0, width: image.size.width, height: image.size.height)
        image.draw(in: rect)

        let normalizedImage = UIGraphicsGetImageFromCurrentImageContext()!
        UIGraphicsEndImageContext()

        return normalizedImage
    }

}

不要忘记将NSPhotoLibraryUsageDescription添加到info.plist

<key>NSPhotoLibraryUsageDescription</key>
<string>For ARkit</string>

这应该足以让你开始......