Question

如何在mongodb中存储火花流数据。

在java中这样做：

data.foreachRDD(
    new Function<JavaRDD<String>, Void>() {
        Mongo mongo = new Mongo("localhost", 27017);
        DB db = mongo.getDB("mongodb");

        DBCollection collection = db.getCollection("fb");

        public Void call(JavaRDD<String> data) throws Exception {
            if(data!=null){
                List<String>result=data.collect();    
                for (String temp :result) {
                    System.out.println(temp);   
                    DBObject dbObject = (DBObject)JSON.parse(temp.toString());
                    collection.insert(dbObject);
                }
                System.out.println("Inserted Data Done");
            } else {
                System.out.println("Got no data in this window");
            }
            return null;
        }     
    }   
);

我想在mongodb中存储数据但在scala中存储数据。上面的代码是在java。

Answer 1

//remove if not needed

import scala.collection.JavaConversions._

data.foreachRDD(new Function[JavaRDD[String], Void]() {

      var mongo: Mongo = new Mongo("localhost", 27017)

      var db: DB = mongo.getDB("mongodb")

      var collection: DBCollection = db.getCollection("fb")

      def call(data: JavaRDD[String]): Void = {
        if (data != null) {
          val result = data.collect()
          for (temp <- result) {
            println(temp)
            val dbObject = JSON.parse(temp.toString).asInstanceOf[DBObject]
            collection.insert(dbObject)
          }
          println("Inserted Data Done")
        } else {
          println("Got no data in this window")
        }
        null
      }
})

将Jim RDD存储在mongodb中

1 个答案: