如何确保将所有数据写入clojure的core.async通道中的文件?

时间:2016-01-19 05:14:32

标签: asynchronous clojure core.async

我对core.async很新,我一直试图了解如何最好地利用core.async和文件IO。虽然打印到控制台工作,但我已经将测试无法写入最后一个文件。知道我错过了什么吗?

首先,一些功能......

(defn thread-write-to-files [channel]
  (let [writer (atom nil)]
    (thread
      (loop []
        (when-some [value (<!! channel)]
          (if (and (map? value) (= :FILE (:type value)))
            (do (when @writer (.close ^Writer @writer))
                (reset! writer (io/writer (File. ^String (:name value))))
                (recur))
            (do (when @writer (.write @writer value)
                              (println value))
                (recur)))))
      (when @writer
        (do (.flush @writer)
            (.close ^Writer @writer))))))

(defn add-line-number [channel-in channel-out]
  (go-loop [line-number 1]
    (when-some [value (<! channel-in)]
      (if (and (map? value) (= :FILE (:type value)))
        (do (>! channel-out value)
            (recur 1))
        (do (>! channel-out (str line-number ". " value))
            (recur (inc line-number)))))))

现在是一个利用它们的测试...

(deftest test-thread-write-to-file
  (let [input-coll ["This gets skipped"
                   {:type :FILE :name "foo.txt"}
                   "This is the first line of foo!\n"
                   "This is the second line of foo.\n"
                   {:type :FILE :name "bar.txt"}
                   "Bar me 1.\n"
                   "Bar me 2.\n"
                   "Bar me 3.\n"
                   {:type :FILE :name "baz.txt"}
                   "BBBBBBBBBBB\n"
                   "AAAAAAAAAAA\n"
                   "ZZZZZZZZZZZ\n"]
        input-channel (async/to-chan input-coll)
        output-channel (chan)
        foo (File. "foo.txt")
        bar (File. "bar.txt")
        baz (File. "baz.txt")]
    (when (.exists foo) (.delete foo))
    (when (.exists bar) (.delete bar))
    (when (.exists baz) (.delete baz))
    (add-line-number input-channel output-channel)
    (thread-write-to-files output-channel)
    (Thread/sleep 1000)
    (is (.exists foo))
    (is (.exists bar))
    (is (.exists baz))
    (is (> (.length foo) 0))
    (is (> (.length bar) 0))
    (is (> (.length baz) 0))))

测试的最后一个条件失败了。文件baz.txt已创建,但为空。我的REPL从输入中打印出每一行,所以我很困惑为什么文件仍然是空的。

1 个答案:

答案 0 :(得分:1)

thread-write-to-files中,您在输入频道关闭时执行刷新并关闭最终文件 (当(when-some [value (<!! channel)] ...)获得nil并退出loop时)。
您的测试永远不会关闭频道,所以这不会发生。尝试在close!上使用output-channel,或者使用onto-chan代替to-chan将测试数据集合放入系统。