我正在尝试模拟parquet
并断言使用正确的路径调用了它,但是无法正确模拟它。如何模拟option
函数以返回模拟的parquet
?
受测代码
def read_from_s3(spark, path):
return spark.read.option('mergeSchema', 'true').parquet(path)
测试
import unittest
import mock
from src.read_from_s3 import read_from_s3
class TestReadFromS3(unittest.TestCase):
def test_read_from_s3__called_with_correct_params(self):
spark = mock.MagicMock()
spark.read.option = mock.MagicMock()
spark.read.option.parquet = mock.MagicMock()
path = 'my_path'
read_from_s3(spark, path)
spark.read.option.assert_called_with('mergeSchema', 'true') # this passes
spark.read.option.parquet.assert_called_with(path) # this fails
测试失败
AssertionError: Expected 'parquet' to have been called once. Called 0 times.
答案 0 :(得分:1)
parquet
不是spark.read.option
的属性;它是option
的返回值的属性。此外,您无需显式创建模拟;而是可以创建模拟。模拟中的属性查找也会返回模拟。
def test_read_from_s3__called_with_correct_params(self):
spark = mock.MagicMock()
read_from_s3(spark, path)
spark.read.option.assert_called_with('mergeSchema', 'true')
spark.read.option.return_value.parquet.assert_called_with(path)