pytest:将测试标记为“必须通过”,如果测试失败则停止测试

时间:2019-12-17 17:36:42

标签: python pytest

我正在尝试实现一个名为pytest的新@pytest.mark.must_pass标记,以指示如果标记的测试失败,则pytest应该跳过所有后续测试并终止。

如果标记的测试失败,我已经可以使用pytest_runtest_call钩子使pytest终止,但是我正在使用pytest.exit,它不打印回溯,也不显示失败有关测试的指示。

我需要将此失败显示为其他任何测试失败,除了pytest在打印出需要打印的内容以详细说明失败之后会停止测试。

到目前为止,我的代码:

# Copied this implementation from _pytest.runner
def pytest_runtest_call(item):
    _update_current_test_var(item, "call")
    try:
        del sys.last_type
        del sys.last_value
        del sys.last_traceback
    except AttributeError:
        pass
    try:
        item.runtest()
    except Exception:
        # Store trace info to allow postmortem debugging
        type, value, tb = sys.exc_info()
        assert tb is not None
        tb = tb.tb_next  # Skip *this* frame
        sys.last_type = type
        sys.last_value = value
        sys.last_traceback = tb
        del type, value, tb  # Get rid of these in this frame

        # If test is marked as must pass, stop testing here
        if item.iter_markers(name = "must_pass"):
            pytest.exit('Test marked as "must_pass" failed, terminating.')

        raise

在pytest中是否已经存在执行此操作的机制?

任何帮助将不胜感激。

谢谢。

2 个答案:

答案 0 :(得分:1)

因此,可以通过使用pytest_runtest_makereportpytest_runtest_setup

来实现

在您的conftest.py中,您应该放置以下内容:

import pytest


def pytest_runtest_makereport(item, call):
    if item.iter_markers(name='must_pass'):
        if call.excinfo is not None:
            parent = item.parent
            parent._mpfailed = item


def pytest_runtest_setup(item):
    must_pass_failed = getattr(item.parent, '_mpfailed', None)
    if must_pass_failed is not None:
        pytest.skip('must pass test failed (%s)' % must_pass_failed.name)

现在,当我们使用以下命令对其进行测试时:

import pytest


def foo(a, b):
    return a + b


def test_foo_1():
    assert foo(1, 1) == 2


@pytest.mark.must_pass
def test_foo_2():
    assert foo(2, 2) == 6


def test_foo_3():
    assert foo(3, 3) == 6


def test_foo_4():
    assert foo(4, 4) == 8

我们看到所需的输出:

     ▲ = pytest test.py 
=============================================================== test session starts ================================================================
platform darwin -- Python 3.6.5, pytest-4.6.2, py-1.8.0, pluggy-0.12.0
rootdir: /Users/foo/Desktop/testing, inifile: pytest.ini
plugins: cov-2.7.1
collected 4 items                                                                                                                                  

test.py .Fss                                                                                                                                 [100%]

===================================================================== FAILURES =====================================================================
____________________________________________________________________ test_foo_2 ____________________________________________________________________

    @pytest.mark.must_pass
    def test_foo_2():
>       assert foo(2, 2) == 6
E       assert 4 == 6
E        +  where 4 = foo(2, 2)

test.py:14: AssertionError
================================================== 1 failed, 1 passed, 2 skipped in 0.08 seconds ===================================================

答案 1 :(得分:0)

在接受的答案中粘贴代码会产生以下结果:

'must_pass' not found in `markers` configuration option

对于任何想要使用而不是实现的人来说,使用 pytest-dependency 也可以实现相同的目的:

  1. pip install pytest-dependency
  2. 有关用法,请参阅 this answer