The pytest framework makes it easy to write small tests, yet scales to support complex functional testing

Overview
pytest
Code coverage Status pre-commit.ci status Documentation Status Discord Libera chat

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing for applications and libraries.

An example of a simple test:

# content of test_sample.py
def inc(x):
    return x + 1


def test_answer():
    assert inc(3) == 5

To execute it:

$ pytest
============================= test session starts =============================
collected 1 items

test_sample.py F

================================== FAILURES ===================================
_________________________________ test_answer _________________________________

    def test_answer():
>       assert inc(3) == 5
E       assert 4 == 5
E        +  where 4 = inc(3)

test_sample.py:5: AssertionError
========================== 1 failed in 0.04 seconds ===========================

Due to pytest's detailed assertion introspection, only plain assert statements are used. See getting-started for more examples.

Features

Documentation

For full documentation, including installation, tutorials and PDF documents, please see https://docs.pytest.org/en/stable/.

Bugs/Requests

Please use the GitHub issue tracker to submit bugs or request features.

Changelog

Consult the Changelog page for fixes and enhancements of each version.

Support pytest

Open Collective is an online funding platform for open and transparent communities. It provides tools to raise money and share your finances in full transparency.

It is the platform of choice for individuals and companies that want to make one-time or monthly donations directly to the project.

See more details in the pytest collective.

pytest for enterprise

Available as part of the Tidelift Subscription.

The maintainers of pytest and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use.

Learn more.

Security

pytest has never been associated with a security vulnerability, but in any case, to report a security vulnerability please use the Tidelift security contact. Tidelift will coordinate the fix and disclosure.

License

Copyright Holger Krekel and others, 2004-2021.

Distributed under the terms of the MIT license, pytest is free and open source software.

Comments
  • get rid of

    get rid of "ImportMismatchError"

    Over on the tox issue tracker, there was a discussion about the irritating "ImportMismatchError" that pytest throws if one collects from the source tree but the imports actually come from some installed location (e.g. some virtualenv). This happens more often with tox i guess because the default way of testing with tox is creating and installing a package and then collecting from the source tree.

    @jaraco and me agreed that it's probably best to try improve pytest so that it, say with pytest-4.0, will automatically redirect from source to install location. Initially and up until the next major release we could introduce a --collect-redirect-to-installed=yes option or so which works like this: if during collection we find a python package (a directory with an __init__.py for now) we check if importing it will actually get it from another location. If so, we redirect to the install location and also report this fact. Only problem is that with python3 one can have python packages without __init__.py files so the actual logic needs to take that into account as well (how many people are really using this, btw?).

    type: enhancement topic: collection type: feature-branch 
    opened by hpk42 82
  • RFC: parametrizing conditional raising with pytest.raises

    RFC: parametrizing conditional raising with pytest.raises

    Currently, parametrizing conditional raising of an exception is rather cumbersome. Consider this:

    def foo(inp):
        if inp:
            raise ValueError("Just a silly example")
    

    When we write a test for it, we need to repeat ourselves:

    @pytest.mark.parametrize('inp, raising', [(True, True), (False, False)])
    def test_foo(raising):
        if raising:
            with pytest.raises(ValueError):
               foo(inp)
        else:
            foo(inp)
    

    An easy way to solve this would be to add something like an activated argument to pytest.raises, where it simply does nothing:

    @pytest.mark.parametrize('inp, raising', [(True, True), (False, False)])
    def test_foo(inp, raising):
        with pytest.raises(FooError, activated=raising):
            foo(inp)
    

    But then sometimes, it's handy to parametrize the exception too - consider this:

    def bar(inp):
        if inp == 1:
            raise ValueError
        elif inp == 2:
            raise TypeError
        else:
            pass
    

    and the test:

    @pytest.mark.parametrize('inp, exception', [(1, ValueError), (2, TypeError),
                                                (3, None)])
    def test_bar(inp, exception):
        if exception is None:
            bar(inp)
        else:
            with pytest.raises(exception):
                bar(inp)
    

    So maybe we could just use None as a special value where pytest.raises does nothing?

    @pytest.mark.parametrize('inp, exception', [(1, ValueError), (2, TypeError),
                                                (3, None)])
    def test_bar(inp, exception):
        with pytest.raises(exception):
            bar(inp)
    

    Or if we're worried about None being accidentally used (though I'm not sure how?), we could use a special value, potentially pytest.raises.nothing or so :laughing:

    Opinions?

    type: enhancement type: proposal 
    opened by The-Compiler 71
  • Feedback about --import-mode=importlib in pytest 6.0

    Feedback about --import-mode=importlib in pytest 6.0

    This issue is a placeholder to gather feedback from users about the new --import-mode=importlib introduced in pytest 6.0.

    It is our intention to change the default to importlib in future versions, and perhaps even eliminate the other --import-mode options (prepend and append).

    topic: collection 
    opened by nicoddemus 56
  • Confusion between message and match parameters in pytest.raises

    Confusion between message and match parameters in pytest.raises

    After analyzing several code bases, it appears there is frequent confusion by users between the match and message parameters in pytest.raises (and consequentially pytest.warns).

    In most cases, users probably would want match but use message by accident, because is it visually similar and the naming does not differentiate their functionality enough. As a result the written test produces false positive which is quite dangerous.

    For instance, here are instances of such errors in popular open-source projects,

    • https://github.com/pandas-dev/pandas/pull/22681#discussion_r217181448
    • https://github.com/scipy/scipy/pull/9264
    • https://github.com/scikit-learn/scikit-learn/pull/12001

    the fact that these cases ended up in the code despite fairly thorough review is telling.

    There was also an earlier issue illustrating this confusion in https://github.com/pytest-dev/pytest/issues/3350

    Searching on github for "pytest.raises(ValueError, message=" for instance, also shows a number of examples that meant to use "match" instead of "message" (though sometimes it's hard to tell).

    One possibility could be to deprecate the message parameter and rename it to something more explicit. I saw there were some deprecations related to the use of node.warn in 3.8, not sure if that's related. However, following the same logic even if pytest.raises(ValueError('expected message')) worked it would still not address all the existing code that currently uses the message parameter incorrectly.


    EDIT by @nicoddemus

    The message parameter has been deprecated and will be removed in pytest 5.0, please see the docs for an alternative which provides the same functionality:

    https://docs.pytest.org/en/latest/deprecations.html#raises-message-deprecated

    type: backward compatibility type: deprecation 
    opened by rth 55
  • implement support for PEP-518 - the tool.pytest key in pyproject.toml

    implement support for PEP-518 - the tool.pytest key in pyproject.toml

    as per https://www.python.org/dev/peps/pep-0518/#specification

    the file has a section for tools using the pypi name for the tool,

    so this is the one file where we can properly and in a supported way put metadata

    i propose adding support asap and deprecating the other config files for the 3.x series so we can possibly remove support starting with the 4.x series

    type: enhancement type: proposal type: backward compatibility 
    opened by RonnyPfannschmidt 53
  • "Last Failed" mode no longer reruns all tests on successful run

    For about a month now (maybe less) our team is experiencing issues with the --last-failed mode. Since we regularly update our development dependencies there is a chance that it might be due to an issue in pytest. Unfortunately I don't have an example to reproduce the issue.

    I will try downgrading to pytest 4.4 and see if this fixes the issue. If I don't forget it, I will update this issue if that's the case.

    When using "last-failed" mode we expect the following behaviour:

    • As long as there are failures, only run the failed tests on each run
    • The run following the first run without any failures should re-run all tests

    What we observe instead:

    • As long as there are failures, only run the failed tests on each run
    • The run following the first run without any failures only some tests are re-run. Only a fraction of tests are executed.

    Workaround:

    • Running pytest once without --last-failed solves the issue (but only once).

    pip list output

    Package                       Version  Location
    ----------------------------- -------- ------------------------------
    alabaster                     0.7.12
    apipkg                        1.5
    asn1crypto                    0.24.0
    astroid                       2.2.5
    atomicwrites                  1.3.0
    attr                          0.3.1
    attrs                         19.1.0
    autopep8                      1.4.4
    Babel                         2.6.0
    bboss                         1.10.1
    bcrypt                        3.1.6
    certifi                       2019.3.9
    cffi                          1.12.3
    chardet                       3.0.4
    colorama                      0.4.1
    commonmark                    0.9.0
    config-resolver               4.3.4
    coverage                      4.5.3
    cryptography                  2.6.1
    distribute                    0.7.3
    docutils                      0.14
    entrypoints                   0.3
    execnet                       1.6.0
    flake8                        3.7.7
    flake8-polyfill               1.0.2
    future                        0.17.1
    gouge                         1.3.0
    idna                          2.8
    imagesize                     1.1.0
    isort                         4.3.20
    jargon                        4.14.0
    Jinja2                        2.10.1
    lazy-object-proxy             1.4.1
    mando                         0.6.4
    MarkupSafe                    1.1.1
    mccabe                        0.6.1
    more-itertools                7.0.0
    msgpack-python                0.5.6
    mypy                          0.701
    mypy-extensions               0.4.1
    packaging                     19.0
    paramiko                      2.4.2
    pathlib2                      2.3.3
    pexpect                       3.3
    pip                           19.1.1
    pkg-resources                 0.0.0
    pluggy                        0.11.0
    puresnmp                      1.5.1
    py                            1.8.0
    pyasn1                        0.4.5
    pycodestyle                   2.5.0
    pycparser                     2.19
    pyflakes                      2.1.1
    Pygments                      2.4.0
    pylint                        2.3.1
    PyNaCl                        1.3.0
    pynet                         3.11.0   /home/users/malbert/work/pynet
    pyparsing                     2.4.0
    pytest                        4.5.0
    pytest-cov                    2.7.1
    pytest-cover                  3.0.0
    pytest-coverage               0.0
    pytest-forked                 1.0.2
    pytest-xdist                  1.28.0
    python-dateutil               2.8.0
    pytz                          2019.1
    PyYAML                        3.13
    radon                         3.0.3
    recommonmark                  0.5.0
    requests                      2.22.0
    schema                        5.2.3
    setuptools                    41.0.1
    six                           1.12.0
    snowballstemmer               1.2.1
    Sphinx                        2.0.1
    sphinx-rtd-theme              0.4.3
    sphinxcontrib-applehelp       1.0.1
    sphinxcontrib-devhelp         1.0.1
    sphinxcontrib-htmlhelp        1.0.2
    sphinxcontrib-jsmath          1.0.1
    sphinxcontrib-qthelp          1.0.2
    sphinxcontrib-serializinghtml 1.1.3
    typed-ast                     1.3.5
    typing                        3.6.6
    urllib3                       1.25.2
    verlib                        0.1
    wcwidth                       0.1.7
    wheel                         0.33.4
    wrapt                         1.11.1
    

    OS Information

    Linux BBS-nexus.ipsw.dt.ept.lu 4.4.0-57-generic #78-Ubuntu SMP Fri Dec 9 23:50:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
    
    DISTRIB_ID=Ubuntu
    DISTRIB_RELEASE=16.04
    DISTRIB_CODENAME=xenial
    DISTRIB_DESCRIPTION="Ubuntu 16.04.1 LTS"
    
    Python 3.5.2
    
    type: bug plugin: cache type: regression 
    opened by exhuma 51
  • Support for static typing

    Support for static typing

    Is there any plan to add static type hints to the Pytest code base, or to support/bless a typeshed implementation? Or is this already solved and my Google skills have failed me?

    type: enhancement topic: typing 
    opened by markedwards 50
  • setup_* executed before all fixtures

    setup_* executed before all fixtures

    Originally reported by: Haak Saxberg (BitBucket: haaksmash, GitHub: haaksmash)


    consider the following dummy test file:

    #!python
    
    import pytest
    
    @pytest.yield_fixture(scope="session", autouse=True)
    def print_session():
        print "session fixture"
        yield
        print "session teardown"
    
    
    class TestClass(object):
    
        def setup_method(self, method):
            print "method setup"
    
        def teardown_method(self, method):
            print "method teardown"
    
        def test_printer(self):
            print "test method"
    

    pytest --capture=no test_file.py will generate the following output:

    #!bash
    
    ==================== test session starts ====================
    platform darwin -- Python 2.7.5 -- py-1.4.20 -- pytest-2.5.2
    collected 1 items
    
    tests/test_ordering.py method setup
    session fixture
    test method
    .method teardown
    session teardown
    
    
    ================= 1 passed in 0.01 seconds =================
    

    it looks like all setup_* methods are invoked before any fixtures are processed, but the teardown_* methods are called in the order you'd expect:

    • method_fixture post-yield
    • method_teardown
    • class_fixture post-yield
    • class_teardown
    • module_fixture post-yield
    • module_teardown

    etc, etc.

    that doesn't seem right, especially since the teardowns are in the correct order. In fact it's pretty bad, because you might (I would think rightly) depend on the session having been set up already in your setup_method.


    • Bitbucket: https://bitbucket.org/pytest-dev/pytest/issue/517
    type: bug plugin: unittest topic: fixtures 
    opened by pytestbot 50
  • pip install pytest fails - Mo matching found for py>=1.5.0 for python3.3

    pip install pytest fails - Mo matching found for py>=1.5.0 for python3.3

    I'm using a tox environment and all of its tests pass in Python 2.7,3.4-6 except for in Python 3.3. It just started happening last night and persisted into this morning, both on my Linux environment locally and also remotely

    Here is the log for when I try to run

    python3.3 -m pip install pytest
    
    Collecting pytest
      Using cached pytest-3.3.0-py2.py3-none-any.whl
    Requirement already satisfied: setuptools in /usr/local/lib/python3.3/dist-packages (from pytest)
    Collecting attrs>=17.2.0 (from pytest)
      Using cached attrs-17.3.0-py2.py3-none-any.whl
    Collecting pluggy<0.7,>=0.5 (from pytest)
      Downloading pluggy-0.5.2.tar.gz
    Collecting py>=1.5.0 (from pytest)
      Could not find a version that satisfies the requirement py>=1.5.0 (from pytest) (from versions: 0.9.1, 0.9.2, 1.0.0, 1.0.1, 1.0.2, 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.3.0, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7.dev3, 1.4.7, 1.4.8, 1.4.9, 1.4.10, 1.4.11, 1.4.12, 1.4.13, 1.4.14, 1.4.15, 1.4.16, 1.4.17, 1.4.18, 1.4.19, 1.4.20, 1.4.21, 1.4.22, 1.4.23, 1.4.24, 1.4.25, 1.4.26, 1.4.27, 1.4.28, 1.4.29, 1.4.30, 1.4.31, 1.4.32, 1.4.33, 1.4.34)
    No matching distribution found for py>=1.5.0 (from pytest)
    

    Here's a report of the failing test remotely: https://travis-ci.org/ColinKennedy/ways/jobs/308277578 That Travis-CI link refers to a log with more output. This pastebin link is that log: https://pastebin.com/rk8EUq0E

    OS: Ubuntu 16.04.2 LTS

    I have a feeling this is simple user error on my part but it's hard to tell since I wiped my environment and am still getting the same error, locally and remotely. Any help would be greatly appreciated

    type: bug type: infrastructure 
    opened by ColinKennedy 49
  • py.test assert rewriting broken with Python 3.5a4+

    py.test assert rewriting broken with Python 3.5a4+

    Originally reported by: BitBucket: gvanrossum, GitHub: gvanrossum


    I am experiencing a traceback ending thus:

    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:137: in find_module
        source_stat, co = _rewrite_test(state, fn_pypath)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:278: in _rewrite_test
        rewrite_asserts(tree)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:336: in rewrite_asserts
        AssertionRewriter().run(mod)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:550: in run
        new.extend(self.visit(child))
    /usr/local/lib/python3.5/ast.py:245: in visit
        return visitor(node)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:658: in visit_Assert
        top_condition, explanation = self.visit(assert_.test)
    /usr/local/lib/python3.5/ast.py:245: in visit
        return visitor(node)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:789: in visit_Compare
        left_res, left_expl = self.visit(comp.left)
    /usr/local/lib/python3.5/ast.py:245: in visit
        return visitor(node)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:640: in generic_visit
        return res, self.explanation_param(self.display(res))
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:577: in display
        return self.helper("saferepr", expr)
    /usr/local/lib/python3.5/site-packages/_pytest/assertion/rewrite.py:583: in helper
        return ast.Call(attr, list(args), [], None, None)
    E   TypeError: Call constructor takes either 0 or 3 positional arguments
    

    I get this as soon as I have an assert statement in my test (even assert True).


    • Bitbucket: https://bitbucket.org/pytest-dev/pytest/issue/744
    type: bug 
    opened by pytestbot 49
  • pytest 5.3.3: slow or crashing tests

    pytest 5.3.3: slow or crashing tests

    tl;dr: If your tests are slow or break on pytest 5.3.3, please pin pytest==5.3.2 until this is resolved. A change to fixture handling seems incompatible with at least pytest-django, but also some non-Django projects.

    A change in 99180939febb6ca4b3ff788cf336b065046653f2 (part of the 5.3.3 release) led to an incompatibility regarding fixture handling/cleanup. It seems fixtures are not correctly recycled/collected, so they persist in unintended ways.

    Original report with plenty of unimportant details inside:

    I'm testing a Django project with pytest, pytest-xdist, pytest-django, and tox as runner. As of the latest pytest release ~2 hours ago, 5.3.3, I'm seeing the weirdest test failures.

    The errors can be seen here:

    django.core.exceptions.ImproperlyConfigured: The database name 'test_travis_ci_test_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0' (71 characters) is longer than PostgreSQL's limit of 63 characters. Supply a shorter NAME in settings.DATABASES.
    ---------------------------- Captured stderr setup -----------------------------
    Got an error creating the test database: database "test_travis_ci_test_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0_gw0" already exists
    

    or using MySQL:

    ---------------------------------------------------------------------------------------------- Captured stderr setup ----------------------------------------------------------------------------------------------
    Got an error creating the test database: (1102, "Incorrect database name 'test_pretalx_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7_gw7'")
    
    

    The database name is supposedly generated by pytest-xdist, which is running on gw0 and gw1 in this Travis runner.

    From my local debugging: It appears that initally, pytest-xdist will create databases called "test_pretalx_gw0" and so on, but then I see those disappear and be replaced by "test_pretalx_gw0_gw0", then "test_pretalx_gw0_gw0_gw0", and so on, while the tests are running. They aren't all replaced at the same time, and not for each test, but (I think) each time each thread opens a new module/test file.

    I'm not sure if the fault rests with pytest, or pytest-xdist, or pytest-django, but it's only present as of the 5.3.3. bugfix release, with 5.3.2 running as intended (and significantly faster, at that). I'm reporting this here in hopes of help, and because while the error implies that the problem lies with either pytest-xdist or pytest-django, the change was definitely introduced on the side of pytest itself.

    I'm happy to provide more details or debugging.

    type: bug status: needs information topic: fixtures 
    opened by rixx 46
  • How to force pytest to read options from commandline only, and ignore config files?

    How to force pytest to read options from commandline only, and ignore config files?

    What's the problem this feature will solve?

    Suppose the pytest config file pyproject.toml is in the project directory:

    [tool.pytest.ini_options]
    addopts = "-rap --capture=tee-sys"
    

    I usually use the options in this file when running the command pytest. And the options are automatically read from the file.

    However, sometimes I want to run pytest with -rA only:

    pytest -rA    # it becomes: pytest -rA --capture=tee-sys
    

    I have to run it with: pytest -rA --capture=fd to override the option --capture=tee-sys in the config file.

    Is there any way to force pytest to read options from commandline only?

    What I've tried:

    In @Andrei 's answer of this question: https://stackoverflow.com/questions/32444402/is-there-an-option-for-pytest-to-ignore-the-setup-cfg-file

    Use -c /dev/null will prevent pytest from finding the config file. I also find that set -c any-non-exist-path is ok.

    However, I'm afraid if -c /dev/null has side effects. In pytest docs (https://docs.pytest.org/en/latest/reference/customize.html#finding-the-rootdir), it says If -c is passed in the command-line, use that as configuration file, and its directory as rootdir. I don't know what will happen if rootdir is set as a non exist dir.

    Describe the solution you'd like

    Add an option in pytest commandline to prevent loading options from config files.

    Alternative Solutions

    Additional context

    opened by jhj0411jhj 0
  • unexpected indirect parameterisation

    unexpected indirect parameterisation

    I would not expect this to work but it does. I would expect it to fail as fixture c is trying to use fixtures d + e that are not defined. I can see pytest creates the missing fixtures using factory _pytest.fixtures.FixtureDef. Is this undocumented functionality that's going to be introduced in later? I'd vote for it, seems like a nice syntax.

    python 3.7.3, pytest 7.0.0

    import pytest
    
    
    @pytest.fixture
    def c(d, e):
        return d + e
    
    
    @pytest.mark.parametrize(argnames='d, e', argvalues=[(0, 2), (1, 3)])
    def test_1(c, d, e):
        assert c == d + e
    
    opened by paulolsson 0
  • XFail and XPass output does not get printed to console

    XFail and XPass output does not get printed to console

    I don't see any output on the console when I run tests marked XFail or XPass. In fact, these tests only show up in the summaries, not in the PASSES nor the FAILURES section, where I would expect to see them. This would seem to be a fairly serious oversight, since testers certainly want to see the output of their tests that have been marked as such. Am I missing something?

    Now, if I specify 'live logs' on the command line, I get my expected output, but only live; not captured. Given that a lot of pytest users probably don't know about this option, wouldn't it make sense to print the stdout/stderr/stdlog to console by default when processing XFail and XPass cases?

    Thanks, Jeff

    Example console outputs:

    $ pytest -rAR -k test_single
    ========================================= test session starts =========================================
    platform darwin -- Python 3.9.9, pytest-7.2.0, pluggy-1.0.0
    rootdir: /Users/jwr003/coding/pytest-tui, configfile: pytest.ini
    plugins: rerunfailures-10.3, metrics-0.4, assume-2.4.3, html-3.2.0, typhoon-xray-0.4.7,
    json-report-1.5.0, Faker-13.15.0, adaptavist-5.8.0, session2file-0.1.11, allure-pytest-2.12.0,
    jira-xray-0.8.2, reportportal-5.1.3, pylama-8.4.1, reportlog-0.1.2, metadata-2.0.2, tui-1.6.0
    
    collected 78 items / 76 deselected / 2 selected
    
    demo-tests/test_single_xpass_xfail.py xX                                                        [100%]
    
    ======================================= short test summary info =======================================
    XFAIL demo-tests/test_single_xpass_xfail.py::test0_xfail
    XPASS demo-tests/test_single_xpass_xfail.py::test0_xpass
    ============================ 76 deselected, 1 xfailed, 1 xpassed in 1.27s =============================
    
    $ pytest --log-cli-level=DEBUG -rAR -k test_single
    ========================================= test session starts =========================================
    platform darwin -- Python 3.9.9, pytest-7.2.0, pluggy-1.0.0
    rootdir: /Users/jwr003/coding/pytest-tui, configfile: pytest.ini
    plugins: rerunfailures-10.3, metrics-0.4, assume-2.4.3, html-3.2.0, typhoon-xray-0.4.7,
    json-report-1.5.0, Faker-13.15.0, adaptavist-5.8.0, session2file-0.1.11, allure-pytest-2.12.0,
    jira-xray-0.8.2, reportportal-5.1.3, pylama-8.4.1, reportlog-0.1.2, metadata-2.0.2, tui-1.6.0
    
    collected 78 items / 76 deselected / 2 selected
    
    demo-tests/test_single_xpass_xfail.py::test0_xfail
    -------------------------------------------- live log call --------------------------------------------
    CRITICAL root:test_single_xpass_xfail.py:10 CRITICAL
    ERROR    root:test_single_xpass_xfail.py:11 ERROR
    WARNING  root:test_single_xpass_xfail.py:12 WARNING
    INFO     root:test_single_xpass_xfail.py:13 INFO
    DEBUG    root:test_single_xpass_xfail.py:14 DEBUG
    XFAIL                                                                                           [ 50%]
    demo-tests/test_single_xpass_xfail.py::test0_xpass
    -------------------------------------------- live log call --------------------------------------------
    CRITICAL root:test_single_xpass_xfail.py:21 CRITICAL
    ERROR    root:test_single_xpass_xfail.py:22 ERROR
    WARNING  root:test_single_xpass_xfail.py:23 WARNING
    INFO     root:test_single_xpass_xfail.py:24 INFO
    DEBUG    root:test_single_xpass_xfail.py:25 DEBUG
    XPASS                                                                                           [100%]
    
    ======================================= short test summary info =======================================
    XFAIL demo-tests/test_single_xpass_xfail.py::test0_xfail
    XPASS demo-tests/test_single_xpass_xfail.py::test0_xpass
    ============================ 76 deselected, 1 xfailed, 1 xpassed in 1.02s =============================
    

    Test file:

    import logging
    import pytest
    
    logger = logging.getLogger()
    
    
    @pytest.mark.xfail()
    def test0_xfail():
        print("Test 0 XFail")
        logger.critical("CRITICAL")
        logger.error("ERROR")
        logger.warning("WARNING")
        logger.info("INFO")
        logger.debug("DEBUG")
        assert False
    
    
    @pytest.mark.xfail()
    def test0_xpass():
        print("Test 0 XPass")
        logger.critical("CRITICAL")
        logger.error("ERROR")
        logger.warning("WARNING")
        logger.info("INFO")
        logger.debug("DEBUG")
        assert True
    
    opened by jeffwright13 2
  • Add more powerful set assertion rewrites for comparisons other than equality `==` (eg: `<=`, etc.)

    Add more powerful set assertion rewrites for comparisons other than equality `==` (eg: `<=`, etc.)

    What's the problem this feature will solve?

    Set comparisons that do not check for pure equality do not have nice assertion rewriting.

    Examples:

    # Set equality assertion message is nice! 👍
    >       assert {1, 2, 3} == {1, 2, 4}
    E       assert {1, 2, 3} == {1, 2, 4}
    E         Extra items in the left set:
    E         3
    E         Extra items in the right set:
    E         4
    E         Use -v to get more diff
    
    # But others are not nice... 👎
    # inequality
    >       assert {1, 2, 3} != {1, 2, 3}
    E       assert {1, 2, 3} != {1, 2, 3}
    
    # proper subset
    >       assert {1, 2, 3} < {1, 2, 3}
    E       assert {1, 2, 3} < {1, 2, 3}
    
    # proper superset
    >       assert {1, 2, 3} > {1, 2, 3}
    E       assert {1, 2, 3} > {1, 2, 3}
    
    # superset
    >       assert {1, 2, 3} >= {1, 2, 4}
    E       assert {1, 2, 3} >= {1, 2, 4}
    
    # subset
    >       assert {1, 2, 3} <= {1, 2, 4}
    E       assert {1, 2, 3} <= {1, 2, 4}
    

    Describe the solution you'd like

    When asserting sets are unequal, such as set_a <= set_b, the assertion text should be more intelligent only displaying the values that fail the check.

    This might look like:

    # inequality
    >       assert {1, 2, 3} != {1, 2, 3}
    E       assert {1, 2, 3} != {1, 2, 3}
    E         Sets are equal
    
    # proper subset
    >       assert {1, 2, 3} < {1, 2, 3}
    E       assert {1, 2, 3} < {1, 2, 3}
    E         Sets are equal
    
    # proper superset
    >       assert {1, 2, 3} > {1, 2, 3}
    E       assert {1, 2, 3} > {1, 2, 3}
    E         Sets are equal
    
    # superset
    >       assert {1, 2, 3} >= {1, 2, 4}
    E       assert {1, 2, 3} >= {1, 2, 4}
    E         Extra items in the right set:
    E         4
    E         Use -v to get more diff
    
    # subset
    >       assert {1, 2, 3} <= {1, 2, 4}
    E       assert {1, 2, 3} <= {1, 2, 4}
    E         Extra items in the left set:
    E         3
    E         Use -v to get more diff
    

    Alternative Solutions

    I'm not aware of any plugins or other tools that implement this, but I have creating my own using pytest_assertrepr_compare:

    def pytest_assertrepr_compare(op, left, right):
        if isinstance(left, set) and isinstance(right, set) and op == "!=":
            return [
                f"{left} {op} {right}",  # N.B.: I know this isn't the _actual_ way to do this, but it's good enough for the example!
                "Sets are equal"
            ]
        if isinstance(left, set) and isinstance(right, set) and op == "<=":
            extra = map(str, left - right)
            return [
                f"{left} {op} {right}",
                "Extra items in left set:",
                *extra,
            ]
        if isinstance(left, set) and isinstance(right, set) and op == "<":
            if left == right:
                return [
                    f"{left} {op} {right}",
                    "Sets are equal"
                ]
            extra = map(str, left - right)
            return [
                f"{left} {op} {right}",
                "Extra items in left set:",
                *extra,
            ]
        if isinstance(left, set) and isinstance(right, set) and op == ">=":
            extra = map(str, right - left)
            return [
                f"{left} {op} {right}",
                "Extra items in right set:",
                *extra,
            ]
        if isinstance(left, set) and isinstance(right, set) and op == ">":
            if left == right:
                return [
                    f"{left} {op} {right}",
                    " Sets are equal",
                ]
            extra = map(str, right - left)
            return [
                f"{left} {op} {right}",
                "Extra items in right set:",
                *extra,
            ]
    

    We then get the following:

    $ pytest pytest_set_assertion.py 
    ======================================== test session starts =========================================
    platform linux -- Python 3.9.13, pytest-7.2.0, pluggy-1.0.0
    rootdir: /usr/local/google/home/dthor/dev/pytest_set_assertrepr
    collected 8 items                                                                                    
    
    pytest_set_assertion.py FFFFFFFF                                                               [100%]
    
    ============================================== FAILURES ==============================================
    ___________________________________________ test_equality ____________________________________________
    
        def test_equality():
    >       assert {1, 2, 3} == {1, 2, 4, 5}
    E       assert {1, 2, 3} == {1, 2, 4, 5}
    E         Extra items in the left set:
    E         3
    E         Extra items in the right set:
    E         4
    E         5
    E         Use -v to get more diff
    
    pytest_set_assertion.py:2: AssertionError
    __________________________________________ test_inequality ___________________________________________
    
        def test_inequality():
    >       assert {1, 2, 3} != {1, 2, 3}
    E       assert {1, 2, 3} != {1, 2, 3}
    E         Sets are equal
    
    pytest_set_assertion.py:6: AssertionError
    ____________________________________________ test_subset _____________________________________________
    
        def test_subset():
    >       assert {1, 2, 3} <= {1, 2, 4}
    E       assert {1, 2, 3} <= {1, 2, 4}
    E         Extra items in left set:
    E         3
    
    pytest_set_assertion.py:10: AssertionError
    _________________________________________ test_proper_subset _________________________________________
    
        def test_proper_subset():
    >       assert {1, 2, 3} < {1, 2, 4}
    E       assert {1, 2, 3} < {1, 2, 4}
    E         Extra items in left set:
    E         3
    
    pytest_set_assertion.py:14: AssertionError
    ___________________________________ test_proper_subset_equal_sets ____________________________________
    
        def test_proper_subset_equal_sets():
    >       assert {1, 2, 3} < {1, 2, 3}
    E       assert {1, 2, 3} < {1, 2, 3}
    E         Sets are equal
    
    pytest_set_assertion.py:18: AssertionError
    ___________________________________________ test_superset ____________________________________________
    
        def test_superset():
    >       assert {1, 2, 3} >= {1, 2, 4}
    E       assert {1, 2, 3} >= {1, 2, 4}
    E         Extra items in right set:
    E         4
    
    pytest_set_assertion.py:22: AssertionError
    ________________________________________ test_proper_superset ________________________________________
    
        def test_proper_superset():
    >       assert {1, 2, 3} > {1, 2, 4}
    E       assert {1, 2, 3} > {1, 2, 4}
    E         Extra items in right set:
    E         4
    
    pytest_set_assertion.py:26: AssertionError
    __________________________________ test_proper_superset_equal_sets ___________________________________
    
        def test_proper_superset_equal_sets():
    >       assert {1, 2, 3} > {1, 2, 3}
    E       assert {1, 2, 3} > {1, 2, 3}
    E          Sets are equal
    
    pytest_set_assertion.py:30: AssertionError
    ====================================== short test summary info =======================================
    FAILED pytest_set_assertion.py::test_equality - assert {1, 2, 3} == {1, 2, 4, 5}
    FAILED pytest_set_assertion.py::test_inequality - assert {1, 2, 3} != {1, 2, 3}
    FAILED pytest_set_assertion.py::test_subset - assert {1, 2, 3} <= {1, 2, 4}
    FAILED pytest_set_assertion.py::test_proper_subset - assert {1, 2, 3} < {1, 2, 4}
    FAILED pytest_set_assertion.py::test_proper_subset_equal_sets - assert {1, 2, 3} < {1, 2, 3}
    FAILED pytest_set_assertion.py::test_superset - assert {1, 2, 3} >= {1, 2, 4}
    FAILED pytest_set_assertion.py::test_proper_superset - assert {1, 2, 3} > {1, 2, 4}
    FAILED pytest_set_assertion.py::test_proper_superset_equal_sets - assert {1, 2, 3} > {1, 2, 3}
    ========================================= 8 failed in 0.06s ==========================================
    

    Additional context

    • Python 3.9.13 on Debian
    • pytest 7.2.0
    opened by dougthor42 0
  • Implement pylib shim using importlib

    Implement pylib shim using importlib

    Now pylib shim shouldn't override real pylib, even if the path where real pylib is installed has lower precedence than pytest's install location.

    py package becomes available only after pytest is imported for the first time. Maybe this change could break some code that tries to import py.path or py.error outside of the test suite or pytest plugin (and doesn't depend on a "real" pylib).

    Fixes #10451

    opened by amezin 1
Releases(7.2.0)
  • 7.2.0(Oct 25, 2022)

    pytest 7.2.0 (2022-10-23)

    Deprecations

    • #10012: Update pytest.PytestUnhandledCoroutineWarning{.interpreted-text role="class"} to a deprecation; it will raise an error in pytest 8.

    • #10396: pytest no longer depends on the py library. pytest provides a vendored copy of py.error and py.path modules but will use the py library if it is installed. If you need other py.* modules, continue to install the deprecated py library separately, otherwise it can usually be removed as a dependency.

    • #4562: Deprecate configuring hook specs/impls using attributes/marks.

      Instead use :pypytest.hookimpl{.interpreted-text role="func"} and :pypytest.hookspec{.interpreted-text role="func"}. For more details, see the docs <legacy-path-hooks-deprecated>{.interpreted-text role="ref"}.

    • #9886: The functionality for running tests written for nose has been officially deprecated.

      This includes:

      • Plain setup and teardown functions and methods: this might catch users by surprise, as setup() and teardown() are not pytest idioms, but part of the nose support.
      • Setup/teardown using the @with_setup decorator.

      For more details, consult the deprecation docs <nose-deprecation>{.interpreted-text role="ref"}.

    Features

    • #9897: Added shell-style wildcard support to testpaths.

    Improvements

    • #10218: @pytest.mark.parametrize() (and similar functions) now accepts any Sequence[str] for the argument names, instead of just list[str] and tuple[str, ...].

      (Note that str, which is itself a Sequence[str], is still treated as a comma-delimited name list, as before).

    • #10381: The --no-showlocals flag has been added. This can be passed directly to tests to override --showlocals declared through addopts.

    • #3426: Assertion failures with strings in NFC and NFD forms that normalize to the same string now have a dedicated error message detailing the issue, and their utf-8 representation is expresed instead.

    • #7337: A warning is now emitted if a test function returns something other than [None]{.title-ref}. This prevents a common mistake among beginners that expect that returning a [bool]{.title-ref} (for example [return foo(a, b) == result]{.title-ref}) would cause a test to pass or fail, instead of using [assert]{.title-ref}.

    • #8508: Introduce multiline display for warning matching via :pypytest.warns{.interpreted-text role="func"} and enhance match comparison for :py_pytest._code.ExceptionInfo.match{.interpreted-text role="func"} as returned by :pypytest.raises{.interpreted-text role="func"}.

    • #8646: Improve :pypytest.raises{.interpreted-text role="func"}. Previously passing an empty tuple would give a confusing error. We now raise immediately with a more helpful message.

    • #9741: On Python 3.11, use the standard library's tomllib{.interpreted-text role="mod"} to parse TOML.

      tomli{.interpreted-text role="mod"}` is no longer a dependency on Python 3.11.

    • #9742: Display assertion message without escaped newline characters with -vv.

    • #9823: Improved error message that is shown when no collector is found for a given file.

    • #9873: Some coloring has been added to the short test summary.

    • #9883: Normalize the help description of all command-line options.

    • #9920: Display full crash messages in short test summary info, when runng in a CI environment.

    • #9987: Added support for hidden configuration file by allowing .pytest.ini as an alternative to pytest.ini.

    Bug Fixes

    • #10150: sys.stdin{.interpreted-text role="data"} now contains all expected methods of a file-like object when capture is enabled.

    • #10382: Do not break into pdb when raise unittest.SkipTest() appears top-level in a file.

    • #7792: Marks are now inherited according to the full MRO in test classes. Previously, if a test class inherited from two or more classes, only marks from the first super-class would apply.

      When inheriting marks from super-classes, marks from the sub-classes are now ordered before marks from the super-classes, in MRO order. Previously it was the reverse.

      When inheriting marks from super-classes, the [pytestmark]{.title-ref} attribute of the sub-class now only contains the marks directly applied to it. Previously, it also contained marks from its super-classes. Please note that this attribute should not normally be accessed directly; use pytest.Node.iter_markers{.interpreted-text role="func"} instead.

    • #9159: Showing inner exceptions by forcing native display in ExceptionGroups even when using display options other than --tb=native. A temporary step before full implementation of pytest-native display for inner exceptions in ExceptionGroups.

    • #9877: Ensure caplog.get_records(when) returns current/correct data after invoking caplog.clear().

    Improved Documentation

    • #10344: Update information on writing plugins to use pyproject.toml instead of setup.py.
    • #9248: The documentation is now built using Sphinx 5.x (up from 3.x previously).
    • #9291: Update documentation on how pytest.warns{.interpreted-text role="func"} affects DeprecationWarning{.interpreted-text role="class"}.

    Trivial/Internal Changes

    • #10196: ~pytest.PytestReturnNotNoneWarning{.interpreted-text role="class"} is now a subclass of ~pytest.PytestRemovedIn8Warning{.interpreted-text role="class"}: the plan is to make returning non-None from tests an error in the future.
    • #10313: Made _pytest.doctest.DoctestItem export pytest.DoctestItem for type check and runtime purposes. Made [_pytest.doctest]{.title-ref} use internal APIs to avoid circular imports.
    • #9906: Made _pytest.compat re-export importlib_metadata in the eyes of type checkers.
    • #9910: Fix default encoding warning (EncodingWarning) in cacheprovider
    • #9984: Improve the error message when we attempt to access a fixture that has been torn down. Add an additional sentence to the docstring explaining when it's not a good idea to call getfixturevalue.
    Source code(tar.gz)
    Source code(zip)
  • 7.1.3(Sep 2, 2022)

    pytest 7.1.3 (2022-08-31)

    Bug Fixes

    • #10060: When running with --pdb, TestCase.tearDown is no longer called for tests when the class has been skipped via unittest.skip or pytest.mark.skip.
    • #10190: Invalid XML characters in setup or teardown error messages are now properly escaped for JUnit XML reports.
    • #10230: Ignore .py files created by pyproject.toml-based editable builds introduced in pip 21.3.
    • #3396: Doctests now respect the --import-mode flag.
    • #9514: Type-annotate FixtureRequest.param as Any as a stop gap measure until 8073{.interpreted-text role="issue"} is fixed.
    • #9791: Fixed a path handling code in rewrite.py that seems to work fine, but was incorrect and fails in some systems.
    • #9917: Fixed string representation for pytest.approx{.interpreted-text role="func"} when used to compare tuples.

    Improved Documentation

    • #9937: Explicit note that tmpdir{.interpreted-text role="fixture"} fixture is discouraged in favour of tmp_path{.interpreted-text role="fixture"}.

    Trivial/Internal Changes

    Source code(tar.gz)
    Source code(zip)
  • 7.1.2(Apr 23, 2022)

    pytest 7.1.2 (2022-04-23)

    Bug Fixes

    • #9726: An unnecessary numpy import inside pytest.approx{.interpreted-text role="func"} was removed.
    • #9820: Fix comparison of dataclasses with InitVar.
    • #9869: Increase stacklevel for the NODE_CTOR_FSPATH_ARG deprecation to point to the user's code, not pytest.
    • #9871: Fix a bizarre (and fortunately rare) bug where the [temp_path]{.title-ref} fixture could raise an internal error while attempting to get the current user's username.
    Source code(tar.gz)
    Source code(zip)
  • 7.1.1(Mar 17, 2022)

    pytest 7.1.1 (2022-03-17)

    Bug Fixes

    • #9767: Fixed a regression in pytest 7.1.0 where some conftest.py files outside of the source tree (e.g. in the [site-packages]{.title-ref} directory) were not picked up.
    Source code(tar.gz)
    Source code(zip)
  • 7.1.0(Mar 13, 2022)

    pytest 7.1.0 (2022-03-13)

    Breaking Changes

    • #8838: As per our policy, the following features have been deprecated in the 6.X series and are now removed:

      • pytest._fillfuncargs function.
      • pytest_warning_captured hook - use pytest_warning_recorded instead.
      • -k -foobar syntax - use -k 'not foobar' instead.
      • -k foobar: syntax.
      • pytest.collect module - import from pytest directly.

      For more information consult Deprecations and Removals in the docs.

    • #9437: Dropped support for Python 3.6, which reached end-of-life at 2021-12-23.

    Improvements

    • #5192: Fixed test output for some data types where -v would show less information.

      Also, when showing diffs for sequences, -q would produce full diffs instead of the expected diff.

    • #9362: pytest now avoids specialized assert formatting when it is detected that the default __eq__ is overridden in attrs or dataclasses.

    • #9536: When -vv is given on command line, show skipping and xfail reasons in full instead of truncating them to fit the terminal width.

    • #9644: More information about the location of resources that led Python to raise ResourceWarning{.interpreted-text role="class"} can now be obtained by enabling tracemalloc{.interpreted-text role="mod"}.

      See resource-warnings{.interpreted-text role="ref"} for more information.

    • #9678: More types are now accepted in the ids argument to @pytest.mark.parametrize. Previously only [str]{.title-ref}, [float]{.title-ref}, [int]{.title-ref} and [bool]{.title-ref} were accepted; now [bytes]{.title-ref}, [complex]{.title-ref}, [re.Pattern]{.title-ref}, [Enum]{.title-ref} and anything with a [__name__]{.title-ref} are also accepted.

    • #9692: pytest.approx{.interpreted-text role="func"} now raises a TypeError{.interpreted-text role="class"} when given an unordered sequence (such as set{.interpreted-text role="class"}).

      Note that this implies that custom classes which only implement __iter__ and __len__ are no longer supported as they don't guarantee order.

    Bug Fixes

    • #8242: The deprecation of raising unittest.SkipTest{.interpreted-text role="class"} to skip collection of tests during the pytest collection phase is reverted - this is now a supported feature again.

    • #9493: Symbolic link components are no longer resolved in conftest paths. This means that if a conftest appears twice in collection tree, using symlinks, it will be executed twice. For example, given

      tests/real/conftest.py tests/real/test_it.py tests/link -> tests/real

      running pytest tests now imports the conftest twice, once as tests/real/conftest.py and once as tests/link/conftest.py. This is a fix to match a similar change made to test collection itself in pytest 6.0 (see 6523{.interpreted-text role="pull"} for details).

    • #9626: Fixed count of selected tests on terminal collection summary when there were errors or skipped modules.

      If there were errors or skipped modules on collection, pytest would mistakenly subtract those from the selected count.

    • #9645: Fixed regression where --import-mode=importlib used together with PYTHONPATH{.interpreted-text role="envvar"} or pythonpath{.interpreted-text role="confval"} would cause import errors in test suites.

    • #9708: pytester{.interpreted-text role="fixture"} now requests a monkeypatch{.interpreted-text role="fixture"} fixture instead of creating one internally. This solves some issues with tests that involve pytest environment variables.

    • #9730: Malformed pyproject.toml files now produce a clearer error message.

    Source code(tar.gz)
    Source code(zip)
  • 7.0.1(Feb 11, 2022)

    pytest 7.0.1 (2022-02-11)

    Bug Fixes

    • #9608: Fix invalid importing of importlib.readers in Python 3.9.
    • #9610: Restore [UnitTestFunction.obj]{.title-ref} to return unbound rather than bound method. Fixes a crash during a failed teardown in unittest TestCases with non-default [__init__]{.title-ref}. Regressed in pytest 7.0.0.
    • #9636: The pythonpath plugin was renamed to python_path. This avoids a conflict with the pytest-pythonpath plugin.
    • #9642: Fix running tests by id with :: in the parametrize portion.
    • #9643: Delay issuing a ~pytest.PytestWarning{.interpreted-text role="class"} about diamond inheritance involving ~pytest.Item{.interpreted-text role="class"} and ~pytest.Collector{.interpreted-text role="class"} so it can be filtered using standard warning filters <warnings>{.interpreted-text role="ref"}.
    Source code(tar.gz)
    Source code(zip)
  • 7.0.0(Feb 4, 2022)

    pytest 7.0.0 (2022-02-03)

    (Please see the full set of changes for this release also in the 7.0.0rc1 notes below)

    Deprecations

    • #9488: If custom subclasses of nodes like pytest.Item{.interpreted-text role="class"} override the __init__ method, they should take **kwargs. See uncooperative-constructors-deprecated{.interpreted-text role="ref"} for details.

      Note that a deprection warning is only emitted when there is a conflict in the arguments pytest expected to pass. This deprecation was already part of pytest 7.0.0rc1 but wasn't documented.

    Bug Fixes

    • #9355: Fixed error message prints function decorators when using assert in Python 3.8 and above.
    • #9396: Ensure pytest.Config.inifile{.interpreted-text role="attr"} is available during the pytest_cmdline_main <_pytest.hookspec.pytest_cmdline_main>{.interpreted-text role="func"} hook (regression during 7.0.0rc1).

    Improved Documentation

    • #9404: Added extra documentation on alternatives to common misuses of [pytest.warns(None)]{.title-ref} ahead of its deprecation.
    • #9505: Clarify where the configuration files are located. To avoid confusions documentation mentions that configuration file is located in the root of the repository.

    Trivial/Internal Changes

    • #9521: Add test coverage to assertion rewrite path.

    pytest 7.0.0rc1 (2021-12-06)

    Breaking Changes

    • #7259: The Node.reportinfo() <non-python tests>{.interpreted-text role="ref"} function first return value type has been expanded from [py.path.local | str]{.title-ref} to [os.PathLike[str] | str]{.title-ref}.

      Most plugins which refer to [reportinfo()]{.title-ref} only define it as part of a custom pytest.Item{.interpreted-text role="class"} implementation. Since [py.path.local]{.title-ref} is a [os.PathLike[str]]{.title-ref}, these plugins are unaffacted.

      Plugins and users which call [reportinfo()]{.title-ref}, use the first return value and interact with it as a [py.path.local]{.title-ref}, would need to adjust by calling [py.path.local(fspath)]{.title-ref}. Although preferably, avoid the legacy [py.path.local]{.title-ref} and use [pathlib.Path]{.title-ref}, or use [item.location]{.title-ref} or [item.path]{.title-ref}, instead.

      Note: pytest was not able to provide a deprecation period for this change.

    • #8246: --version now writes version information to stdout rather than stderr.

    • #8733: Drop a workaround for pyreadline that made it work with --pdb.

      The workaround was introduced in #1281 in 2015, however since then pyreadline seems to have gone unmaintained, is generating warnings, and will stop working on Python 3.10.

    • #9061: Using pytest.approx{.interpreted-text role="func"} in a boolean context now raises an error hinting at the proper usage.

      It is apparently common for users to mistakenly use pytest.approx like this:

      assert pytest.approx(actual, expected)
      

      While the correct usage is:

      assert actual == pytest.approx(expected)
      

      The new error message helps catch those mistakes.

    • #9277: The pytest.Instance collector type has been removed. Importing pytest.Instance or _pytest.python.Instance returns a dummy type and emits a deprecation warning. See instance-collector-deprecation{.interpreted-text role="ref"} for details.

    • #9308: PytestRemovedIn7Warning deprecation warnings are now errors by default.

      Following our plan to remove deprecated features with as little disruption as possible, all warnings of type PytestRemovedIn7Warning now generate errors instead of warning messages by default.

      The affected features will be effectively removed in pytest 7.1, so please consult the deprecations{.interpreted-text role="ref"} section in the docs for directions on how to update existing code.

      In the pytest 7.0.X series, it is possible to change the errors back into warnings as a stopgap measure by adding this to your pytest.ini file:

      [pytest]
      filterwarnings =
          ignore::pytest.PytestRemovedIn7Warning
      

      But this will stop working when pytest 7.1 is released.

      If you have concerns about the removal of a specific feature, please add a comment to 9308{.interpreted-text role="issue"}.

    Deprecations

    • #7259: py.path.local arguments for hooks have been deprecated. See the deprecation note <legacy-path-hooks-deprecated>{.interpreted-text role="ref"} for full details.

      py.path.local arguments to Node constructors have been deprecated. See the deprecation note <node-ctor-fspath-deprecation>{.interpreted-text role="ref"} for full details.

      ::: {.note} ::: {.admonition-title} Note :::

      The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

      This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::

    • #7469: Directly constructing the following classes is now deprecated:

      • _pytest.mark.structures.Mark
      • _pytest.mark.structures.MarkDecorator
      • _pytest.mark.structures.MarkGenerator
      • _pytest.python.Metafunc
      • _pytest.runner.CallInfo
      • _pytest._code.ExceptionInfo
      • _pytest.config.argparsing.Parser
      • _pytest.config.argparsing.OptionGroup
      • _pytest.pytester.HookRecorder

      These constructors have always been considered private, but now issue a deprecation warning, which may become a hard error in pytest 8.

    • #8242: Raising unittest.SkipTest{.interpreted-text role="class"} to skip collection of tests during the pytest collection phase is deprecated. Use pytest.skip{.interpreted-text role="func"} instead.

      Note: This deprecation only relates to using unittest.SkipTest{.interpreted-text role="class"} during test collection. You are probably not doing that. Ordinary usage of unittest.SkipTest{.interpreted-text role="class"} / unittest.TestCase.skipTest{.interpreted-text role="meth"} / unittest.skip{.interpreted-text role="func"} in unittest test cases is fully supported.

    • #8315: Several behaviors of Parser.addoption <pytest.Parser.addoption>{.interpreted-text role="meth"} are now scheduled for removal in pytest 8 (deprecated since pytest 2.4.0):

      • parser.addoption(..., help=".. %default ..") - use %(default)s instead.
      • parser.addoption(..., type="int/string/float/complex") - use type=int etc. instead.
    • #8447: Defining a custom pytest node type which is both an pytest.Item <Item>{.interpreted-text role="class"} and a pytest.Collector <Collector>{.interpreted-text role="class"} (e.g. pytest.File <File>{.interpreted-text role="class"}) now issues a warning. It was never sanely supported and triggers hard to debug errors.

      See the deprecation note <diamond-inheritance-deprecated>{.interpreted-text role="ref"} for full details.

    • #8592: pytest_cmdline_preparse{.interpreted-text role="hook"} has been officially deprecated. It will be removed in a future release. Use pytest_load_initial_conftests{.interpreted-text role="hook"} instead.

      See the deprecation note <cmdline-preparse-deprecated>{.interpreted-text role="ref"} for full details.

    • #8645: pytest.warns(None) <pytest.warns>{.interpreted-text role="func"} is now deprecated because many people used it to mean "this code does not emit warnings", but it actually had the effect of checking that the code emits at least one warning of any type - like pytest.warns() or pytest.warns(Warning).

    • #8948: pytest.skip(msg=...) <pytest.skip>{.interpreted-text role="func"}, pytest.fail(msg=...) <pytest.fail>{.interpreted-text role="func"} and pytest.exit(msg=...) <pytest.exit>{.interpreted-text role="func"} signatures now accept a reason argument instead of msg. Using msg still works, but is deprecated and will be removed in a future release.

      This was changed for consistency with pytest.mark.skip <pytest.mark.skip>{.interpreted-text role="func"} and pytest.mark.xfail <pytest.mark.xfail>{.interpreted-text role="func"} which both accept reason as an argument.

    • #8174: The following changes have been made to types reachable through pytest.ExceptionInfo.traceback{.interpreted-text role="attr"}:

      • The path property of _pytest.code.Code returns Path instead of py.path.local.
      • The path property of _pytest.code.TracebackEntry returns Path instead of py.path.local.

      There was no deprecation period for this change (sorry!).

    Features

    • #5196: Tests are now ordered by definition order in more cases.

      In a class hierarchy, tests from base classes are now consistently ordered before tests defined on their subclasses (reverse MRO order).

    • #7132: Added two environment variables PYTEST_THEME{.interpreted-text role="envvar"} and PYTEST_THEME_MODE{.interpreted-text role="envvar"} to let the users customize the pygments theme used.

    • #7259: Added cache.mkdir() <pytest.Cache.mkdir>{.interpreted-text role="meth"}, which is similar to the existing cache.makedir() <pytest.Cache.makedir>{.interpreted-text role="meth"}, but returns a pathlib.Path{.interpreted-text role="class"} instead of a legacy py.path.local.

      Added a paths type to parser.addini() <pytest.Parser.addini>{.interpreted-text role="meth"}, as in parser.addini("mypaths", "my paths", type="paths"), which is similar to the existing pathlist, but returns a list of pathlib.Path{.interpreted-text role="class"} instead of legacy py.path.local.

    • #7469: The types of objects used in pytest's API are now exported so they may be used in type annotations.

      The newly-exported types are:

      • pytest.Config for Config <pytest.Config>{.interpreted-text role="class"}.
      • pytest.Mark for marks <pytest.Mark>{.interpreted-text role="class"}.
      • pytest.MarkDecorator for mark decorators <pytest.MarkDecorator>{.interpreted-text role="class"}.
      • pytest.MarkGenerator for the pytest.mark <pytest.MarkGenerator>{.interpreted-text role="class"} singleton.
      • pytest.Metafunc for the metafunc <pytest.MarkGenerator>{.interpreted-text role="class"} argument to the pytest_generate_tests{.interpreted-text role="hook"} hook.
      • pytest.CallInfo for the CallInfo <pytest.CallInfo>{.interpreted-text role="class"} type passed to various hooks.
      • pytest.PytestPluginManager for PytestPluginManager <pytest.PytestPluginManager>{.interpreted-text role="class"}.
      • pytest.ExceptionInfo for the ExceptionInfo <pytest.ExceptionInfo>{.interpreted-text role="class"} type returned from pytest.raises{.interpreted-text role="func"} and passed to various hooks.
      • pytest.Parser for the Parser <pytest.Parser>{.interpreted-text role="class"} type passed to the pytest_addoption{.interpreted-text role="hook"} hook.
      • pytest.OptionGroup for the OptionGroup <pytest.OptionGroup>{.interpreted-text role="class"} type returned from the parser.addgroup <pytest.Parser.getgroup>{.interpreted-text role="func"} method.
      • pytest.HookRecorder for the HookRecorder <pytest.HookRecorder>{.interpreted-text role="class"} type returned from ~pytest.Pytester{.interpreted-text role="class"}.
      • pytest.RecordedHookCall for the RecordedHookCall <pytest.HookRecorder>{.interpreted-text role="class"} type returned from ~pytest.HookRecorder{.interpreted-text role="class"}.
      • pytest.RunResult for the RunResult <pytest.RunResult>{.interpreted-text role="class"} type returned from ~pytest.Pytester{.interpreted-text role="class"}.
      • pytest.LineMatcher for the LineMatcher <pytest.RunResult>{.interpreted-text role="class"} type used in ~pytest.RunResult{.interpreted-text role="class"} and others.
      • pytest.TestReport for the TestReport <pytest.TestReport>{.interpreted-text role="class"} type used in various hooks.
      • pytest.CollectReport for the CollectReport <pytest.CollectReport>{.interpreted-text role="class"} type used in various hooks.

      Constructing most of them directly is not supported; they are only meant for use in type annotations. Doing so will emit a deprecation warning, and may become a hard-error in pytest 8.0.

      Subclassing them is also not supported. This is not currently enforced at runtime, but is detected by type-checkers such as mypy.

    • #7856: --import-mode=importlib <import-modes>{.interpreted-text role="ref"} now works with features that depend on modules being on :pysys.modules{.interpreted-text role="data"}, such as pickle{.interpreted-text role="mod"} and dataclasses{.interpreted-text role="mod"}.

    • #8144: The following hooks now receive an additional pathlib.Path argument, equivalent to an existing py.path.local argument:

      • pytest_ignore_collect{.interpreted-text role="hook"} - The collection_path parameter (equivalent to existing path parameter).
      • pytest_collect_file{.interpreted-text role="hook"} - The file_path parameter (equivalent to existing path parameter).
      • pytest_pycollect_makemodule{.interpreted-text role="hook"} - The module_path parameter (equivalent to existing path parameter).
      • pytest_report_header{.interpreted-text role="hook"} - The start_path parameter (equivalent to existing startdir parameter).
      • pytest_report_collectionfinish{.interpreted-text role="hook"} - The start_path parameter (equivalent to existing startdir parameter).

      ::: {.note} ::: {.admonition-title} Note :::

      The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

      This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::

    • #8251: Implement Node.path as a pathlib.Path. Both the old fspath and this new attribute gets set no matter whether path or fspath (deprecated) is passed to the constructor. It is a replacement for the fspath attribute (which represents the same path as py.path.local). While fspath is not deprecated yet due to the ongoing migration of methods like ~_pytest.Item.reportinfo{.interpreted-text role="meth"}, we expect to deprecate it in a future release.

      ::: {.note} ::: {.admonition-title} Note :::

      The name of the ~_pytest.nodes.Node{.interpreted-text role="class"} arguments and attributes (the new attribute being path) is the opposite of the situation for hooks (the old argument being path).

      This is an unfortunate artifact due to historical reasons, which should be resolved in future versions as we slowly get rid of the py{.interpreted-text role="pypi"} dependency (see 9283{.interpreted-text role="issue"} for a longer discussion). :::

    • #8421: pytest.approx{.interpreted-text role="func"} now works on ~decimal.Decimal{.interpreted-text role="class"} within mappings/dicts and sequences/lists.

    • #8606: pytest invocations with --fixtures-per-test and --fixtures have been enriched with:

      • Fixture location path printed with the fixture name.
      • First section of the fixture's docstring printed under the fixture name.
      • Whole of fixture's docstring printed under the fixture name using --verbose option.
    • #8761: New version-tuple{.interpreted-text role="ref"} attribute, which makes it simpler for users to do something depending on the pytest version (such as declaring hooks which are introduced in later versions).

    • #8789: Switch TOML parser from toml to tomli for TOML v1.0.0 support in pyproject.toml.

    • #8920: Added pytest.Stash{.interpreted-text role="class"}, a facility for plugins to store their data on ~pytest.Config{.interpreted-text role="class"} and ~_pytest.nodes.Node{.interpreted-text role="class"}s in a type-safe and conflict-free manner. See plugin-stash{.interpreted-text role="ref"} for details.

    • #8953: RunResult <_pytest.pytester.RunResult>{.interpreted-text role="class"} method assert_outcomes <_pytest.pytester.RunResult.assert_outcomes>{.interpreted-text role="meth"} now accepts a warnings argument to assert the total number of warnings captured.

    • #8954: --debug flag now accepts a str{.interpreted-text role="class"} file to route debug logs into, remains defaulted to [pytestdebug.log]{.title-ref}.

    • #9023: Full diffs are now always shown for equality assertions of iterables when [CI]{.title-ref} or BUILD_NUMBER is found in the environment, even when -v isn't used.

    • #9113: RunResult <_pytest.pytester.RunResult>{.interpreted-text role="class"} method assert_outcomes <_pytest.pytester.RunResult.assert_outcomes>{.interpreted-text role="meth"} now accepts a deselected argument to assert the total number of deselected tests.

    • #9114: Added pythonpath{.interpreted-text role="confval"} setting that adds listed paths to sys.path{.interpreted-text role="data"} for the duration of the test session. If you currently use the pytest-pythonpath or pytest-srcpaths plugins, you should be able to replace them with built-in [pythonpath]{.title-ref} setting.

    Improvements

    • #7480: A deprecation scheduled to be removed in a major version X (e.g. pytest 7, 8, 9, ...) now uses warning category [PytestRemovedInXWarning]{.title-ref}, a subclass of ~pytest.PytestDeprecationWarning{.interpreted-text role="class"}, instead of PytestDeprecationWarning{.interpreted-text role="class"} directly.

      See backwards-compatibility{.interpreted-text role="ref"} for more details.

    • #7864: Improved error messages when parsing warning filters.

      Previously pytest would show an internal traceback, which besides being ugly sometimes would hide the cause of the problem (for example an ImportError while importing a specific warning type).

    • #8335: Improved pytest.approx{.interpreted-text role="func"} assertion messages for sequences of numbers.

      The assertion messages now dumps a table with the index and the error of each diff. Example:

      >       assert [1, 2, 3, 4] == pytest.approx([1, 3, 3, 5])
      E       assert comparison failed for 2 values:
      E         Index | Obtained | Expected
      E         1     | 2        | 3 +- 3.0e-06
      E         3     | 4        | 5 +- 5.0e-06
      
    • #8403: By default, pytest will truncate long strings in assert errors so they don't clutter the output too much, currently at 240 characters by default.

      However, in some cases the longer output helps, or is even crucial, to diagnose a failure. Using -v will now increase the truncation threshold to 2400 characters, and -vv or higher will disable truncation entirely.

    • #8509: Fixed issue where unittest.TestCase.setUpClass{.interpreted-text role="meth"} is not called when a test has [/]{.title-ref} in its name since pytest 6.2.0.

      This refers to the path part in pytest node IDs, e.g. TestClass::test_it in the node ID tests/test_file.py::TestClass::test_it.

      Now, instead of assuming that the test name does not contain /, it is assumed that test path does not contain ::. We plan to hopefully make both of these work in the future.

    • #8803: It is now possible to add colors to custom log levels on cli log.

      By using add_color_level <_pytest.logging.add_color_level>{.interpreted-text role="func"} from a pytest_configure hook, colors can be added:

      logging_plugin = config.pluginmanager.get_plugin('logging-plugin')
      logging_plugin.log_cli_handler.formatter.add_color_level(logging.INFO, 'cyan')
      logging_plugin.log_cli_handler.formatter.add_color_level(logging.SPAM, 'blue')
      

      See log_colors{.interpreted-text role="ref"} for more information.

    • #8822: When showing fixture paths in [--fixtures]{.title-ref} or [--fixtures-by-test]{.title-ref}, fixtures coming from pytest itself now display an elided path, rather than the full path to the file in the [site-packages]{.title-ref} directory.

    • #8898: Complex numbers are now treated like floats and integers when generating parameterization IDs.

    • #9062: --stepwise-skip now implicitly enables --stepwise and can be used on its own.

    • #9205: pytest.Cache.set{.interpreted-text role="meth"} now preserves key order when saving dicts.

    Bug Fixes

    • #7124: Fixed an issue where __main__.py would raise an ImportError when --doctest-modules was provided.

    • #8061: Fixed failing staticmethod test cases if they are inherited from a parent test class.

    • #8192: testdir.makefile now silently accepts values which don't start with . to maintain backward compatibility with older pytest versions.

      pytester.makefile now issues a clearer error if the . is missing in the ext argument.

    • #8258: Fixed issue where pytest's faulthandler support would not dump traceback on crashes if the faulthandler{.interpreted-text role="mod"} module was already enabled during pytest startup (using python -X dev -m pytest for example).

    • #8317: Fixed an issue where illegal directory characters derived from getpass.getuser() raised an OSError.

    • #8367: Fix Class.from_parent so it forwards extra keyword arguments to the constructor.

    • #8377: The test selection options pytest -k and pytest -m now support matching names containing forward slash (/) characters.

    • #8384: The @pytest.mark.skip decorator now correctly handles its arguments. When the reason argument is accidentally given both positional and as a keyword (e.g. because it was confused with skipif), a TypeError now occurs. Before, such tests were silently skipped, and the positional argument ignored. Additionally, reason is now documented correctly as positional or keyword (rather than keyword-only).

    • #8394: Use private names for internal fixtures that handle classic setup/teardown so that they don't show up with the default --fixtures invocation (but they still show up with --fixtures -v).

    • #8456: The required_plugins{.interpreted-text role="confval"} config option now works correctly when pre-releases of plugins are installed, rather than falsely claiming that those plugins aren't installed at all.

    • #8464: -c <config file> now also properly defines rootdir as the directory that contains <config file>.

    • #8503: pytest.MonkeyPatch.syspath_prepend{.interpreted-text role="meth"} no longer fails when setuptools is not installed. It now only calls pkg_resources.fixup_namespace_packages{.interpreted-text role="func"} if pkg_resources was previously imported, because it is not needed otherwise.

    • #8548: Introduce fix to handle precision width in log-cli-format in turn to fix output coloring for certain formats.

    • #8796: Fixed internal error when skipping doctests.

    • #8983: The test selection options pytest -k and pytest -m now support matching names containing backslash ([\]{.title-ref}) characters. Backslashes are treated literally, not as escape characters (the values being matched against are already escaped).

    • #8990: Fix [pytest -vv]{.title-ref} crashing with an internal exception [AttributeError: 'str' object has no attribute 'relative_to']{.title-ref} in some cases.

    • #9077: Fixed confusing error message when request.fspath / request.path was accessed from a session-scoped fixture.

    • #9131: Fixed the URL used by --pastebin to use bpa.st.

    • #9163: The end line number and end column offset are now properly set for rewritten assert statements.

    • #9169: Support for the files API from importlib.resources within rewritten files.

    • #9272: The nose compatibility module-level fixtures [setup()]{.title-ref} and [teardown()]{.title-ref} are now only called once per module, instead of for each test function. They are now called even if object-level [setup]{.title-ref}/[teardown]{.title-ref} is defined.

    Improved Documentation

    • #4320: Improved docs for [pytester.copy_example]{.title-ref}.
    • #5105: Add automatically generated plugin-list{.interpreted-text role="ref"}. The list is updated on a periodic schedule.
    • #8337: Recommend numpy.testing module on pytest.approx{.interpreted-text role="func"} documentation.
    • #8655: Help text for --pdbcls more accurately reflects the option's behavior.
    • #9210: Remove incorrect docs about confcutdir being a configuration option: it can only be set through the --confcutdir command-line option.
    • #9242: Upgrade readthedocs configuration to use a newer Ubuntu version` with better unicode support for PDF docs.
    • #9341: Various methods commonly used for non-python tests{.interpreted-text role="ref"} are now correctly documented in the reference docs. They were undocumented previously.

    Trivial/Internal Changes

    • #8133: Migrate to setuptools_scm 6.x to use SETUPTOOLS_SCM_PRETEND_VERSION_FOR_PYTEST for more robust release tooling.
    • #8174: The following changes have been made to internal pytest types/functions:
      • The _pytest.code.getfslineno() function returns Path instead of py.path.local.
      • The _pytest.python.path_matches_patterns() function takes Path instead of py.path.local.
      • The _pytest._code.Traceback.cut() function accepts any os.PathLike[str], not just py.path.local.
    • #8248: Internal Restructure: let python.PyObjMixin inherit from nodes.Node to carry over typing information.
    • #8432: Improve error message when pytest.skip{.interpreted-text role="func"} is used at module level without passing [allow_module_level=True]{.title-ref}.
    • #8818: Ensure regendoc opts out of TOX_ENV cachedir selection to ensure independent example test runs.
    • #8913: The private CallSpec2._arg2scopenum attribute has been removed after an internal refactoring.
    • #8967: pytest_assertion_pass{.interpreted-text role="hook"} is no longer considered experimental and future changes to it will be considered more carefully.
    • #9202: Add github action to upload coverage report to codecov instead of bash uploader.
    • #9225: Changed the command used to create sdist and wheel artifacts: using the build package instead of setup.py.
    • #9351: Correct minor typos in doc/en/example/special.rst.
    Source code(tar.gz)
    Source code(zip)
  • 7.0.0rc1(Dec 7, 2021)

  • 6.2.5(Aug 30, 2021)

  • 6.2.4(May 4, 2021)

  • 6.2.3(Apr 3, 2021)

    pytest 6.2.3 (2021-04-03)

    Bug Fixes

    • #8414: pytest used to create directories under /tmp with world-readable permissions. This means that any user in the system was able to read information written by tests in temporary directories (such as those created by the tmp_path/tmpdir fixture). Now the directories are created with private permissions.

      pytest used silenty use a pre-existing /tmp/pytest-of-<username> directory, even if owned by another user. This means another user could pre-create such a directory and gain control of another user's temporary directory. Now such a condition results in an error.

    Source code(tar.gz)
    Source code(zip)
  • 6.2.2(Jan 25, 2021)

    pytest 6.2.2 (2021-01-25)

    Bug Fixes

    • #8152: Fixed "(<Skipped instance>)" being shown as a skip reason in the verbose test summary line when the reason is empty.
    • #8249: Fix the faulthandler plugin for occasions when running with twisted.logger and using pytest --capture=no.
    Source code(tar.gz)
    Source code(zip)
  • 6.2.1(Dec 15, 2020)

    pytest 6.2.1 (2020-12-15)

    Bug Fixes

    • #7678: Fixed bug where ImportPathMismatchError would be raised for files compiled in the host and loaded later from an UNC mounted path (Windows).

    • #8132: Fixed regression in approx: in 6.2.0 approx no longer raises TypeError when dealing with non-numeric types, falling back to normal comparison. Before 6.2.0, array types like tf.DeviceArray fell through to the scalar case, and happened to compare correctly to a scalar if they had only one element. After 6.2.0, these types began failing, because they inherited neither from standard Python number hierarchy nor from numpy.ndarray.

      approx now converts arguments to numpy.ndarray if they expose the array protocol and are not scalars. This treats array-like objects like numpy arrays, regardless of size.

    Source code(tar.gz)
    Source code(zip)
  • 6.2.0(Dec 12, 2020)

    pytest 6.2.0 (2020-12-12)

    Breaking Changes

    • #7808: pytest now supports python3.6+ only.

    Deprecations

    • #7469: Directly constructing/calling the following classes/functions is now deprecated:

      • _pytest.cacheprovider.Cache
      • _pytest.cacheprovider.Cache.for_config()
      • _pytest.cacheprovider.Cache.clear_cache()
      • _pytest.cacheprovider.Cache.cache_dir_from_config()
      • _pytest.capture.CaptureFixture
      • _pytest.fixtures.FixtureRequest
      • _pytest.fixtures.SubRequest
      • _pytest.logging.LogCaptureFixture
      • _pytest.pytester.Pytester
      • _pytest.pytester.Testdir
      • _pytest.recwarn.WarningsRecorder
      • _pytest.recwarn.WarningsChecker
      • _pytest.tmpdir.TempPathFactory
      • _pytest.tmpdir.TempdirFactory

      These have always been considered private, but now issue a deprecation warning, which may become a hard error in pytest 7.0.0.

    • #7530: The --strict command-line option has been deprecated, use --strict-markers instead.

      We have plans to maybe in the future to reintroduce --strict and make it an encompassing flag for all strictness related options (--strict-markers and --strict-config at the moment, more might be introduced in the future).

    • #7988: The @pytest.yield_fixture decorator/function is now deprecated. Use pytest.fixture instead.

      yield_fixture has been an alias for fixture for a very long time, so can be search/replaced safely.

    Features

    • #5299: pytest now warns about unraisable exceptions and unhandled thread exceptions that occur in tests on Python>=3.8. See unraisable for more information.

    • #7425: New pytester fixture, which is identical to testdir but its methods return pathlib.Path when appropriate instead of py.path.local.

      This is part of the movement to use pathlib.Path objects internally, in order to remove the dependency to py in the future.

      Internally, the old Testdir <_pytest.pytester.Testdir> is now a thin wrapper around Pytester <_pytest.pytester.Pytester>, preserving the old interface.

    • #7695: A new hook was added, pytest_markeval_namespace which should return a dictionary. This dictionary will be used to augment the "global" variables available to evaluate skipif/xfail/xpass markers.

      Pseudo example

      conftest.py:

      def pytest_markeval_namespace():
          return {"color": "red"}
      

      test_func.py:

      @pytest.mark.skipif("color == 'blue'", reason="Color is not red")
      def test_func():
          assert False
      
    • #8006: It is now possible to construct a ~pytest.MonkeyPatch object directly as pytest.MonkeyPatch(), in cases when the monkeypatch fixture cannot be used. Previously some users imported it from the private _pytest.monkeypatch.MonkeyPatch namespace.

      Additionally, MonkeyPatch.context <pytest.MonkeyPatch.context> is now a classmethod, and can be used as with MonkeyPatch.context() as mp: .... This is the recommended way to use MonkeyPatch directly, since unlike the monkeypatch fixture, an instance created directly is not undo()-ed automatically.

    Improvements

    • #1265: Added an __str__ implementation to the ~pytest.pytester.LineMatcher class which is returned from pytester.run_pytest().stdout and similar. It returns the entire output, like the existing str() method.

    • #2044: Verbose mode now shows the reason that a test was skipped in the test's terminal line after the "SKIPPED", "XFAIL" or "XPASS".

    • #7469 The types of builtin pytest fixtures are now exported so they may be used in type annotations of test functions. The newly-exported types are:

      • pytest.FixtureRequest for the request fixture.
      • pytest.Cache for the cache fixture.
      • pytest.CaptureFixture[str] for the capfd and capsys fixtures.
      • pytest.CaptureFixture[bytes] for the capfdbinary and capsysbinary fixtures.
      • pytest.LogCaptureFixture for the caplog fixture.
      • pytest.Pytester for the pytester fixture.
      • pytest.Testdir for the testdir fixture.
      • pytest.TempdirFactory for the tmpdir_factory fixture.
      • pytest.TempPathFactory for the tmp_path_factory fixture.
      • pytest.MonkeyPatch for the monkeypatch fixture.
      • pytest.WarningsRecorder for the recwarn fixture.

      Constructing them is not supported (except for MonkeyPatch); they are only meant for use in type annotations. Doing so will emit a deprecation warning, and may become a hard-error in pytest 7.0.

      Subclassing them is also not supported. This is not currently enforced at runtime, but is detected by type-checkers such as mypy.

    • #7527: When a comparison between namedtuple <collections.namedtuple> instances of the same type fails, pytest now shows the differing field names (possibly nested) instead of their indexes.

    • #7615: Node.warn <_pytest.nodes.Node.warn> now permits any subclass of Warning, not just PytestWarning <pytest.PytestWarning>.

    • #7701: Improved reporting when using --collected-only. It will now show the number of collected tests in the summary stats.

    • #7710: Use strict equality comparison for non-numeric types in pytest.approx instead of raising TypeError.

      This was the undocumented behavior before 3.7, but is now officially a supported feature.

    • #7938: New --sw-skip argument which is a shorthand for --stepwise-skip.

    • #8023: Added 'node_modules' to default value for norecursedirs.

    • #8032: doClassCleanups <unittest.TestCase.doClassCleanups> (introduced in unittest in Python and 3.8) is now called appropriately.

    Bug Fixes

    • #4824: Fixed quadratic behavior and improved performance of collection of items using autouse fixtures and xunit fixtures.
    • #7758: Fixed an issue where some files in packages are getting lost from --lf even though they contain tests that failed. Regressed in pytest 5.4.0.
    • #7911: Directories created by by tmp_path and tmpdir are now considered stale after 3 days without modification (previous value was 3 hours) to avoid deleting directories still in use in long running test suites.
    • #7913: Fixed a crash or hang in pytester.spawn <_pytest.pytester.Pytester.spawn> when the readline module is involved.
    • #7951: Fixed handling of recursive symlinks when collecting tests.
    • #7981: Fixed symlinked directories not being followed during collection. Regressed in pytest 6.1.0.
    • #8016: Fixed only one doctest being collected when using pytest --doctest-modules path/to/an/__init__.py.

    Improved Documentation

    • #7429: Add more information and use cases about skipping doctests.
    • #7780: Classes which should not be inherited from are now marked final class in the API reference.
    • #7872: _pytest.config.argparsing.Parser.addini() accepts explicit None and "string".
    • #7878: In pull request section, ask to commit after editing changelog and authors file.

    Trivial/Internal Changes

    • #7802: The attrs dependency requirement is now >=19.2.0 instead of >=17.4.0.
    • #8014: .pyc files created by pytest's assertion rewriting now conform to the newer PEP-552 format on Python>=3.7. (These files are internal and only interpreted by pytest itself.)
    Source code(tar.gz)
    Source code(zip)
  • 6.1.2(Oct 28, 2020)

    pytest 6.1.2 (2020-10-28)

    Bug Fixes

    • #7758: Fixed an issue where some files in packages are getting lost from --lf even though they contain tests that failed. Regressed in pytest 5.4.0.
    • #7911: Directories created by tmpdir are now considered stale after 3 days without modification (previous value was 3 hours) to avoid deleting directories still in use in long running test suites.

    Improved Documentation

    • #7815: Improve deprecation warning message for pytest._fillfuncargs().
    Source code(tar.gz)
    Source code(zip)
  • 6.1.1(Oct 3, 2020)

    pytest 6.1.1 (2020-10-03)

    Bug Fixes

    • #7807: Fixed regression in pytest 6.1.0 causing incorrect rootdir to be determined in some non-trivial cases where parent directories have config files as well.
    • #7814: Fixed crash in header reporting when testpaths is used and contains absolute paths (regression in 6.1.0).
    Source code(tar.gz)
    Source code(zip)
  • 6.1.0(Sep 26, 2020)

    pytest 6.1.0 (2020-09-26)

    Breaking Changes

    • #5585: As per our policy, the following features which have been deprecated in the 5.X series are now removed:

      • The funcargnames read-only property of FixtureRequest, Metafunc, and Function classes. Use fixturenames attribute.
      • @pytest.fixture no longer supports positional arguments, pass all arguments by keyword instead.
      • Direct construction of Node subclasses now raise an error, use from_parent instead.
      • The default value for junit_family has changed to xunit2. If you require the old format, add junit_family=xunit1 to your configuration file.
      • The TerminalReporter no longer has a writer attribute. Plugin authors may use the public functions of the TerminalReporter instead of accessing the TerminalWriter object directly.
      • The --result-log option has been removed. Users are recommended to use the pytest-reportlog plugin instead.

      For more information consult Deprecations and Removals in the docs.

    Deprecations

    • #6981: The pytest.collect module is deprecated: all its names can be imported from pytest directly.

    • #7097: The pytest._fillfuncargs function is deprecated. This function was kept for backward compatibility with an older plugin.

      It's functionality is not meant to be used directly, but if you must replace it, use function._request._fillfixtures() instead, though note this is not a public API and may break in the future.

    • #7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

      The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.

    • #7255: The pytest_warning_captured <_pytest.hookspec.pytest_warning_captured> hook is deprecated in favor of pytest_warning_recorded <_pytest.hookspec.pytest_warning_recorded>, and will be removed in a future version.

    • #7648: The gethookproxy() and isinitpath() methods of FSCollector and Package are deprecated; use self.session.gethookproxy() and self.session.isinitpath() instead. This should work on all pytest versions.

    Features

    • #7667: New --durations-min command-line flag controls the minimal duration for inclusion in the slowest list of tests shown by --durations. Previously this was hard-coded to 0.005s.

    Improvements

    • #6681: Internal pytest warnings issued during the early stages of initialization are now properly handled and can filtered through filterwarnings or --pythonwarnings/-W.

      This also fixes a number of long standing issues: #2891, #7620, #7426.

    • #7572: When a plugin listed in required_plugins is missing or an unknown config key is used with --strict-config, a simple error message is now shown instead of a stacktrace.

    • #7685: Added two new attributes rootpath <_pytest.config.Config.rootpath> and inipath <_pytest.config.Config.inipath> to Config <_pytest.config.Config>. These attributes are pathlib.Path versions of the existing rootdir <_pytest.config.Config.rootdir> and inifile <_pytest.config.Config.inifile> attributes, and should be preferred over them when possible.

    • #7780: Public classes which are not designed to be inherited from are now marked @final. Code which inherits from these classes will trigger a type-checking (e.g. mypy) error, but will still work in runtime. Currently the final designation does not appear in the API Reference but hopefully will in the future.

    Bug Fixes

    • #1953: Fixed error when overwriting a parametrized fixture, while also reusing the super fixture value.

      # conftest.py
      import pytest
      
      
      @pytest.fixture(params=[1, 2])
      def foo(request):
          return request.param
      
      
      # test_foo.py
      import pytest
      
      
      @pytest.fixture
      def foo(foo):
          return foo * 2
      
    • #4984: Fixed an internal error crash with IndexError: list index out of range when collecting a module which starts with a decorated function, the decorator raises, and assertion rewriting is enabled.

    • #7591: pylint shouldn't complain anymore about unimplemented abstract methods when inheriting from File <non-python tests>.

    • #7628: Fixed test collection when a full path without a drive letter was passed to pytest on Windows (for example \projects\tests\test.py instead of c:\projects\tests\pytest.py).

    • #7638: Fix handling of command-line options that appear as paths but trigger an OS-level syntax error on Windows, such as the options used internally by pytest-xdist.

    • #7742: Fixed INTERNALERROR when accessing locals / globals with faulty exec.

    Improved Documentation

    • #1477: Removed faq.rst and its reference in contents.rst.

    Trivial/Internal Changes

    • #7536: The internal junitxml plugin has rewritten to use xml.etree.ElementTree. The order of attributes in XML elements might differ. Some unneeded escaping is no longer performed.
    • #7587: The dependency on the more-itertools package has been removed.
    • #7631: The result type of capfd.readouterr() <_pytest.capture.CaptureFixture.readouterr> (and similar) is no longer a namedtuple, but should behave like one in all respects. This was done for technical reasons.
    • #7671: When collecting tests, pytest finds test classes and functions by examining the attributes of python objects (modules, classes and instances). To speed up this process, pytest now ignores builtin attributes (like __class__, __delattr__ and __new__) without consulting the python_classes and python_functions configuration options and without passing them to plugins using the pytest_pycollect_makeitem <_pytest.hookspec.pytest_pycollect_makeitem> hook.
    Source code(tar.gz)
    Source code(zip)
  • 6.0.2(Sep 11, 2020)

    pytest 6.0.2 (2020-09-04)

    Bug Fixes

    • #7148: Fixed --log-cli potentially causing unrelated print output to be swallowed.
    • #7672: Fixed log-capturing level restored incorrectly if caplog.set_level is called more than once.
    • #7686: Fixed NotSetType.token being used as the parameter ID when the parametrization list is empty. Regressed in pytest 6.0.0.
    • #7707: Fix internal error when handling some exceptions that contain multiple lines or the style uses multiple lines (--tb=line for example).
    Source code(tar.gz)
    Source code(zip)
  • 6.0.1(Jul 30, 2020)

    pytest 6.0.1 (2020-07-30)

    Bug Fixes

    • #7394: Passing an empty help value to Parser.add_option is now accepted instead of crashing when running pytest --help. Passing None raises a more informative TypeError.
    • #7558: Fix pylint not-callable lint on pytest.mark.parametrize() and the other builtin marks: skip, skipif, xfail, usefixtures, filterwarnings.
    • #7559: Fix regression in plugins using TestReport.longreprtext (such as pytest-html) when TestReport.longrepr is not a string.
    • #7569: Fix logging capture handler's level not reset on teardown after a call to caplog.set_level().
    Source code(tar.gz)
    Source code(zip)
  • 6.0.0(Jul 28, 2020)

    pytest 6.0.0 (2020-07-28)

    (Please see the full set of changes for this release also in the 6.0.0rc1 notes below)

    Breaking Changes

    • #5584: PytestDeprecationWarning are now errors by default.

      Following our plan to remove deprecated features with as little disruption as possible, all warnings of type PytestDeprecationWarning now generate errors instead of warning messages.

      The affected features will be effectively removed in pytest 6.1, so please consult the Deprecations and Removals section in the docs for directions on how to update existing code.

      In the pytest 6.0.X series, it is possible to change the errors back into warnings as a stopgap measure by adding this to your pytest.ini file:

      [pytest]
      filterwarnings =
          ignore::pytest.PytestDeprecationWarning
      

      But this will stop working when pytest 6.1 is released.

      If you have concerns about the removal of a specific feature, please add a comment to #5584.

    • #7472: The exec_() and is_true() methods of _pytest._code.Frame have been removed.

    Features

    • #7464: Added support for NO_COLOR and FORCE_COLOR environment variables to control colored output.

    Improvements

    • #7467: --log-file CLI option and log_file ini marker now create subdirectories if needed.
    • #7489: The pytest.raises function has a clearer error message when match equals the obtained string but is not a regex match. In this case it is suggested to escape the regex.

    Bug Fixes

    • #7392: Fix the reported location of tests skipped with @pytest.mark.skip when --runxfail is used.
    • #7491: tmpdir and tmp_path no longer raise an error if the lock to check for stale temporary directories is not accessible.
    • #7517: Preserve line endings when captured via capfd.
    • #7534: Restored the previous formatting of TracebackEntry.__str__ which was changed by accident.

    Improved Documentation

    • #7422: Clarified when the usefixtures mark can apply fixtures to test.
    • #7441: Add a note about -q option used in getting started guide.

    Trivial/Internal Changes

    • #7389: Fixture scope package is no longer considered experimental.

    pytest 6.0.0rc1 (2020-07-08)

    Breaking Changes

    • #1316: TestReport.longrepr is now always an instance of ReprExceptionInfo. Previously it was a str when a test failed with pytest.fail(..., pytrace=False).

    • #5965: symlinks are no longer resolved during collection and matching conftest.py files with test file paths.

      Resolving symlinks for the current directory and during collection was introduced as a bugfix in 3.9.0, but it actually is a new feature which had unfortunate consequences in Windows and surprising results in other platforms.

      The team decided to step back on resolving symlinks at all, planning to review this in the future with a more solid solution (see discussion in #6523 for details).

      This might break test suites which made use of this feature; the fix is to create a symlink for the entire test tree, and not only to partial files/tress as it was possible previously.

    • #6505: Testdir.run().parseoutcomes() now always returns the parsed nouns in plural form.

      Originally parseoutcomes() would always returns the nouns in plural form, but a change meant to improve the terminal summary by using singular form single items (1 warning or 1 error) caused an unintended regression by changing the keys returned by parseoutcomes().

      Now the API guarantees to always return the plural form, so calls like this:

      result = testdir.runpytest()
      result.assert_outcomes(error=1)
      

      Need to be changed to:

      result = testdir.runpytest()
      result.assert_outcomes(errors=1)
      
    • #6903: The os.dup() function is now assumed to exist. We are not aware of any supported Python 3 implementations which do not provide it.

    • #7040: -k no longer matches against the names of the directories outside the test session root.

      Also, pytest.Package.name is now just the name of the directory containing the package's __init__.py file, instead of the full path. This is consistent with how the other nodes are named, and also one of the reasons why -k would match against any directory containing the test suite.

    • #7122: Expressions given to the -m and -k options are no longer evaluated using Python's eval. The format supports or, and, not, parenthesis and general identifiers to match against. Python constants, keywords or other operators are no longer evaluated differently.

    • #7135: Pytest now uses its own TerminalWriter class instead of using the one from the py library. Plugins generally access this class through TerminalReporter.writer, TerminalReporter.write() (and similar methods), or _pytest.config.create_terminal_writer().

      The following breaking changes were made:

      • Output (write() method and others) no longer flush implicitly; the flushing behavior of the underlying file is respected. To flush explicitly (for example, if you want output to be shown before an end-of-line is printed), use write(flush=True) or terminal_writer.flush().
      • Explicit Windows console support was removed, delegated to the colorama library.
      • Support for writing bytes was removed.
      • The reline method and chars_on_current_line property were removed.
      • The stringio and encoding arguments was removed.
      • Support for passing a callable instead of a file was removed.
    • #7224: The item.catch_log_handler and item.catch_log_handlers attributes, set by the logging plugin and never meant to be public , are no longer available.

      The deprecated --no-print-logs option is removed. Use --show-capture instead.

    • #7226: Removed the unused args parameter from pytest.Function.__init__.

    • #7418: Removed the pytest_doctest_prepare_content hook specification. This hook hasn't been triggered by pytest for at least 10 years.

    • #7438: Some changes were made to the internal _pytest._code.source, listed here for the benefit of plugin authors who may be using it:

      • The deindent argument to Source() has been removed, now it is always true.
      • Support for zero or multiple arguments to Source() has been removed.
      • Support for comparing Source with an str has been removed.
      • The methods Source.isparseable() and Source.putaround() have been removed.
      • The method Source.compile() and function _pytest._code.compile() have been removed; use plain compile() instead.
      • The function _pytest._code.source.getsource() has been removed; use Source() directly instead.

    Deprecations

    • #7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

      The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.

    • #4049: pytest_warning_captured is deprecated in favor of the pytest_warning_recorded hook.

    Features

    • #1556: pytest now supports pyproject.toml files for configuration.

      The configuration options is similar to the one available in other formats, but must be defined in a [tool.pytest.ini_options] table to be picked up by pytest:

      # pyproject.toml
      [tool.pytest.ini_options]
      minversion = "6.0"
      addopts = "-ra -q"
      testpaths = [
          "tests",
          "integration",
      ]
      

      More information can be found in the docs.

    • #3342: pytest now includes inline type annotations and exposes them to user programs. Most of the user-facing API is covered, as well as internal code.

      If you are running a type checker such as mypy on your tests, you may start noticing type errors indicating incorrect usage. If you run into an error that you believe to be incorrect, please let us know in an issue.

      The types were developed against mypy version 0.780. Versions before 0.750 are known not to work. We recommend using the latest version. Other type checkers may work as well, but they are not officially verified to work by pytest yet.

    • #4049: Introduced a new hook named pytest_warning_recorded to convey information about warnings captured by the internal pytest warnings plugin.

      This hook is meant to replace pytest_warning_captured, which is deprecated and will be removed in a future release.

    • #6471: New command-line flags:

      • `--no-header`: disables the initial header, including platform, version, and plugins.
      • `--no-summary`: disables the final test summary, including warnings.
    • #6856: A warning is now shown when an unknown key is read from a config INI file.

      The --strict-config flag has been added to treat these warnings as errors.

    • #6906: Added --code-highlight command line option to enable/disable code highlighting in terminal output.

    • #7245: New --import-mode=importlib option that uses importlib to import test modules.

      Traditionally pytest used __import__ while changing sys.path to import test modules (which also changes sys.modules as a side-effect), which works but has a number of drawbacks, like requiring test modules that don't live in packages to have unique names (as they need to reside under a unique name in sys.modules).

      --import-mode=importlib uses more fine grained import mechanisms from importlib which don't require pytest to change sys.path or sys.modules at all, eliminating much of the drawbacks of the previous mode.

      We intend to make --import-mode=importlib the default in future versions, so users are encouraged to try the new mode and provide feedback (both positive or negative) in issue #7245.

      You can read more about this option in the documentation.

    • #7305: New required_plugins configuration option allows the user to specify a list of plugins, including version information, that are required for pytest to run. An error is raised if any required plugins are not found when running pytest.

    Improvements

    • #4375: The pytest command now suppresses the BrokenPipeError error message that is printed to stderr when the output of pytest is piped and and the pipe is closed by the piped-to program (common examples are less and head).

    • #4391: Improved precision of test durations measurement. CallInfo items now have a new <CallInfo>.duration attribute, created using time.perf_counter(). This attribute is used to fill the <TestReport>.duration attribute, which is more accurate than the previous <CallInfo>.stop - <CallInfo>.start (as these are based on time.time()).

    • #4675: Rich comparison for dataclasses and attrs-classes is now recursive.

    • #6285: Exposed the pytest.FixtureLookupError exception which is raised by request.getfixturevalue() (where request is a FixtureRequest fixture) when a fixture with the given name cannot be returned.

    • #6433: If an error is encountered while formatting the message in a logging call, for example logging.warning("oh no!: %s: %s", "first") (a second argument is missing), pytest now propagates the error, likely causing the test to fail.

      Previously, such a mistake would cause an error to be printed to stderr, which is not displayed by default for passing tests. This change makes the mistake visible during testing.

      You may supress this behavior temporarily or permanently by setting logging.raiseExceptions = False.

    • #6817: Explicit new-lines in help texts of command-line options are preserved, allowing plugins better control of the help displayed to users.

    • #6940: When using the --duration option, the terminal message output is now more precise about the number and duration of hidden items.

    • #6991: Collected files are displayed after any reports from hooks, e.g. the status from --lf.

    • #7091: When fd capturing is used, through --capture=fd or the capfd and capfdbinary fixtures, and the file descriptor (0, 1, 2) cannot be duplicated, FD capturing is still performed. Previously, direct writes to the file descriptors would fail or be lost in this case.

    • #7119: Exit with an error if the --basetemp argument is empty, is the current working directory or is one of the parent directories. This is done to protect against accidental data loss, as any directory passed to this argument is cleared.

    • #7128: pytest --version now displays just the pytest version, while pytest --version --version displays more verbose information including plugins. This is more consistent with how other tools show --version.

    • #7133: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> will now override any log_level set via the CLI or configuration file.

    • #7159: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> and caplog.at_level() <_pytest.logging.LogCaptureFixture.at_level> no longer affect the level of logs that are shown in the Captured log report report section.

    • #7348: Improve recursive diff report for comparison asserts on dataclasses / attrs.

    • #7385: --junitxml now includes the exception cause in the message XML attribute for failures during setup and teardown.

      Previously:

      <error message="test setup failure">
      

      Now:

      <error message="failed on setup with &quot;ValueError: Some error during setup&quot;">
      

    Bug Fixes

    • #1120: Fix issue where directories from tmpdir are not removed properly when multiple instances of pytest are running in parallel.

    • #4583: Prevent crashing and provide a user-friendly error when a marker expression (-m) invoking of eval raises any exception.

    • #4677: The path shown in the summary report for SKIPPED tests is now always relative. Previously it was sometimes absolute.

    • #5456: Fix a possible race condition when trying to remove lock files used to control access to folders created by tmp_path and tmpdir.

    • #6240: Fixes an issue where logging during collection step caused duplication of log messages to stderr.

    • #6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.

    • #6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.

    • #6871: Fix crash with captured output when using capsysbinary.

    • #6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

      The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.

    • #6910: Fix crash when plugins return an unknown stats while using the --reportlog option.

    • #6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.

    • #6925: Fix TerminalRepr instances to be hashable again.

    • #6947: Fix regression where functions registered with unittest.TestCase.addCleanup were not being called on test failures.

    • #6951: Allow users to still set the deprecated TerminalReporter.writer attribute.

    • #6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.

    • #6991: Fix regressions with --lf filtering too much since pytest 5.4.

    • #6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.

    • #7061: When a yielding fixture fails to yield a value, report a test setup error instead of crashing.

    • #7076: The path of file skipped by @pytest.mark.skip in the SKIPPED report is now relative to invocation directory. Previously it was relative to root directory.

    • #7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.

    • #7126: --setup-show now doesn't raise an error when a bytes value is used as a parametrize parameter when Python is called with the -bb flag.

    • #7143: Fix pytest.File.from_parent so it forwards extra keyword arguments to the constructor.

    • #7145: Classes with broken __getattribute__ methods are displayed correctly during failures.

    • #7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.

    • #7180: Fix _is_setup_py for files encoded differently than locale.

    • #7215: Fix regression where running with --pdb would call unittest.TestCase.tearDown for skipped tests.

    • #7253: When using pytest.fixture on a function directly, as in pytest.fixture(func), if the autouse or params arguments are also passed, the function is no longer ignored, but is marked as a fixture.

    • #7360: Fix possibly incorrect evaluation of string expressions passed to pytest.mark.skipif and pytest.mark.xfail, in rare circumstances where the exact same string is used but refers to different global values.

    • #7383: Fixed exception causes all over the codebase, i.e. use raise new_exception from old_exception when wrapping an exception.

    Improved Documentation

    • #7202: The development guide now links to the contributing section of the docs and RELEASING.rst on GitHub.
    • #7233: Add a note about --strict and --strict-markers and the preference for the latter one.
    • #7345: Explain indirect parametrization and markers for fixtures.

    Trivial/Internal Changes

    • #7035: The originalname attribute of _pytest.python.Function now defaults to name if not provided explicitly, and is always set.
    • #7264: The dependency on the wcwidth package has been removed.
    • #7291: Replaced py.iniconfig with iniconfig.
    • #7295: src/_pytest/config/__init__.py now uses the warnings module to report warnings instead of sys.stderr.write.
    • #7356: Remove last internal uses of deprecated slave term from old pytest-xdist.
    • #7357: py>=1.8.2 is now required.
    Source code(tar.gz)
    Source code(zip)
  • 6.0.0rc1(Aug 28, 2020)

    pytest 6.0.0rc1 (2020-07-08)

    Breaking Changes

    • #1316: TestReport.longrepr is now always an instance of ReprExceptionInfo. Previously it was a str when a test failed with pytest.fail(..., pytrace=False).

    • #5965: symlinks are no longer resolved during collection and matching conftest.py files with test file paths.

      Resolving symlinks for the current directory and during collection was introduced as a bugfix in 3.9.0, but it actually is a new feature which had unfortunate consequences in Windows and surprising results in other platforms.

      The team decided to step back on resolving symlinks at all, planning to review this in the future with a more solid solution (see discussion in #6523 for details).

      This might break test suites which made use of this feature; the fix is to create a symlink for the entire test tree, and not only to partial files/tress as it was possible previously.

    • #6505: Testdir.run().parseoutcomes() now always returns the parsed nouns in plural form.

      Originally parseoutcomes() would always returns the nouns in plural form, but a change meant to improve the terminal summary by using singular form single items (1 warning or 1 error) caused an unintended regression by changing the keys returned by parseoutcomes().

      Now the API guarantees to always return the plural form, so calls like this:

      result = testdir.runpytest()
      result.assert_outcomes(error=1)
      

      Need to be changed to:

      result = testdir.runpytest()
      result.assert_outcomes(errors=1)
      
    • #6903: The os.dup() function is now assumed to exist. We are not aware of any supported Python 3 implementations which do not provide it.

    • #7040: -k no longer matches against the names of the directories outside the test session root.

      Also, pytest.Package.name is now just the name of the directory containing the package's __init__.py file, instead of the full path. This is consistent with how the other nodes are named, and also one of the reasons why -k would match against any directory containing the test suite.

    • #7122: Expressions given to the -m and -k options are no longer evaluated using Python's eval. The format supports or, and, not, parenthesis and general identifiers to match against. Python constants, keywords or other operators are no longer evaluated differently.

    • #7135: Pytest now uses its own TerminalWriter class instead of using the one from the py library. Plugins generally access this class through TerminalReporter.writer, TerminalReporter.write() (and similar methods), or _pytest.config.create_terminal_writer().

      The following breaking changes were made:

      • Output (write() method and others) no longer flush implicitly; the flushing behavior of the underlying file is respected. To flush explicitly (for example, if you want output to be shown before an end-of-line is printed), use write(flush=True) or terminal_writer.flush().
      • Explicit Windows console support was removed, delegated to the colorama library.
      • Support for writing bytes was removed.
      • The reline method and chars_on_current_line property were removed.
      • The stringio and encoding arguments was removed.
      • Support for passing a callable instead of a file was removed.
    • #7224: The item.catch_log_handler and item.catch_log_handlers attributes, set by the logging plugin and never meant to be public , are no longer available.

      The deprecated --no-print-logs option is removed. Use --show-capture instead.

    • #7226: Removed the unused args parameter from pytest.Function.__init__.

    • #7418: Removed the pytest_doctest_prepare_content hook specification. This hook hasn't been triggered by pytest for at least 10 years.

    • #7438: Some changes were made to the internal _pytest._code.source, listed here for the benefit of plugin authors who may be using it:

      • The deindent argument to Source() has been removed, now it is always true.
      • Support for zero or multiple arguments to Source() has been removed.
      • Support for comparing Source with an str has been removed.
      • The methods Source.isparseable() and Source.putaround() have been removed.
      • The method Source.compile() and function _pytest._code.compile() have been removed; use plain compile() instead.
      • The function _pytest._code.source.getsource() has been removed; use Source() directly instead.

    Deprecations

    • #7210: The special -k '-expr' syntax to -k is deprecated. Use -k 'not expr' instead.

      The special -k 'expr:' syntax to -k is deprecated. Please open an issue if you use this and want a replacement.

    • #4049: pytest_warning_captured is deprecated in favor of the pytest_warning_recorded hook.

    Features

    • #1556: pytest now supports pyproject.toml files for configuration.

      The configuration options is similar to the one available in other formats, but must be defined in a [tool.pytest.ini_options] table to be picked up by pytest:

      # pyproject.toml
      [tool.pytest.ini_options]
      minversion = "6.0"
      addopts = "-ra -q"
      testpaths = [
          "tests",
          "integration",
      ]
      

      More information can be found in the docs.

    • #3342: pytest now includes inline type annotations and exposes them to user programs. Most of the user-facing API is covered, as well as internal code.

      If you are running a type checker such as mypy on your tests, you may start noticing type errors indicating incorrect usage. If you run into an error that you believe to be incorrect, please let us know in an issue.

      The types were developed against mypy version 0.780. Versions before 0.750 are known not to work. We recommend using the latest version. Other type checkers may work as well, but they are not officially verified to work by pytest yet.

    • #4049: Introduced a new hook named pytest_warning_recorded to convey information about warnings captured by the internal pytest warnings plugin.

      This hook is meant to replace pytest_warning_captured, which is deprecated and will be removed in a future release.

    • #6471: New command-line flags:

      • `--no-header`: disables the initial header, including platform, version, and plugins.
      • `--no-summary`: disables the final test summary, including warnings.
    • #6856: A warning is now shown when an unknown key is read from a config INI file.

      The --strict-config flag has been added to treat these warnings as errors.

    • #6906: Added --code-highlight command line option to enable/disable code highlighting in terminal output.

    • #7245: New --import-mode=importlib option that uses importlib to import test modules.

      Traditionally pytest used __import__ while changing sys.path to import test modules (which also changes sys.modules as a side-effect), which works but has a number of drawbacks, like requiring test modules that don't live in packages to have unique names (as they need to reside under a unique name in sys.modules).

      --import-mode=importlib uses more fine grained import mechanisms from importlib which don't require pytest to change sys.path or sys.modules at all, eliminating much of the drawbacks of the previous mode.

      We intend to make --import-mode=importlib the default in future versions, so users are encouraged to try the new mode and provide feedback (both positive or negative) in issue #7245.

      You can read more about this option in the documentation.

    • #7305: New required_plugins configuration option allows the user to specify a list of plugins, including version information, that are required for pytest to run. An error is raised if any required plugins are not found when running pytest.

    Improvements

    • #4375: The pytest command now suppresses the BrokenPipeError error message that is printed to stderr when the output of pytest is piped and and the pipe is closed by the piped-to program (common examples are less and head).

    • #4391: Improved precision of test durations measurement. CallInfo items now have a new <CallInfo>.duration attribute, created using time.perf_counter(). This attribute is used to fill the <TestReport>.duration attribute, which is more accurate than the previous <CallInfo>.stop - <CallInfo>.start (as these are based on time.time()).

    • #4675: Rich comparison for dataclasses and attrs-classes is now recursive.

    • #6285: Exposed the pytest.FixtureLookupError exception which is raised by request.getfixturevalue() (where request is a FixtureRequest fixture) when a fixture with the given name cannot be returned.

    • #6433: If an error is encountered while formatting the message in a logging call, for example logging.warning("oh no!: %s: %s", "first") (a second argument is missing), pytest now propagates the error, likely causing the test to fail.

      Previously, such a mistake would cause an error to be printed to stderr, which is not displayed by default for passing tests. This change makes the mistake visible during testing.

      You may supress this behavior temporarily or permanently by setting logging.raiseExceptions = False.

    • #6817: Explicit new-lines in help texts of command-line options are preserved, allowing plugins better control of the help displayed to users.

    • #6940: When using the --duration option, the terminal message output is now more precise about the number and duration of hidden items.

    • #6991: Collected files are displayed after any reports from hooks, e.g. the status from --lf.

    • #7091: When fd capturing is used, through --capture=fd or the capfd and capfdbinary fixtures, and the file descriptor (0, 1, 2) cannot be duplicated, FD capturing is still performed. Previously, direct writes to the file descriptors would fail or be lost in this case.

    • #7119: Exit with an error if the --basetemp argument is empty, is the current working directory or is one of the parent directories. This is done to protect against accidental data loss, as any directory passed to this argument is cleared.

    • #7128: pytest --version now displays just the pytest version, while pytest --version --version displays more verbose information including plugins. This is more consistent with how other tools show --version.

    • #7133: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> will now override any log_level set via the CLI or configuration file.

    • #7159: caplog.set_level() <_pytest.logging.LogCaptureFixture.set_level> and caplog.at_level() <_pytest.logging.LogCaptureFixture.at_level> no longer affect the level of logs that are shown in the Captured log report report section.

    • #7348: Improve recursive diff report for comparison asserts on dataclasses / attrs.

    • #7385: --junitxml now includes the exception cause in the message XML attribute for failures during setup and teardown.

      Previously:

      <error message="test setup failure">
      

      Now:

      <error message="failed on setup with &quot;ValueError: Some error during setup&quot;">
      

    Bug Fixes

    • #1120: Fix issue where directories from tmpdir are not removed properly when multiple instances of pytest are running in parallel.

    • #4583: Prevent crashing and provide a user-friendly error when a marker expression (-m) invoking of eval raises any exception.

    • #4677: The path shown in the summary report for SKIPPED tests is now always relative. Previously it was sometimes absolute.

    • #5456: Fix a possible race condition when trying to remove lock files used to control access to folders created by tmp_path and tmpdir.

    • #6240: Fixes an issue where logging during collection step caused duplication of log messages to stderr.

    • #6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.

    • #6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.

    • #6871: Fix crash with captured output when using capsysbinary.

    • #6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

      The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.

    • #6910: Fix crash when plugins return an unknown stats while using the --reportlog option.

    • #6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.

    • #6925: Fix TerminalRepr instances to be hashable again.

    • #6947: Fix regression where functions registered with unittest.TestCase.addCleanup were not being called on test failures.

    • #6951: Allow users to still set the deprecated TerminalReporter.writer attribute.

    • #6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.

    • #6991: Fix regressions with --lf filtering too much since pytest 5.4.

    • #6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.

    • #7061: When a yielding fixture fails to yield a value, report a test setup error instead of crashing.

    • #7076: The path of file skipped by @pytest.mark.skip in the SKIPPED report is now relative to invocation directory. Previously it was relative to root directory.

    • #7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.

    • #7126: --setup-show now doesn't raise an error when a bytes value is used as a parametrize parameter when Python is called with the -bb flag.

    • #7143: Fix pytest.File.from_parent so it forwards extra keyword arguments to the constructor.

    • #7145: Classes with broken __getattribute__ methods are displayed correctly during failures.

    • #7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.

    • #7180: Fix _is_setup_py for files encoded differently than locale.

    • #7215: Fix regression where running with --pdb would call unittest.TestCase.tearDown for skipped tests.

    • #7253: When using pytest.fixture on a function directly, as in pytest.fixture(func), if the autouse or params arguments are also passed, the function is no longer ignored, but is marked as a fixture.

    • #7360: Fix possibly incorrect evaluation of string expressions passed to pytest.mark.skipif and pytest.mark.xfail, in rare circumstances where the exact same string is used but refers to different global values.

    • #7383: Fixed exception causes all over the codebase, i.e. use raise new_exception from old_exception when wrapping an exception.

    Improved Documentation

    • #7202: The development guide now links to the contributing section of the docs and RELEASING.rst on GitHub.
    • #7233: Add a note about --strict and --strict-markers and the preference for the latter one.
    • #7345: Explain indirect parametrization and markers for fixtures.

    Trivial/Internal Changes

    • #7035: The originalname attribute of _pytest.python.Function now defaults to name if not provided explicitly, and is always set.
    • #7264: The dependency on the wcwidth package has been removed.
    • #7291: Replaced py.iniconfig with iniconfig.
    • #7295: src/_pytest/config/__init__.py now uses the warnings module to report warnings instead of sys.stderr.write.
    • #7356: Remove last internal uses of deprecated slave term from old pytest-xdist.
    • #7357: py>=1.8.2 is now required.
    Source code(tar.gz)
    Source code(zip)
  • 4.6.11(Jun 5, 2020)

    Bug Fixes

    • #6334: Fix summary entries appearing twice when f/F and s/S report chars were used at the same time in the -r command-line option (for example -rFf).

      The upper case variants were never documented and the preferred form should be the lower case.

    • #7310: Fix UnboundLocalError: local variable 'letter' referenced before assignment in _pytest.terminal.pytest_report_teststatus() when plugins return report objects in an unconventional state.

      This was making pytest_report_teststatus() skip entering if-block branches that declare the letter variable.

      The fix was to set the initial value of the letter before the if-block cascade so that it always has a value.

    Source code(tar.gz)
    Source code(zip)
  • 5.4.3(Jun 2, 2020)

    pytest 5.4.3 (2020-06-02)

    Bug Fixes

    • #6428: Paths appearing in error messages are now correct in case the current working directory has changed since the start of the session.
    • #6755: Support deleting paths longer than 260 characters on windows created inside tmpdir.
    • #6956: Prevent pytest from printing ConftestImportFailure traceback to stdout.
    • #7150: Prevent hiding the underlying exception when ConfTestImportFailure is raised.
    • #7215: Fix regression where running with --pdb would call the tearDown methods of unittest.TestCase subclasses for skipped tests.
    Source code(tar.gz)
    Source code(zip)
  • 5.4.2(May 8, 2020)

    pytest 5.4.2 (2020-05-08)

    Bug Fixes

    • #6871: Fix crash with captured output when using the capsysbinary fixture <capsysbinary>.
    • #6924: Ensure a unittest.IsolatedAsyncioTestCase is actually awaited.
    • #6925: Fix TerminalRepr instances to be hashable again.
    • #6947: Fix regression where functions registered with TestCase.addCleanup were not being called on test failures.
    • #6951: Allow users to still set the deprecated TerminalReporter.writer attribute.
    • #6992: Revert "tmpdir: clean up indirection via config for factories" #6767 as it breaks pytest-xdist.
    • #7110: Fixed regression: asyncbase.TestCase tests are executed correctly again.
    • #7143: Fix File.from_constructor so it forwards extra keyword arguments to the constructor.
    • #7145: Classes with broken __getattribute__ methods are displayed correctly during failures.
    • #7180: Fix _is_setup_py for files encoded differently than locale.
    Source code(tar.gz)
    Source code(zip)
  • 4.6.10(Jun 5, 2020)

    • #6870: New Config.invocation_args attribute containing the unchanged arguments passed to pytest.main().

      Remark: while this is technically a new feature and according to our policy it should not have been backported, we have opened an exception in this particular case because it fixes a serious interaction with pytest-xdist, so it can also be considered a bugfix.

    Source code(tar.gz)
    Source code(zip)
  • 5.4.1(Mar 13, 2020)

    pytest 5.4.1 (2020-03-13)

    Bug Fixes

    • #6909: Revert the change introduced by #6330, which required all arguments to @pytest.mark.parametrize to be explicitly defined in the function signature.

      The intention of the original change was to remove what was expected to be an unintended/surprising behavior, but it turns out many people relied on it, so the restriction has been reverted.

    • #6910: Fix crash when plugins return an unknown stats while using the --reportlog option.

    Source code(tar.gz)
    Source code(zip)
  • 5.4.0(Mar 12, 2020)

    Breaking Changes

    • #6316: Matching of -k EXPRESSION to test names is now case-insensitive.

    • #6443: Plugins specified with -p are now loaded after internal plugins, which results in their hooks being called before the internal ones.

      This makes the -p behavior consistent with PYTEST_PLUGINS.

    • #6637: Removed the long-deprecated pytest_itemstart hook.

      This hook has been marked as deprecated and not been even called by pytest for over 10 years now.

    • #6673: Reversed / fix meaning of "+/-" in error diffs. "-" means that sth. expected is missing in the result and "+" means that there are unexpected extras in the result.

    • #6737: The cached_result attribute of FixtureDef is now set to None when the result is unavailable, instead of being deleted.

      If your plugin performs checks like hasattr(fixturedef, 'cached_result'), for example in a pytest_fixture_post_finalizer hook implementation, replace it with fixturedef.cached_result is not None. If you del the attribute, set it to None instead.

    Deprecations

    • #3238: Option --no-print-logs is deprecated and meant to be removed in a future release. If you use --no-print-logs, please try out --show-capture and provide feedback.

      --show-capture command-line option was added in pytest 3.5.0 and allows to specify how to display captured output when tests fail: no, stdout, stderr, log or all (the default).

    • #571: Deprecate the unused/broken [pytest_collect_directory]{.title-ref} hook. It was misaligned since the removal of the Directory collector in 2010 and incorrect/unusable as soon as collection was split from test execution.

    • #5975: Deprecate using direct constructors for Nodes.

      Instead they are new constructed via Node.from_parent.

      This transitional mechanism enables us to detangle the very intensely entangled Node relationships by enforcing more controlled creation/configruation patterns.

      As part of that session/config are already disallowed parameters and as we work on the details we might need disallow a few more as well.

      Subclasses are expected to use [super().from_parent]{.title-ref} if they intend to expand the creation of [Nodes]{.title-ref}.

    • #6779: The TerminalReporter.writer attribute has been deprecated and should no longer be used. This was inadvertently exposed as part of the public API of that plugin and ties it too much with py.io.TerminalWriter.

    Features

    • #4597: New --capture=tee-sys <capture-method>{.interpreted-text role="ref"} option to allow both live printing and capturing of test output.
    • #5712: Now all arguments to @pytest.mark.parametrize need to be explicitly declared in the function signature or via indirect. Previously it was possible to omit an argument if a fixture with the same name existed, which was just an accident of implementation and was not meant to be a part of the API.
    • #6454: Changed default for [-r]{.title-ref} to [fE]{.title-ref}, which displays failures and errors in the short test summary <pytest.detailed_failed_tests_usage>{.interpreted-text role="ref"}. [-rN]{.title-ref} can be used to disable it (the old behavior).
    • #6469: New options have been added to the junit_logging{.interpreted-text role="confval"} option: log, out-err, and all.
    • #6834: Excess warning summaries are now collapsed per file to ensure readable display of warning summaries.

    Improvements

    • #1857: pytest.mark.parametrize accepts integers for ids again, converting it to strings.

    • #449: Use "yellow" main color with any XPASSED tests.

    • #4639: Revert "A warning is now issued when assertions are made for None".

      The warning proved to be less useful than initially expected and had quite a few false positive cases.

    • #5686: tmpdir_factory.mktemp now fails when given absolute and non-normalized paths.

    • #5984: The pytest_warning_captured hook now receives a location parameter with the code location that generated the warning.

    • #6213: pytester: the testdir fixture respects environment settings from the monkeypatch fixture for inner runs.

    • #6247: --fulltrace is honored with collection errors.

    • #6384: Make [--showlocals]{.title-ref} work also with [--tb=short]{.title-ref}.

    • #6653: Add support for matching lines consecutively with LineMatcher <_pytest.pytester.LineMatcher>{.interpreted-text role="attr"}'s ~_pytest.pytester.LineMatcher.fnmatch_lines{.interpreted-text role="func"} and ~_pytest.pytester.LineMatcher.re_match_lines{.interpreted-text role="func"}.

    • #6658: Code is now highlighted in tracebacks when pygments is installed.

      Users are encouraged to install pygments into their environment and provide feedback, because the plan is to make pygments a regular dependency in the future.

    • #6795: Import usage error message with invalid [-o]{.title-ref} option.

    • #759: pytest.mark.parametrize supports iterators and generators for ids.

    Bug Fixes

    • #310: Add support for calling [pytest.xfail()]{.title-ref} and [pytest.importorskip()]{.title-ref} with doctests.

    • #3823: --trace now works with unittests.

    • #4445: Fixed some warning reports produced by pytest to point to the correct location of the warning in the user's code.

    • #5301: Fix --last-failed to collect new tests from files with known failures.

    • #5928: Report PytestUnknownMarkWarning at the level of the user's code, not pytest's.

    • #5991: Fix interaction with --pdb and unittests: do not use unittest's TestCase.debug().

    • #6334: Fix summary entries appearing twice when f/F and s/S report chars were used at the same time in the -r command-line option (for example -rFf).

      The upper case variants were never documented and the preferred form should be the lower case.

    • #6409: Fallback to green (instead of yellow) for non-last items without previous passes with colored terminal progress indicator.

    • #6454: [--disable-warnings]{.title-ref} is honored with [-ra]{.title-ref} and [-rA]{.title-ref}.

    • #6497: Fix bug in the comparison of request key with cached key in fixture.

      A construct if key == cached_key: can fail either because == is explicitly disallowed, or for, e.g., NumPy arrays, where the result of a == b cannot generally be converted to [bool]{.title-ref}. The implemented fix replaces [==]{.title-ref} with is.

    • #6557: Make capture output streams .write() method return the same return value from original streams.

    • #6566: Fix EncodedFile.writelines to call the underlying buffer's writelines method.

    • #6575: Fix internal crash when faulthandler starts initialized (for example with PYTHONFAULTHANDLER=1 environment variable set) and faulthandler_timeout defined in the configuration file.

    • #6597: Fix node ids which contain a parametrized empty-string variable.

    • #6646: Assertion rewriting hooks are (re)stored for the current item, which fixes them being still used after e.g. pytester's testdir.runpytest <_pytest.pytester.Testdir.runpytest>{.interpreted-text role="func"} etc.

    • #6660: pytest.exit() <_pytest.outcomes.exit>{.interpreted-text role="func"} is handled when emitted from the pytest_sessionfinish <_pytest.hookspec.pytest_sessionfinish>{.interpreted-text role="func"} hook. This includes quitting from a debugger.

    • #6752: When :pypytest.raises{.interpreted-text role="func"} is used as a function (as opposed to a context manager), a [match]{.title-ref} keyword argument is now passed through to the tested function. Previously it was swallowed and ignored (regression in pytest 5.1.0).

    • #6801: Do not display empty lines inbetween traceback for unexpected exceptions with doctests.

    • #6802: The testdir fixture <testdir>{.interpreted-text role="fixture"} works within doctests now.

    Improved Documentation

    • #6696: Add list of fixtures to start of fixture chapter.
    • #6742: Expand first sentence on fixtures into a paragraph.

    Trivial/Internal Changes

    • #6404: Remove usage of parser module, deprecated in Python 3.9.
    Source code(tar.gz)
    Source code(zip)
  • 5.3.5(Jan 29, 2020)

  • 5.3.4(Jan 20, 2020)

    pytest 5.3.4 (2020-01-20)

    Bug Fixes

    • #6496: Revert #6436: unfortunately this change has caused a number of regressions in many suites, so the team decided to revert this change and make a new release while we continue to look for a solution.
    Source code(tar.gz)
    Source code(zip)
  • 5.3.3(Jan 17, 2020)

    pytest 5.3.3 (2020-01-16)

    Bug Fixes

    • #2780: Captured output during teardown is shown with -rP.
    • #5971: Fix a pytest-xdist crash when dealing with exceptions raised in subprocesses created by the multiprocessing module.
    • #6436: FixtureDef <_pytest.fixtures.FixtureDef> objects now properly register their finalizers with autouse and parameterized fixtures that execute before them in the fixture stack so they are torn down at the right times, and in the right order.
    • #6532: Fix parsing of outcomes containing multiple errors with testdir results (regression in 5.3.0).

    Trivial/Internal Changes

    • #6350: Optimized automatic renaming of test parameter IDs.
    Source code(tar.gz)
    Source code(zip)
django-quill-editor makes Quill.js easy to use on Django Forms and admin sites

django-quill-editor django-quill-editor makes Quill.js easy to use on Django Forms and admin sites No configuration required for static files! The ent

lhy 139 Dec 5, 2022
Django-Audiofield is a simple app that allows Audio files upload, management and conversion to different audio format (mp3, wav & ogg), which also makes it easy to play audio files into your Django application.

Django-Audiofield Description: Django Audio Management Tools Maintainer: Areski Contributors: list of contributors Django-Audiofield is a simple app t

Areski Belaid 167 Nov 10, 2022
A music recommendation REST API which makes a machine learning algorithm work with the Django REST Framework

music-recommender-rest-api A music recommendation REST API which makes a machine learning algorithm work with the Django REST Framework How it works T

The Reaper 1 Sep 28, 2021
Run Django tests with testcontainers.

django-rdtwt (Run Django Tests With Testcontainers) This targets users who wish to forget setting up a database for tests. There's no manually startin

null 2 Jan 9, 2022
Simple yet powerful and really extendable application for managing a blog within your Django Web site.

Django Blog Zinnia Simple yet powerful and really extendable application for managing a blog within your Django Web site. Zinnia has been made for pub

Julien Fache 2.1k Dec 24, 2022
Yet another Django audit log app, hopefully the simplest one.

django-easy-audit Yet another Django audit log app, hopefully the easiest one. This app allows you to keep track of every action taken by your users.

Natán 510 Jan 2, 2023
Realtime data read and write without page refresh using Ajax in Django.

Realtime read-write with AJAX Hey,this is the basic implementation type of ajax realtime read write from the database. where you can insert or view re

Mehedi Hasan 3 Dec 13, 2022
django Filer is a file management application for django that makes handling of files and images a breeze.

django Filer is a file management application for django that makes handling of files and images a breeze.

django CMS Association 1.6k Jan 6, 2023
A small and lightweight imageboard written with Django

Yuu A small and lightweight imageboard written with Django. What are the requirements? Python 3.7.x PostgreSQL 14.x Redis 5.x FFmpeg 4.x Why? I don't

mint.lgbt 1 Oct 30, 2021
Django friendly finite state machine support

Django friendly finite state machine support django-fsm adds simple declarative state management for django models. If you need parallel task executio

Viewflow 2.1k Dec 31, 2022
Django-MySQL extends Django's built-in MySQL and MariaDB support their specific features not available on other databases.

Django-MySQL The dolphin-pony - proof that cute + cute = double cute. Django-MySQL extends Django's built-in MySQL and MariaDB support their specific

Adam Johnson 504 Jan 4, 2023
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:

Stream Framework Activity Streams & Newsfeeds Stream Framework is a Python library which allows you to build activity streams & newsfeeds using Cassan

Thierry Schellenbach 4.7k Jan 2, 2023
django-dashing is a customisable, modular dashboard application framework for Django to visualize interesting data about your project. Inspired in the dashboard framework Dashing

django-dashing django-dashing is a customisable, modular dashboard application framework for Django to visualize interesting data about your project.

talPor Solutions 703 Dec 22, 2022
Easy thumbnails for Django

Easy Thumbnails A powerful, yet easy to implement thumbnailing application for Django 1.11+ Below is a quick summary of usage. For more comprehensive

Chris Beaven 1.3k Dec 30, 2022
Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

Dave Hall 1.1k Dec 22, 2022
🏭 An easy-to-use implementation of Creation Methods for Django, backed by Faker.

Django-fakery An easy-to-use implementation of Creation Methods (aka Object Factory) for Django, backed by Faker. django_fakery will try to guess the

Flavio Curella 93 Oct 12, 2022
This is a repository for collecting global custom management extensions for the Django Framework.

Django Extensions Django Extensions is a collection of custom extensions for the Django Framework. Getting Started The easiest way to figure out what

Django Extensions 6k Dec 26, 2022
django-reversion is an extension to the Django web framework that provides version control for model instances.

django-reversion django-reversion is an extension to the Django web framework that provides version control for model instances. Requirements Python 3

Dave Hall 2.8k Jan 2, 2023
Cookiecutter Django is a framework for jumpstarting production-ready Django projects quickly.

Cookiecutter Django Powered by Cookiecutter, Cookiecutter Django is a framework for jumpstarting production-ready Django projects quickly. Documentati

Daniel Feldroy 10k Dec 31, 2022