Commit graph

2233 commits

Author SHA1 Message Date
Tomas Babej
83f71520d2
tests: Make faketime tests less susceptible to race conditions
The duration can be 10:01 if the original task call happened a split
second before the faketime fixation of +10 minutes.

Use more relaxed regular expresison to check.
2020-12-06 12:00:38 -05:00
Tomas Babej
ee15bfa1db
tests: Skip the diagnostics test on Ubuntu 16.04
This is a byproduct of recent bump to C++17 compliant compilers. Ubuntu
16.04 does not have C++17 compliant compiler, but it's still useful to
for us to test 2.5.3 there as the branch does not actually use any of
the C++17 features not available on gcc on Ubuntu.
2020-12-06 11:48:41 -05:00
Tomas Babej
c6ec416e30
ci: Rename Arch container to make it clear we're testing on rolling base 2020-12-06 10:09:53 -05:00
Tomas Babej
9a193e26ec
ci: Add support for CentOS 8 2020-12-06 10:09:46 -05:00
Tomas Babej
2657880ff3
ci: Replace F28 and F29 with F31, F32 and F33 2020-12-06 10:09:39 -05:00
Tomas Babej
497262d23c
ci: Add Ubuntu 20.04 2020-12-06 10:09:31 -05:00
Tomas Babej
1b745bc505
ci: Properly setup en_US.UTF-8 locale for Ubuntu containers 2020-12-06 10:09:20 -05:00
Max Rossmannek
2620714b43
Fix Arch docker image 2020-12-06 10:01:54 -05:00
Max Rossmannek
4ebf611b91
Fix faketime packages 2020-12-06 10:01:45 -05:00
Max Rossmannek
862ae0b969
Replace libfaketime with faketime in debianstable
I verified locally that this avoids skipping all of the
faketime-dependent unittests. The Travis CI logs will have to be
investigated for all of the other docker images on which distros we may
need to apply a similar fix.
2020-12-06 10:01:30 -05:00
Max Rossmannek
b634dea7ab
Attempt greedy docker config update
This is an attempt at updating all docker configurations by simply
replacing the `python` packages with `python3`. The Travis CI will let
us know if this works.
2020-12-06 10:01:19 -05:00
Max Rossmannek
2931be613b
Enforce Python 3 in test_hooks/wrapper
This change was not included in the previous commit because the sed
command I used included the `/usr/bin/env` path to ensure I don't
replace any occurences of the word `python` which I did not wish to
replace.
2020-12-06 10:01:09 -05:00
Max Rossmannek
6d2ecaa15c
Enforce Python 3 for unittests
This commit updates all tests to enforce the Python3 executable. This is
necessary because the `assertRegex` function we use was renamed to this
name only in Python 3.2 [1]

For reference:
s;/usr/bin/env python;/usr/bin/env python3;g

[1]: https://docs.python.org/3/library/unittest.html#unittest.TestCase.assertRegex
2020-12-06 10:00:59 -05:00
Tomas Babej
a8c215774b
tests: Implement mechanism for expected failures in C++ tests
Implements detection of unexpected successes and expected failures. Both
classes are represented in the TAP output as 'not ok', unexpected
successes with '# FIXED' metadata and expected failures as '# TODO'.

This brings C++ tests to feature parity with Python-based ones when it
comes to expected failures and unexpected successes.
2020-12-06 09:56:37 -05:00
Tomas Babej
cd1d42bc9d
tests: Mark failing corner case tests as expected for 2.5.2 2020-12-05 16:40:28 -05:00
mrossinek
4f14b8923f Fix variant_subtract test case after PR #2095 2020-11-24 08:12:39 -05:00
Max Rossmannek
cad9a4f834 Update diag.t to correct C++ version
The default C++ version was updated in 4729876 and this commit reflects
this change in the test.
2020-11-24 08:12:39 -05:00
mrossinek
ca1e2a5a6b Mark project.t 1455 as expected failure 2020-11-24 08:12:39 -05:00
Tomas Babej
79e076c3c0 tests: Use updated unittest method 2020-11-24 08:12:39 -05:00
mrossinek
7d567c3ac9 Fix wait.t to correct expected output 2020-11-24 08:12:39 -05:00
Tomas Babej
351965a87b
Update copyright to 2020 2020-11-21 12:43:40 -05:00
Tomas Babej
d1b867f7b5
tests: Do not require line buffering
Test runner complains about it not being supported with binary files and
it does not look like it affects any tests in the first place anyway.
2020-11-21 12:41:18 -05:00
Tomas Babej
52c49169b4
tests: Use updated unittest methods 2020-11-21 12:39:03 -05:00
Tomas Babej
720c561b75
tests: Use updated Thread object API
Replace isAlive with is_alive as the former is no longer supported in
Python 3.9.
2020-11-21 12:38:14 -05:00
Paul Beckingham
fb97883bef Build: Do not set CMP0037 on CMake 3.11.0 and above
- This policy is no longer necessary because CMake issue #16062, which caused
  incorrect warnings to be shown, has been resolved in 3.11.0.
- Thanks to Janik Rabe
2019-04-26 20:45:46 -04:00
mrossinek
f06eb12d10 Add unit test 2019-04-14 19:45:13 -04:00
Paul Beckingham
b87703eb39 Tests: REmoved check for absence of a segfault
- Testing for the absence of a segfault is not a good test.
2019-03-03 10:50:49 -05:00
Paul Beckingham
863038905c Tests: Version test removed
- Veriying that the diag  command emits the correct commit SHA1 creates
  sporadic failures when CMake has not been run against the current
  commit, and this is not a good test.
2019-03-03 10:34:09 -05:00
Paul Beckingham
2eb488359d Certs: Updated test certs 2019-03-03 10:03:42 -05:00
Paul Beckingham
3c73af7964 Updated Copyright 2019-03-02 14:33:04 -05:00
Paul Beckingham
3313e1f6cc Updated copyright 2019-03-02 14:13:31 -05:00
Paul Beckingham
49a5937ace Test: Updated diag test expectation 2019-03-02 14:03:34 -05:00
Tomas Babej
d457bca59a tests: Add CentOS7 CI testing support 2019-02-07 08:37:59 -05:00
Tomas Babej
8f8a04fdb5 tests: Install libfaketime in all containers 2019-02-07 08:37:59 -05:00
Tomas Babej
a4ce40add4 tests: Improve bytes python3 compatibility 2019-02-07 08:37:59 -05:00
Tomas Babej
b8347821c4 tests: due:yesterday does not match current year on 1st of January 2019-02-07 08:37:59 -05:00
Tomas Babej
3f97a034c7 tests: mkstemp_exec needs argument in bytes 2019-02-07 08:37:59 -05:00
Tomas Babej
74949bb049 tests: Fix incorrect assert method 2019-02-07 08:37:59 -05:00
Tomas Babej
9e7f259d03 tests: Do not use filter objects
The filter objects are not well handled by the unittest framework, pass
a concrete number of occurences instead.
2019-02-07 08:37:59 -05:00
Tomas Babej
b8b06e6680 tests: Encode input data for the subprocess
Needed for Python2/3 compatibility.
2019-02-07 08:37:59 -05:00
Tomas Babej
928befeea2 tests: Use verbose output when running the tests 2019-02-07 08:37:59 -05:00
Tomas Babej
2140298af2 tests: Do not explicitly require Python 2.7 2019-02-07 08:37:59 -05:00
Tomas Babej
adece30891 tests: Add Archlinux 2018 platform 2019-02-07 08:37:59 -05:00
Tomas Babej
012430cfb6 tests: Add OpenSUSE platform 2019-02-07 08:37:59 -05:00
Tomas Babej
0b20a7eef8 tests: Add Debian Testing as a platform 2019-02-07 08:37:59 -05:00
Tomas Babej
82102f59ba tests: Add gentoo platform 2019-02-07 08:37:59 -05:00
Tomas Babej
ea2c4d96b4 tests: Add support for Fedora 29 2019-02-07 08:37:59 -05:00
Tomas Babej
9518cdc1e9 tests: Add testing support for Ubuntu 18.04 2019-02-07 08:37:59 -05:00
Tomas Babej
7153a03a5f tests: Properly set the xtrace flag 2019-02-07 08:37:59 -05:00
Tomas Babej
d748650691 tests: Add OS X test sript 2019-02-07 08:37:59 -05:00