Commit graph

2605 commits

Author SHA1 Message Date
Tomas Babej
59c20a782d
tests: Definition of someday is in year 9999 now 2020-12-28 01:33:49 -05:00
Tomas Babej
7dfff13b06
tests: Allow match for 8 bit color code in color.rules.t
The test proper coloring for overdue task from an hour ago fails,
even though the task is properly colored. This is because the blue color
gets upgraded to blue color in 256-color scheme, and hence is
represented with 38;5;4m instead of 34m.

Support both representations of the blue color in the given test.
2020-12-14 23:13:44 -05:00
Tomas Babej
83a55ccfe5
tests: Add test for coloring an overdue task from earlier today 2020-12-14 22:35:34 -05:00
Tomas Babej
1a52c59356
tests: Add test to ensure 64 bit time_t 2020-12-10 00:51:41 -05:00
Tomas Babej
af5e81434f
tests: Parallelize more when compiling TW 2020-12-10 00:08:44 -05:00
Tomas Babej
ccb222a31b
tests: Make faketime tests less susceptible to race conditions
The duration can be 10:01 if the original task call happened a split
second before the faketime fixation of +10 minutes.

Use more relaxed regular expresison to check.
2020-12-06 12:02:17 -05:00
Tomas Babej
83f71520d2
tests: Make faketime tests less susceptible to race conditions
The duration can be 10:01 if the original task call happened a split
second before the faketime fixation of +10 minutes.

Use more relaxed regular expresison to check.
2020-12-06 12:00:38 -05:00
Tomas Babej
ee15bfa1db
tests: Skip the diagnostics test on Ubuntu 16.04
This is a byproduct of recent bump to C++17 compliant compilers. Ubuntu
16.04 does not have C++17 compliant compiler, but it's still useful to
for us to test 2.5.3 there as the branch does not actually use any of
the C++17 features not available on gcc on Ubuntu.
2020-12-06 11:48:41 -05:00
Max Rossmannek
fdaabcf956
Update diag.t to correct C++ version
The default C++ version was updated in 4729876 and this commit reflects
this change in the test.
2020-12-06 10:50:30 -05:00
Tomas Babej
c6ec416e30
ci: Rename Arch container to make it clear we're testing on rolling base 2020-12-06 10:09:53 -05:00
Tomas Babej
9a193e26ec
ci: Add support for CentOS 8 2020-12-06 10:09:46 -05:00
Tomas Babej
2657880ff3
ci: Replace F28 and F29 with F31, F32 and F33 2020-12-06 10:09:39 -05:00
Tomas Babej
497262d23c
ci: Add Ubuntu 20.04 2020-12-06 10:09:31 -05:00
Tomas Babej
1b745bc505
ci: Properly setup en_US.UTF-8 locale for Ubuntu containers 2020-12-06 10:09:20 -05:00
Max Rossmannek
2620714b43
Fix Arch docker image 2020-12-06 10:01:54 -05:00
Max Rossmannek
4ebf611b91
Fix faketime packages 2020-12-06 10:01:45 -05:00
Max Rossmannek
862ae0b969
Replace libfaketime with faketime in debianstable
I verified locally that this avoids skipping all of the
faketime-dependent unittests. The Travis CI logs will have to be
investigated for all of the other docker images on which distros we may
need to apply a similar fix.
2020-12-06 10:01:30 -05:00
Max Rossmannek
b634dea7ab
Attempt greedy docker config update
This is an attempt at updating all docker configurations by simply
replacing the `python` packages with `python3`. The Travis CI will let
us know if this works.
2020-12-06 10:01:19 -05:00
Max Rossmannek
2931be613b
Enforce Python 3 in test_hooks/wrapper
This change was not included in the previous commit because the sed
command I used included the `/usr/bin/env` path to ensure I don't
replace any occurences of the word `python` which I did not wish to
replace.
2020-12-06 10:01:09 -05:00
Max Rossmannek
6d2ecaa15c
Enforce Python 3 for unittests
This commit updates all tests to enforce the Python3 executable. This is
necessary because the `assertRegex` function we use was renamed to this
name only in Python 3.2 [1]

For reference:
s;/usr/bin/env python;/usr/bin/env python3;g

[1]: https://docs.python.org/3/library/unittest.html#unittest.TestCase.assertRegex
2020-12-06 10:00:59 -05:00
Tomas Babej
a8c215774b
tests: Implement mechanism for expected failures in C++ tests
Implements detection of unexpected successes and expected failures. Both
classes are represented in the TAP output as 'not ok', unexpected
successes with '# FIXED' metadata and expected failures as '# TODO'.

This brings C++ tests to feature parity with Python-based ones when it
comes to expected failures and unexpected successes.
2020-12-06 09:56:37 -05:00
Tomas Babej
af49667adb
ci: Rename Arch container to make it clear we're testing on rolling base 2020-12-06 02:42:10 -05:00
Tomas Babej
a6bbeeaab5
ci: Add support for CentOS 8 2020-12-06 01:55:17 -05:00
Tomas Babej
53e39760ab
ci: Replace F28 and F29 with F31, F32 and F33 2020-12-06 01:35:47 -05:00
Tomas Babej
88ea8544f6
ci: Add Ubuntu 20.04 2020-12-06 00:53:34 -05:00
Tomas Babej
2b9525980e
ci: Removing support for Ubuntu 16.04
Ubuntu 16.04 has reached EOL and the 2.6.0 branch does not compile
there.
2020-12-06 00:28:59 -05:00
Tomas Babej
bf99dedc07
ci: Properly setup en_US.UTF-8 locale for Ubuntu containers 2020-12-06 00:22:32 -05:00
Tomas Babej
9e9ef6a210
tests: Allow specifying lexer tests as expected failures 2020-12-05 21:22:42 -05:00
Tomas Babej
efc56d3ab6
tests: Implement mechanism for expected failures in C++ tests
Implements detection of unexpected successes and expected failures. Both
classes are represented in the TAP output as 'not ok', unexpected
successes with '# FIXED' metadata and expected failures as '# TODO'.

This brings C++ tests to feature parity with Python-based ones when it
comes to expected failures and unexpected successes.
2020-12-05 21:22:24 -05:00
Tomas Babej
d25d930ada
tests: Unmark unexpected successes
These tests are passing on 2.6.0.
2020-12-05 19:35:45 -05:00
Tomas Babej
095d51e479
tests: Properly label and detect unexpected successes
Unexpected successes were being labeled as failures, which might be
related to [1]. This behaviour is indeed welcome - we want to detect if
tests are unexpectedly succeeding via test pipeline failures, however,
the current implementation of the simpletap did not properly implement
this.

[1] https://bugs.python.org/issue20165
2020-12-05 19:28:47 -05:00
Tomas Babej
642f250f72
tests: Mark failing corner case tests as expected for 2.6.0
These are still important problems, but it will allow us to fully
leverage CI while waiting for the fixes.
2020-12-05 18:24:29 -05:00
Tomas Babej
cd1d42bc9d
tests: Mark failing corner case tests as expected for 2.5.2 2020-12-05 16:40:28 -05:00
Max Rossmannek
4663ca840f Mark failing tests as expected failures
Related issues:
- TW-1630 (#1654) needs to be re-opened!
- TW-1915 (#1928)
2020-11-30 01:01:26 -05:00
Max Rossmannek
d85901e7ff Properly escape filters including spaces
This adds a note to the man page to properly escape filters containing
spaces. It also fixes the unittests to reflect this.

One of the unittests contained an alternative syntax as discussed in
TW-1479 (#1505). It has been extracted into its own unittest and marked
as an expected failure because it is currently not supported.
2020-11-30 01:01:26 -05:00
Max Rossmannek
50cfd92ad5 Fix Arch docker image 2020-11-30 00:51:54 -05:00
Max Rossmannek
596d681be7 Fix faketime packages 2020-11-30 00:51:54 -05:00
Max Rossmannek
07a27cbd3b Replace libfaketime with faketime in debianstable
I verified locally that this avoids skipping all of the
faketime-dependent unittests. The Travis CI logs will have to be
investigated for all of the other docker images on which distros we may
need to apply a similar fix.
2020-11-30 00:51:54 -05:00
Max Rossmannek
61a78d0a6f Attempt greedy docker config update
This is an attempt at updating all docker configurations by simply
replacing the `python` packages with `python3`. The Travis CI will let
us know if this works.
2020-11-30 00:51:54 -05:00
Max Rossmannek
8b91cd97a8 Enforce Python 3 in test_hooks/wrapper
This change was not included in the previous commit because the sed
command I used included the `/usr/bin/env` path to ensure I don't
replace any occurences of the word `python` which I did not wish to
replace.
2020-11-30 00:51:54 -05:00
Max Rossmannek
f35989be0e Enforce Python 3 for unittests
This commit updates all tests to enforce the Python3 executable. This is
necessary because the `assertRegex` function we use was renamed to this
name only in Python 3.2 [1]

For reference:
s;/usr/bin/env python;/usr/bin/env python3;g

[1]: https://docs.python.org/3/library/unittest.html#unittest.TestCase.assertRegex
2020-11-30 00:51:54 -05:00
mrossinek
4f14b8923f Fix variant_subtract test case after PR #2095 2020-11-24 08:12:39 -05:00
Max Rossmannek
cad9a4f834 Update diag.t to correct C++ version
The default C++ version was updated in 4729876 and this commit reflects
this change in the test.
2020-11-24 08:12:39 -05:00
mrossinek
ca1e2a5a6b Mark project.t 1455 as expected failure 2020-11-24 08:12:39 -05:00
Tomas Babej
79e076c3c0 tests: Use updated unittest method 2020-11-24 08:12:39 -05:00
mrossinek
7d567c3ac9 Fix wait.t to correct expected output 2020-11-24 08:12:39 -05:00
Tomas Janousek
2c4d4ad649 Test: Add UUID test demonstrating a "Cannot subtract strings" bug
$ task 0000000d-000a-0000-0000-000000000000 export
Cannot subtract strings
$ task 0000000d-0000-0000-0000-000000000000 export
The expression could not be evaluated.
2020-11-24 02:42:32 -05:00
Tomas Babej
351965a87b
Update copyright to 2020 2020-11-21 12:43:40 -05:00
Tomas Babej
d1b867f7b5
tests: Do not require line buffering
Test runner complains about it not being supported with binary files and
it does not look like it affects any tests in the first place anyway.
2020-11-21 12:41:18 -05:00
Tomas Babej
52c49169b4
tests: Use updated unittest methods 2020-11-21 12:39:03 -05:00