Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
# Target System We selected a Highly Configuration System active and available [online](https://gitlab.com/libssh/libssh-mirror). This system was mined on 2020-04-02. We identified 44 product variants, of which we selected 31 that have at least one failed test case in their history of builds. The first line of the table presents a set with all test cases considering every variant. The first column shows the variant name and the second columns its acronym used to improve the visualization during analysis. The third column shows the period that each variant was used. The fourth column presents the total of builds identified. Only valid builds (success or fail) were considered, that is, we discarded builds with some problem, for instance, canceled builds. The fifth column shows the total of failures found, and in parenthesis the number of builds in which at least one test failed. The sixth column shows the number of different (unique) test cases identified from build logs, and in parenthesis the range of test cases executed in the builds. The last columns present, for each system, the mean (± standard deviation) duration in minutes of the CI Cycles and the interval between them. | **Name** | **Period** | **Builds** | **Failures** | **Test Cases** | **Duration (min)** | **Interval (min)** | |-----------|-----------|-----------|-----------|-----------|-----------|-----------| |*Total* | 2018/04/12-2020/02/25 | 334 | 223 (127) | 62 (17 - 62) | 0.4029 (2.037) | 1142.528 (459.283) | | *address-sanitizer* | 2018/04/18-2018/04/18 | 1 | 13 (1) | 29 (29 - 29) | 0.0110 (0.032) | - | | *CentOS7-openssl* | 2018/04/12-2018/04/12 | 1 | 1 (1) | 17 (17 - 17) | 0.0237 (0.042) | - | | *CentOS7-openssl 1.0.x-x86-64* | 2018/04/12-2018/04/18 | 22 | 8 (7) | 29 (17 - 29) | 0.0104 (0.02) | 1320.7984 (287.806) | | *centos7-openssl_1.0.x-x86-64* | 2018/04/18-2019/12/10 | 128 | 1 (1) | 26 (17 - 25) | 0.0332 (0.1) | 972.3706 (457.855)| | *Debian.cross.mips-linux-gnu* | 2018/07/02-2018/12/24 | 131 | 7 (7) | 29 (19 - 29) | 1.3815 (4.122) | 956.783 (499.357) | | *Debian-openssl 1.0.x-aarch64* | 2018/04/12-2018/04/13 | 8 | 1 (1) | 17 (17 - 17) | 0.0431 (0.083) | 1298.6738 (306.178) | | *fedora-libgcrypt-x86_64* | 2018/09/10-2020/02/25 | 179 | 11 (11) | 57 (40 - 57) | 0.0669 (0.204) | 930.5167 (533.409) | | *fedora-mbedtls-x86-64* | 2018/06/27-2019/12/10 | 108 | 16 (6) | 40 (30 - 40) | 0.0554 (0.16) | 987.9657 (458.517) | | *fedora-mbedtls-x86_64* | 2018/09/10-2020/02/25 | 178 | 2 (2) | 56 (39 - 56) | 0.0568 (0.177) | 904.7565 (534.632) | | *Fedora-openssl* | 2018/04/12-2018/04/12 | 1 | 1 (1) | 17 (17 - 17) | 0.0149 (0.031) | - | | *Fedora-openssl 1.1.x-x86-64* | 2018/04/12-2018/04/18 | 21 | 3 (3) | 29 (17 - 29) | 0.0120 (0.027) | 1315.1925 (293.81)| | *fedora-openssl_1.1.x-x86-64* | 2018/04/18-2019/12/10 | 125 | 14 (13) | 41 (29 - 41) | 0.0489 (0.132) | 993.4781 (455.632)| | *fedora-openssl_1.1.x-x86-64-release* | 2018/08/20-2019/03/13 | 57 | 4 (4) | 41 (38 - 41) | 0.0485 (0.126) | 927.5525 (463.556)| | *fedora-openssl_1.1.x-x86_64* | 2018/09/10-2020/02/25 | 179 | 3 (3) | 60 (40 - 60) | 0.0604 (0.195) | 905.6718 (535.739)| | *fedora-openssl_1.1.x-x86_64-fips* | 2019/06/13-2020/02/25 | 71 | 11 (10) | 57 (55 - 57) | 0.0805 (0.297) | 1013.623 (538.089)| | *fedora-openssl_1.1.x-x86_64-minimal* | 2018/12/13-2020/02/25 | 124 | 1 (1) | 45 (40 - 45) | 0.0461 (0.15) | 927.5229 (534.695)| | *fedora-undefined-sanitizer* | 2018/04/18-2020/02/25 | 307 | 16 (15) | 57 (29 - 57) | 0.0701 (0.208) | 966.4755 (506.954)| | *freebsd-x86_64* | 2018/09/10-2020/02/25 | 179 | 10 (3) | 33 (24 - 33) | 0.0346 (0.102) | 886.7128 (543.546)| | *mingw32* | 2018/06/27-2019/12/10 | 86 | 3 (3) | 16 (10 - 16) | 0.0849 (0.229) | 951.7082 (482.182)| | *mingw64* | 2018/06/27-2019/12/10 | 86 | 3 (3) | 16 (10 - 16) | 0.0610 (0.142) | 957.3851 (477.583)| | *pages* | 2018/04/18-2018/04/18 | 3 | 18 (3) | 29 (29 - 29) | 0.0088 (0.022) | 1434.4083 (0.608)| | *tumbleweed-openssl_1.1.x-x86-64* | 2018/05/30-2019/12/10 | 103 | 24 (8) | 41 (29 - 41) | 0.0568 (0.15) | 963.3945 (482.27)| | *tumbleweed-openssl_1.1.x-x86-64-release* | 2018/08/20-2019/03/13 | 57 | 1 (1) | 41 (38 - 41) | 0.0600 (0.155) | 942.0249 (457.872)| | *tumbleweed-openssl_1.1.x-x86_64-clang* | 2018/09/10-2020/02/25 | 180 | 19 (10) | 57 (38 - 57) | 0.0616 (0.184) | 909.4417 (536.359)| | *tumbleweed-openssl_1.1.x-x86_64-gcc* | 2018/09/10-2020/02/25 | 176 | 16 (7) | 56 (38 - 56) | 0.0620 (0.184) | 896.6659 (536.939)| | *tumbleweed-openssl_1.1.x-x86_64-gcc7* | 2018/09/10-2020/02/25 | 179 | 15 (7) | 57 (38 - 57) | 0.0625 (0.187) | 902.7045 (540.006)| | *tumbleweed-undefined-sanitizer* | 2018/05/30-2020/02/25 | 300 | 36 (14) | 56 (29 - 56) | 0.0707 (0.196) | 956.385 (514.161)| | *ubuntu-openssl_1.1.x-x86_64* | 2019/12/23-2020/02/25 | 13 | 10 (5) | 57 (57 - 57) | 0.0583 (0.19) | 1036.3259 (543.659)| | *undefined-sanitizer* | 2018/04/18-2018/04/18 | 4 | 29 (2) | 29 (29 - 29) | 0.0162 (0.043) | 1430.6278 (1.341)| | *visualstudio-x86* | 2018/11/30-2020/02/25 | 116 | 13 (11) | 18 (16 - 18) | 0.0044 (0.007) | 953.6386 (530.41)| | *visualstudio-x86_64* | 2018/11/30-2020/02/25 | 116 | 14 (14) | 18 (16 - 18) | 0.0051 (0.01) | 957.3534 (534.557)| ## Download dataset The complete dataset is available on Dataverse. The link is as follows: - [LIBSSH](https://doi.org/10.7910/DVN/SSTESD)
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.