mirror of
https://git.proxmox.com/git/wasi-libc
synced 2025-06-12 23:25:59 +00:00
2b853ff079
This change represents a rather large re-design in how `wasi-libc` builds and runs its tests. Initially, #346 retrieved the `libc-test` repository and built a subset of those tests to give us some amount of test coverage. Later, because there was no way to add custom C tests, #522 added a `smoke` directory which allowed this. But (a) each of these test suites was built and run separately and (b) it was unclear how to add more tests flexibly--some tests should only run on `*p2` targets or `*-threads` targets, e.g. This change reworks all of this so that all tests are built the same way, in the same place. For downloaded tests like those from `libc-test`, I chose to add "stub tests" that `#include` the original version. This not only keeps all enabled tests in one place, it also allows us to add "directives," C comments that the `Makefile` uses to filter out tests for certain targets or add special compile, link or run flags. These rudimentary scripts, along with other Bash logic I moved out of the Makefile now live in the `scripts` directory. Finally, all of this is explained more clearly in an updated `README.md`. The hope with documenting this a bit better is that it would be easier for drive-by contributors to be able to either dump in new C tests for regressions they may find or enable more libc-tests. As of my current count, we only enable 40/75 of libc-test's functional tests, 0/228 math tests, 0/69 regression tests, and 0/79 API tests. Though many of these may not apply to WASI programs, it would be nice to explore how many more of these tests can be enabled to increase wasi-libc's test coverage. This change should explain how to do that and, with directives, make it possible to condition how the tests compile and run.
25 lines
490 B
Bash
Executable File
25 lines
490 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
# This script checks for failed tests in the given directory. Failed tests will
|
|
# include text in a *.log file.
|
|
#
|
|
# Usage: failed-tests.sh [TESTDIR]
|
|
#
|
|
# Optionally set the VERBOSE environment variable to see the list of failed
|
|
# tests.
|
|
|
|
set -e
|
|
|
|
TESTDIR=${1:-.}
|
|
FAILED=$(find $TESTDIR -type f -and -name *.log -and -not -size 0)
|
|
|
|
if [[ -n "$VERBOSE" ]]; then
|
|
for failed in "$FAILED"; do
|
|
echo "$failed";
|
|
done
|
|
fi
|
|
|
|
if [[ -n "$FAILED" ]]; then
|
|
exit 1
|
|
fi
|