mirror of
https://git.proxmox.com/git/wasi-libc
synced 2025-06-12 23:25:59 +00:00
2b853ff079
This change represents a rather large re-design in how `wasi-libc` builds and runs its tests. Initially, #346 retrieved the `libc-test` repository and built a subset of those tests to give us some amount of test coverage. Later, because there was no way to add custom C tests, #522 added a `smoke` directory which allowed this. But (a) each of these test suites was built and run separately and (b) it was unclear how to add more tests flexibly--some tests should only run on `*p2` targets or `*-threads` targets, e.g. This change reworks all of this so that all tests are built the same way, in the same place. For downloaded tests like those from `libc-test`, I chose to add "stub tests" that `#include` the original version. This not only keeps all enabled tests in one place, it also allows us to add "directives," C comments that the `Makefile` uses to filter out tests for certain targets or add special compile, link or run flags. These rudimentary scripts, along with other Bash logic I moved out of the Makefile now live in the `scripts` directory. Finally, all of this is explained more clearly in an updated `README.md`. The hope with documenting this a bit better is that it would be easier for drive-by contributors to be able to either dump in new C tests for regressions they may find or enable more libc-tests. As of my current count, we only enable 40/75 of libc-test's functional tests, 0/228 math tests, 0/69 regression tests, and 0/79 API tests. Though many of these may not apply to WASI programs, it would be nice to explore how many more of these tests can be enabled to increase wasi-libc's test coverage. This change should explain how to do that and, with directives, make it possible to condition how the tests compile and run.
22 lines
673 B
Bash
Executable File
22 lines
673 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
# Create stub tests in `$TO_DIR` that `#include` a test in the `$FROM_DIR`
|
|
# directory. If the stub already exists, do not overwrite it.
|
|
#
|
|
# Usage: FROM_DIR=... TO_DIR=... ./generate-stubs.sh
|
|
|
|
FROM_DIR="${FROM_DIR:-build/download/libc-test}"
|
|
TO_DIR="${TO_DIR:-src/libc-test}"
|
|
# For now, only retrieve the functional tests.
|
|
FUNCTIONAL_TESTS=$(find $FROM_DIR/src/math -name '*.c')
|
|
|
|
for from in $FUNCTIONAL_TESTS; do
|
|
to="${from/"$FROM_DIR/src"/"$TO_DIR"}"
|
|
if [ ! -f $to ]; then \
|
|
mkdir -p $(dirname $to)
|
|
echo '// Auto-generated by generate-stubs.sh' > $to
|
|
echo '//! add-flags.py(CFLAGS): -I.' >> $to
|
|
echo "#include \"$from\"" >> $to
|
|
fi
|
|
done
|