Commit Graph

1329 Commits

Author SHA1 Message Date
Jan Pokorný
6fad6b7b2d
tests: better diagnose test_max_dgram_size test failures 2016-11-28 15:16:04 +01:00
Jan Pokorný
f321df7498
CI: travis: fix dh -> du + add "lsblk -f" diagnostics 2016-11-28 15:14:27 +01:00
Chrissie Caulfield
d03b718021 Merge pull request #235 from jnpkrn/travis-issue-234
CI: make travis watch for the issue #234
2016-11-24 15:18:15 +00:00
Jan Pokorný
e702848b0d
CI: make travis watch for the issue #234 2016-11-24 16:05:25 +01:00
Christine Caulfield
0a329683a7 version: Update version for 1.0.1 release 2016-11-24 09:44:27 +00:00
Chrissie Caulfield
3ca533b44e Merge pull request #233 from jnpkrn/copr-tito
build: git -> automatic COPR builds integration followup
2016-11-24 09:02:29 +00:00
Jan Pokorný
77cb88d6f8
build: tito: minor adjustments 2016-11-23 13:05:28 +01:00
Jan Pokorný
704c196426
doc: README: add a status badge+link for the COPR builds 2016-11-22 16:36:26 +01:00
Chrissie Caulfield
45712eae1b Merge pull request #232 from jnpkrn/copr-tito
build: allow for git -> automatic COPR builds integration
2016-11-22 14:27:43 +00:00
Jan Pokorný
27d51a8339
build: allow for git -> automatic COPR builds integration
New tito-related files makes the repository compatible with tito method
of building in COPR (https://fedorahosted.org/copr/wiki/UserDocs#Tito).
2016-11-18 23:32:44 +01:00
Jan Pokorný
85b82bd615
build: ensure debug make flags are not derived when unsuitable
Unfortunately, debug messages of GNU make are emitted to stdout, which
spoils the extracted output we rely on.  So prevent it (as well as
any other extraneous option) by force.

(discovered during git -> automatic COPR builds integration)
2016-11-18 23:29:07 +01:00
Jan Pokorný
f6e40425dc
build: ensure check_SCRIPTS are distributed
(discovered during git -> automatic COPR builds integration)
2016-11-18 22:41:14 +01:00
Chrissie Caulfield
b67f8ff9f4 Merge pull request #231 from jnpkrn/unlink-or-truncate
Unlink or truncate (as a fallback) files when shm IPC client terminates connection forcibly
2016-11-08 11:01:26 +00:00
Jan Pokorný
f610b1b161
tests: start stdlib failures injection effort with unlink{,at} + test
There are not many ways to test alternate code paths having failure of
some function from standard library as a precondition.

For a starter, we need to test failing unlink{,at} functions in a
controlled manner to mimic client and server path of the IPC connection
having different privileges to validate the previous commit.  But the
test suite cannot assume it has root privileges (so as to add artificial
user system-wide, which is a pretty stupid idea on its own), cannot
generally use stuff like chroot/namespacing (not to speak about
synergies of the former like docker).  So what's left is to make our
own playground, or better yet, use existing playground but just to
modify the rules of the game a bit when it's desired -- a variation
of old good LD_PRELOAD trick.

Note that this concept was already used in syslog tests (see commit
642f74d) and is now further extended using dlsym(RTLD_NEXT, "symbol")
to resolve the standard library symbol being shadowed by our little
"module".  This hence yields a customized wrapping we use to either
inject a call failure or to increase an invocation counter so as to
assure something has indeed been called.  As the mechanisms used are
not supposed to be available everywhere, the build system is
conditionalized respectively.

Back to our test when unlink{,at} fails, with the help of the described
mechanism, it was actually easy to massage test_ipc_server_fail_shm
into test_ipcc_truncate_when_unlink_fails_shm desired addition, which
is also featured in this commit, together with a modification to
resources.test script so that it expects particular number of empty
file leftovers (see previous commit).

It's expected that the module for failure injections will keep growing
so as to enable better overall coverage of the code (on the platforms
where this provision is available).
2016-11-04 19:06:08 +01:00
Jan Pokorný
1559192234
Med: rb: use new qb_rb_close_helper able to resort to file truncating
This changeset builds on previous 2-3 commits and represents the main
libqb's answer to the original question behind pacemaker's security
defect known as CVE-2016-7035.

Beside the helper partly unifying handling of qb_rb_force_close and
qb_rb_close, it provides the former with ability to use file truncating
as a fallback for when unlinking fails, e.g., because client (note that
mentioned is currently only relevant for the client side as normally
server is responsible for the lifecycle of the materialized files,
unless it crashes and only client is left to do its best) is not the
owner while they are placed at a directory with restricted deletion,
which enforces this very ownership condition.

In practice, this means that, at worst, just the zero-size files are
left behind, so not that much space exhaustion (usually "ramdisk"
like tmpfs is what backs default storage directory /dev/shm, so it
boils down to physical memory exhaustion, even if it can be just
for page cache and related overhead) can happen even on repeated
crashes as the memory mappings are cleared as much as possible.

Also openat/unlinkat functions (sported in qb_sys_unlink_or_truncate_at
as of the previous commit) are, when applicable, used so as to limit
possible race conditions between/during individual path traversals
(both files being got rid of presumably share the same directory).

Few words on which actions are attempted in which order for the
equivalent of qb_rb_force_close now:
There are subtle interactions between what's externally visible
(files) and what's not (memory mappings associated with such files),
and perhaps between memory pages management from the perspective of
the former (usually "ramdisk"/tmpfs) and the latter (mmap + munmap).
If the associated file is no longer publicly exposed by the means of
unlink (even if the object survives internally as refcounting is in
the game, with mmap holding a reference), memory mapping is not
affected.  On the other hand, if it's just limited by truncation
to zero size, memory mapping is aware and generates SIGBUS in response
to accessing respective addresses.  Similarly, accessing munmap'd
(no refcounting here) memory generates SIGSEGV.  For delicacy,
the inputs for all of unlink, truncate, and munmap are stored
at the mmap'd location we are about to drop, but that's just a matter
of making copies ahead of time.
At Ken's suggestion, the scheme is: (unlink or truncate) then munmap,
which has a benefit that externally visible (and program's life span
otherwise surviving!) part is eliminated first, with memory mappings
(disposed at program termination automatically at latest) to follow.
(There was originally a paranoid expectation on my side that truncate
on tmpfs actually does silent munmap, so that our munmap could in fact
tear down the mapping added in the interim by the libraries, signal
handler or due to requirements of another thread, also because of
munmap on the range without any current mappings will not fail, and
thus there's likely no portable way to non-intrusively check the
status, but also due to documented SIGBUS vs. SIGSEGV differences
the whole assumption appears bogus on the second thought.)

Relevant unit tests that exercise client-side unlinking:
- check_ipc: test_ipc_server_fail_shm, test_ipc_exit_shm
- new test in a subsequent commit
2016-11-04 19:05:35 +01:00
Jan Pokorný
7286215ec7
Low: unix: new qb_sys_unlink_or_truncate{,_at} helpers
These are intended for subsequent qb_rb_{force_,}close refactorization
and utilization of this new truncate as a fallback after unlink failure
as detailed in the commit to follow.

For newer POSIX revision compliant systems, there's "at" variant using
openat/unlinkat functions so that paths do not have to be traversed
in full anew when not needed (as both unlink and truncate operate on
the same path).
2016-11-04 19:02:50 +01:00
Jan Pokorný
189ca28db9
Med: rb: make it more robust against trivial IPC API misuses
...using a new private inline helper that is intended to "decorate"
argument (plus extra reference level added) to qb_rb_{force_,}close().
It is purposefully not hardwired to neither qb_rb_close (it's a public
API function that should not change its semantics) nor qb_rb_force_close
(just for symmetry, preempting issues when the two would differ, and
also makes them more mutually compatible, which is already expected
at qb_ipcc_shm_disconnect).

It sets the original ringbuffer pointer to NULL (having the immediate
impact on other threads/asynchronous handling) and also sets the
(currently underused) reference counter set to exacly 1 (that is
subsequently going to be decremented in qb_rb_close so that it's
sound in the current arrangement).

More in the comment at the helper.
Suitable places are also made to use it right away.
2016-11-04 19:02:32 +01:00
Jan Pokorný
c5aaea9207
Refactor: ipc_shm: better grip on ringbuffers to close
Also remove unused comment-introduced section of code.
2016-11-04 19:02:00 +01:00
Chrissie Caulfield
026aaa7bde Merge pull request #230 from jnpkrn/log_thread
Med: log_thread: logt_wthread_lock is vital for logging thread
2016-10-21 15:43:17 +01:00
Chrissie Caulfield
7e5212b6a3 Merge pull request #228 from jnpkrn/maint
Various cleanups (symbol imports, typos, doc)
2016-10-21 15:31:13 +01:00
Jan Pokorný
ca710b2505
Refactor: log_thread: fix and diminish inferior comments 2016-10-21 09:42:48 +02:00
Jan Pokorný
07542cf693
Med: log_thread: logt_wthread_lock is vital for logging thread
This fixes issue with would-fail-if-applied-to-thread-right-away
qb_log_thread_priority_set invocation when logging thread doesn't
exist yet, which will arrange for calling itself at the time of
thread's birth that is the moment it will actually fail.
In this + lock-could-not-have-been-initialized corner cases, the
already running thread would proceed as allowed by error condition
handling in the main thread, trying to dereference uninitialized
(or outdated) pointer to the lock at hand, resulting in segfault.

Also include the test that would have been caught that (we use the
fact that it doesn't matter whether setting of the scheduler parameters
fails due to bad input or just because of lack of privileges as it's
the failure at the right moment that is of our interest).

See also:
https://github.com/ClusterLabs/libqb/issues/229
2016-10-21 09:42:16 +02:00
Christine Caulfield
e13d15e993 tests: Unit test for previous zero tag patch
Signed-off-by: Christine Caulfield <ccaulfie@redhat.com>
2016-10-20 14:52:52 +01:00
Christine Caulfield
0d6a698931 log: Remove check for HAVE_SCHED_GET_PRIORITY_MAX
it doesn't exist

Signed-off-by: Christine Caulfield <ccaulfie@redhat.com>
2016-10-20 09:50:12 +01:00
Jan Pokorný
0d90bcb0ad
tests: SIGSTOP cannot be caught, blocked, or ignored
...per signal(7), so it is foolish trying to do so.
2016-10-19 00:40:56 +02:00
Christine Caulfield
b40c499d7d log: Don't overwrite valid tags
If a tag of 0 is passed into the logger and an existing callsite
is found with a non-zero tag, the don't overwrite the existing tag.

Signed-off-by: Christine Caulfield <ccaulfie@redhat.com>
2016-10-18 14:30:28 +01:00
Jan Pokorný
6743206b72
Low: ipc_shm: fix superfluous NULL check
That's what qb_rb_chunk_reclaim does since commit
ef77398738 that made this
check redundant.

Signed-off-by: Jan Pokorný <jpokorny@redhat.com>
2016-10-17 19:48:19 +02:00
Jan Pokorný
617730b3ed
doc: elaborate more on thread safety as it's not so pure 2016-10-17 18:25:03 +02:00
Jan Pokorný
d107a2ab3b
Low: further sanitize qbipc[cs].h public headers wrt. includes 2016-10-17 17:41:37 +02:00
Jan Pokorný
ab78f2a4fd
Low: sanitize import of <poll.h> symbols 2016-10-17 17:39:09 +02:00
Jan Pokorný
c1c26c94cb
Low: sanitize import of <qb/qbarray.h> symbols 2016-10-17 17:25:50 +02:00
Jan Pokorný
b7f6dae97a
Fix typos: availabi{l -> li}ty, explici{lt -> tl}y 2016-10-12 20:10:22 +02:00
Christine Caulfield
2f6f5892fe Merge branch 'jnpkrn-Svante-Signell-Hurd' 2016-10-11 15:25:07 +01:00
Christine Caulfield
e77383897e Merge branch 'Svante-Signell-Hurd' of https://github.com/jnpkrn/libqb into jnpkrn-Svante-Signell-Hurd 2016-10-11 15:24:50 +01:00
Chrissie Caulfield
164ba7b6af Merge pull request #226 from jnpkrn/maint
Maint: fix typos + resources.test
2016-10-11 10:02:57 +01:00
Jan Pokorný
8cc165a87b
tests: resources: check for proper names of leftover processes
Unfortunately, the change in test names introduced with commit e990681
hadn't been reflected (until now).

Also reformat shell syntax per more usual convention.
2016-10-07 21:14:07 +02:00
Jan Pokorný
485885597c
Fix typos: differ{ne -> en}t, is -> if 2016-10-07 21:13:17 +02:00
Chrissie Caulfield
e3d569c331 Merge pull request #224 from jnpkrn/maint
Maint: typo + unused functions checked in configure
2016-10-04 09:09:11 +01:00
Jan Pokorný
d2b15efe60
Fix typo: asyncronous -> asynchronous 2016-09-30 14:26:15 +02:00
Jan Pokorný
db7dcd1411
Build: configure: do not check for unused "sched" functions
Do not compile-time-conditionalize based on one of them being available,
either.
2016-09-30 14:24:46 +02:00
Chrissie Caulfield
04442d41d5 Merge pull request #223 from jnpkrn/maint
maint: qb-blackbox man page should accompany the binary
2016-09-23 09:45:47 +01:00
Jan Pokorný
6da5cc1368
maint: qb-blackbox man page should accompany the binary 2016-09-22 20:59:40 +02:00
Chrissie Caulfield
4dff79e3f3 Merge pull request #218 from wferi/apropos
docs: qbdefs.h: description must directly follow @file
2016-08-01 11:07:58 +01:00
Ferenc Wágner
d7aaae8497 docs: qbdefs.h: description must directly follow @file
If we want to see it again in the man page NAME section, where it can
be indexed by apropos or whatis.
2016-07-31 14:03:34 +02:00
Chrissie Caulfield
495389d03a Merge pull request #221 from jnpkrn/typo-qblog.h
Fix typo: qblog.h: q{g -> b}_log_filter_ctl
2016-06-30 08:31:31 +01:00
Jan Pokorný
bf3abb45c1
Fix typo: qblog.h: q{g -> b}_log_filter_ctl 2016-06-29 13:25:06 +02:00
Chrissie Caulfield
84b131c27e Merge pull request #217 from jnpkrn/log-serialize-check-char-properly
Low: log: check for appropriate space when serializing a char
2016-06-20 08:52:53 +01:00
Christine Caulfield
22ac41108e log: Add missing z,j, & t types to the logger
Signed-off-by: Christine Caulfield <ccaulfie@redhat.com>
Reviewed-by: Ken Gaillot <kgaillot@redhat.com>
Reviewed-by: Jan Pokorný <jpokorny@redhat.com>
2016-06-20 08:37:13 +01:00
Jan Pokorný
17e5a36b18
Low: log: check for appropriate space when serializing a char
... where appropriate space is measured for, surprisingly, a char,
not for an int.  Note that's also the actual type used for both
de-/serializing, so there's no conflict.

Also bother to explain why, now surprisingly for real, an unsigned int
is scraped out from va_list (akin to to STDARG(3)).
2016-06-17 16:42:36 +02:00
Chrissie Caulfield
907e49b999 Merge pull request #213 from liu4480/master
low:fixed:Spelling error of failure in qbhdb.h
2016-06-06 09:49:38 +01:00