Re: Build failed in Jenkins: FreeBSD_HEAD-tests2 #928

On Apr 13, 2015, at 11:07, jenkins-admin_at_freebsd.org wrote:

> See <https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/928/>

…

> kyua report --verbose --results-filter passed,skipped,xfail,broken,failed  --output test-report.txt
> kyua: E: Load of 'Kyuafile' failed: Failed to load Lua file 'Kyuafile': Kyuafile:49: Load of 'lib/Kyuafile' failed: Failed to load Lua file 'lib/Kyuafile': lib/Kyuafile:49: Load of 'lib/libthr/Kyuafile' failed: Failed to load Lua file 'lib/libthr/Kyuafile': lib/libthr/Kyuafile:26: Non-existent test program 'lib/libthr/atexit_test'.
> kyuatestprompt # kyua report-junit --output=test-report.xml
> kyua report --verbose --results-filter passed,skipped,xfail,bro ken,failed  --output test-report.txt
> 
> kyua: E: No previous results file found for test suite usr_tests.
> kyuatestprompt # kyua report-junit --output=test-report.xmlshutdown -p now
> 
> 
> kyua: E: No previous results file found for test suite usr_tests.
> kyuatestprompt # shutdown -p now
> 
> Shutdown NOW!
> shutdown: [pid 664]
> kyuatestprompt #                                                                                

...

> Waiting (max 60 seconds) for system process `vnlru' to stop...done
> Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
> Waiting (max 60 seconds) for system process `syncer' to stop...
> Syncing disks, vnodes remaining...0 0 done
> All buffers synced.
> lock order reversal:
> 1st 0xfffff800062d2068 ufs (ufs) _at_ /builds/FreeBSD_HEAD/sys/kern/vfs_mount.c:1229
> 2nd 0xfffff800061a15f0 devfs (devfs) _at_ /builds/FreeBSD_HEAD/sys/kern/vfs_subr.c:2176
> KDB: stack backtrace:
> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007bdea650
> witness_checkorder() at witness_checkorder+0xe26/frame 0xfffffe007bdea6e0
> __lockmgr_args() at __lockmgr_args+0xa5c/frame 0xfffffe007bdea810
> vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe007bdea830
> VOP_LOCK1_APV() at VOP_LOCK1_APV+0xfc/frame 0xfffffe007bdea860
> _vn_lock() at _vn_lock+0x9a/frame 0xfffffe007bdea8d0
> vget() at vget+0x67/frame 0xfffffe007bdea910
> devfs_allocv() at devfs_allocv+0xfd/frame 0xfffffe007bdea960
> devfs_root() at devfs_root+0x43/frame 0xfffffe007bdea990
> dounmount() at dounmount+0x342/frame 0xfffffe007bdeaa10
> vfs_unmountall() at vfs_unmountall+0x61/frame 0xfffffe007bdeaa40
> kern_reboot() at kern_reboot+0x4f6/frame 0xfffffe007bdeaac0
> sys_reboot() at sys_reboot+0x58/frame 0xfffffe007bdeaae0
> amd64_syscall() at amd64_syscall+0x27f/frame 0xfffffe007bdeabf0
> Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe007bdeabf0
> --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x40fabc, rsp = 0x7fffffffe718, rbp = 0x7fffffffe810 ---
> Uptime: 16s
> acpi0: Powering system off
> + sudo python /vm/freebsd-ci/scripts/test/extract-test-logs.py -f /vm/freebsd-ci/scripts/test/config/config.json
> cp: /tmp/tmp8uNnu_/usr/tests/*.xml: No such file or directory
> mdconfig -a -u 99 -t vnode -f /net/jenkins-10.freebsd.org/builds/Build-UFS-image/image/FreeBSD_HEAD/test.img
> umount /tmp/tmp8uNnu_
> mdconfig -d -u 99
> Recording test results
> ERROR: Publisher hudson.tasks.junit.JUnitResultArchiver aborted due to exception
> hudson.AbortException: Test reports were found but none of them are new. Did tests run? 
> For example, <https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/ws/test-report.xml> is 10 days old
> 
> 	at hudson.tasks.junit.TestResult.parse(TestResult.java:178)
> 	at hudson.tasks.junit.TestResult.parse(TestResult.java:146)
> 	at hudson.tasks.junit.TestResult.<init>(TestResult.java:122)
> 	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:119)
> 	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:93)
> 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2688)
> 	at hudson.remoting.UserRequest.perform(UserRequest.java:121)
> 	at hudson.remoting.UserRequest.perform(UserRequest.java:49)
> 	at hudson.remoting.Request$2.run(Request.java:325)
> 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> 	at ......remote call to havoc.ysv.freebsd.org(Native Method)
> 	at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1360)
> 	at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
> 	at hudson.remoting.Channel.call(Channel.java:753)
> 	at hudson.FilePath.act(FilePath.java:978)
> 	at hudson.FilePath.act(FilePath.java:967)
> 	at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:90)
> 	at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:120)
> 	at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:137)
> 	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:74)
> 	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:761)
> 	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:721)
> 	at hudson.model.Build$BuildExecution.post2(Build.java:183)
> 	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:670)
> 	at hudson.model.Run.execute(Run.java:1766)
> 	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 	at hudson.model.ResourceController.execute(ResourceController.java:98)
> 	at hudson.model.Executor.run(Executor.java:374)

This breakage was caused by r281055; atexit_test is a script installed via ATF_TESTS_SH, and was not being installed right. Repro was as follows:

sudo pkg install -y kyua
sudo rm -Rf /usr/tests
sudo make hier
(cd lib/libthr/tests/; make obj; make depend; make all; sudo make install)
(cd /usr/tests/lib/libthr; kyua list)

This failure is the reason why I didn’t commit a similar patch a while ago (sorry for not noting this sooner :/..).

I’ve reverted the commit in r281503 and will work on the correct fix post-haste to unblock your work Baptiste.

Thank you (and sorry for not noting this issue sooner…),