I got more stacktraces in course of compilation of bash, see the updated dmesg. By the way, could someone suggest what types of stability tests I might perform? I.e. examples of disk- and FS-intensive workloads. On Fri, 17 Dec 2010 00:54:36 +0300, Rechistov Grigory (Речистов Григорий) <ggg_mail_at_inbox.ru> wrote: > I started to check the new ZFS version inside a VirtualBox machine. So > far it works for me without crashes, but I got some observations worth > mentioning. Here are the steps I made: > > 1. Installed 8.1-RELEASE (from minimal install CD) > 2. Csup'ped sources to CURRENT (as of 14/12/2010) [note that I haven't > used SVN repository] > 3. Applied the patch in question. > 4. Created a zpool raidz of two disks of old version 15. Also some > usual tuning of ZFS in loader.conf was done as I am running 32 bit > version with low amount of memory. "zfs_enable=YES" in rc.conf was > added too. > 4.1 Moved /usr/ports to ZFS to have some files on it. > 5. Make buildworld, buildkernel, installkernel, installworld - all the > canonical steps from the Handbook. > 6. After reboot to final 9.0-CURRENT world I got a dmesg with some trace > stack related to ZFS and also a rc.d script message about unrecognized > command 'volinit' (see the text of it in attachment). > 7. Nevertheless the system booted. Files > 8. `zpool upgrade -a` worked all right and reported that now I have ZFS > version 28 > > Overall I am pleasantly surprised how streamlined the whole process was. > > I am going to perform more tourturing of this VM later as well. > > Thanks for your work! Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #1: Thu Dec 16 02:53:13 MSK 2010 root_at_bsdtest.localnet:/usr/obj/usr/src/sys/GENERIC i386 WARNING: WITNESS option enabled, expect reduced performance. CPU: Intel(R) Core(TM)2 Duo CPU T7500 _at_ 2.20GHz (2171.85-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6fb Family = 6 Model = f Stepping = 11 Features=0x783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2> Features2=0x209<SSE3,MON,SSSE3> AMD Features=0x20100800<SYSCALL,NX,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant real memory = 671023104 (639 MB) avail memory = 637427712 (607 MB) pnpbios: Bad PnP BIOS data checksum kbd1 at kbdmux0 acpi0: <VBOX VBOXXSDT> on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 isab0: <PCI-ISA bridge> at device 1.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0 ata0: <ATA channel 0> on atapci0 ata1: <ATA channel 1> on atapci0 vgapci0: <VGA-compatible display> mem 0xe0000000-0xe0ffffff irq 11 at device 2.0 on pci0 em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port 0xd010-0xd017 mem 0xf0000000-0xf001ffff irq 10 at device 3.0 on pci0 em0: Ethernet address: 08:00:27:05:9b:9f pci0: <base peripheral> at device 4.0 (no driver attached) pci0: <multimedia, audio> at device 5.0 (no driver attached) ohci0: <OHCI (generic) USB controller> mem 0xf0804000-0xf0804fff irq 11 at device 6.0 on pci0 usbus0: <OHCI (generic) USB controller> on ohci0 pci0: <bridge> at device 7.0 (no driver attached) ehci0: <Intel 82801FB (ICH6) USB 2.0 controller> mem 0xf0805000-0xf0805fff irq 10 at device 11.0 on pci0 usbus1: EHCI version 1.0 usbus1: <Intel 82801FB (ICH6) USB 2.0 controller> on ehci0 mpt0: <LSILogic 1030 Ultra4 Adapter> port 0xd300-0xd3ff mem 0xf0820000-0xf083ffff,0xf0840000-0xf085ffff irq 9 at device 20.0 on pci0 mpt0: MPI Version=1.2.0.0 battery0: <ACPI Control Method Battery> on acpi0 acpi_acad0: <AC Adapter> on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: <PS/2 Mouse> irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 attimer0: <AT timer> port 0x40-0x43,0x50-0x53 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 pmtimer0 on isa0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xe2000-0xe2fff pnpid ORM0000 on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0 Event timer "RTC" frequency 32768 Hz quality 0 ppc0: parallel port not found. Timecounter "TSC" frequency 2171848610 Hz quality 800 Timecounters tick every 10.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 480Mbps High Speed USB v2.0 ad0: 16384MB <VBOX HARDDISK 1.0> at ata0-master UDMA33 ugen0.1: <Apple> at usbus0 uhub0: <Apple OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 ugen1.1: <Intel> at usbus1 uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 uhub0: 8 ports with 8 removable, self powered uhub1: 8 ports with 8 removable, self powered da0 at mpt0 bus 0 scbus0 target 0 lun 0 da0: <VBOX HARDDISK 1.0> Fixed Direct Access SCSI-5 device da0: 3.300MB/s transfers da0: Command Queueing enabled da0: 32768MB (67108864 512 byte sectors: 255H 63S/T 4177C) da1 at mpt0 bus 0 scbus0 target 1 lun 0 da1: <VBOX HARDDISK 1.0> Fixed Direct Access SCSI-5 device da1: 3.300MB/s transfers da1: Command Queueing enabled da1: 10240MB (20971520 512 byte sectors: 255H 63S/T 1305C) ata0: timeout waiting to issue command ata0: error issuing ATA PACKET command acd0: DVDROM <VBOX CD-ROM/1.0> at ata0-slave UDMA33 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/ad0s1a [rw]... ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior. Consider tuning vm.kmem_size and vm.kmem_size_max in /boot/loader.conf. ZFS filesystem version 5 ZFS storage pool version 28 lock order reversal: 1st 0xc433fa30 db->db_mtx (db->db_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2009 2nd 0xc435b32c dn->dn_mtx (dn->dn_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1174 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,6d2f7379,6c75646f,7a2f7365,2e2f7366,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c393f588,c393f4b8,d825a884,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c435b32c,c3ef0e9d,c393f4b8,c3ef0053,...) at _witness_debugger+0x25 witness_checkorder(c435b32c,9,c3ef0053,496,0,...) at witness_checkorder+0x839 _sx_xlock(c435b32c,0,c3ef0053,496,7fe,...) at _sx_xlock+0x85 dnode_rele(c435b28c,c433f930,c4180c00,d825a914,c3dfcf94,...) at dnode_rele+0x4d bpobj_close(c4180c60,0,0,c4180c00,c433f9f4,...) at bpobj_close+0x27 dsl_deadlist_close(c4180c20,c4180c00,c3ef714b,96,c433f9f4,...) at dsl_deadlist_close+0xa4 dsl_dataset_evict(c433f9f4,c4180c00,1,0,0,...) at dsl_dataset_evict+0x84 dbuf_evict_user(c433fa48,c3ee7b31,c3dbfe15,c433fa30,0,...) at dbuf_evict_user+0x4c dbuf_rele_and_unlock(c433f9f4,c3ee7b31,0,c42a2000,c42a2014,...) at dbuf_rele_and_unlock+0x1f4 dsl_pool_open(c40ee000,10f,0,c40ee1a4,246,...) at dsl_pool_open+0x203 spa_load(0,6,0,5,c3ee7ee0,...) at spa_load+0x634 spa_load_best(ffffffff,ffffffff,1,949,c0e47ce0,...) at spa_load_best+0x59 spa_open_common(c3b11ae0,0,c3ee938b,c40f7000,0,...) at spa_open_common+0x15e pool_status_check(c40f7000,2,0,12,0,...) at pool_status_check+0x2c zfsdev_ioctl(c3cdc800,d5985a12,c40f7000,0,c40f6000,...) at zfsdev_ioctl+0x238 devfs_ioctl_f(c3d10af0,d5985a12,c40f7000,c3976e80,c40f6000,...) at devfs_ioctl_f+0x10b kern_ioctl(c40f6000,3,d5985a12,c40f7000,125acec,...) at kern_ioctl+0x20d ioctl(c40f6000,d825acec,d825ad28,c0ceabb6,0,...) at ioctl+0x134 syscallenter(c40f6000,d825ace4,d825ace4,0,0,...) at syscallenter+0x263 syscall(d825ad28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (54, FreeBSD ELF32, ioctl), eip = 0x28239cb3, esp = 0xbfbfcdfc, ebp = 0xbfbfce38 --- lock order reversal: 1st 0xc434003c db->db_mtx (db->db_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:396 2nd 0xc4171dac os->os_lock (os->os_lock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:439 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,7379732f,646f6d2f,73656c75,73667a2f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c393f588,c3946c90,d825a758,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4171dac,c3eef85e,c3946c90,c3ef0053,...) at _witness_debugger+0x25 witness_checkorder(c4171dac,9,c3ef0053,1b7,0,...) at witness_checkorder+0x839 _sx_xlock(c4171dac,0,c3ef0053,1b7,c433dcbc,...) at _sx_xlock+0x85 dnode_destroy(c433de28,c3ee749a,c3ef1241,c40f6000,20,...) at dnode_destroy+0x41 dnode_buf_pageout(c4340000,c4126000,c434003c,0,c4340000,...) at dnode_buf_pageout+0x99 dbuf_evict_user(c4340054,8,c3ef1241,18c,0,...) at dbuf_evict_user+0x4c dbuf_clear(c4340000,0,c3ef1241,18c,c40f60b0,...) at dbuf_clear+0x3e dnode_evict_dbufs(c433e000,c3eef27f,204,207,c4171dac,...) at dnode_evict_dbufs+0xa8 dmu_objset_evict_dbufs(c4171c00,3,0,c3dbf2ce,c434003c,...) at dmu_objset_evict_dbufs+0x144 dmu_objset_evict(c4171c00,c4126064,df51772e,d825a9c8,c3e1c482,...) at dmu_objset_evict+0xbd dsl_pool_close(c42a2000,c3ef9e9e,12e,12a,df51772e,...) at dsl_pool_close+0x73 spa_unload(c40ee000,c3b111c0,d825aaac,c40ee1a4,246,...) at spa_unload+0x72 spa_load(0,6,0,5,c3ee7ee0,...) at spa_load+0x724 spa_load_best(ffffffff,ffffffff,1,949,c0e47ce0,...) at spa_load_best+0x59 spa_open_common(c3b11ae0,0,c3ee938b,c40f7000,0,...) at spa_open_common+0x15e pool_status_check(c40f7000,2,0,12,0,...) at pool_status_check+0x2c zfsdev_ioctl(c3cdc800,d5985a12,c40f7000,0,c40f6000,...) at zfsdev_ioctl+0x238 devfs_ioctl_f(c3d10af0,d5985a12,c40f7000,c3976e80,c40f6000,...) at devfs_ioctl_f+0x10b kern_ioctl(c40f6000,3,d5985a12,c40f7000,125acec,...) at kern_ioctl+0x20d ioctl(c40f6000,d825acec,d825ad28,c0ceabb6,0,...) at ioctl+0x134 syscallenter(c40f6000,d825ace4,d825ace4,0,0,...) at syscallenter+0x263 syscall(d825ad28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (54, FreeBSD ELF32, ioctl), eip = 0x28239cb3, esp = 0xbfbfcdfc, ebp = 0xbfbfce38 --- lock order reversal: 1st 0xc441434c db->db_mtx (db->db_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1242 2nd 0xc3b10120 dr->dt.di.dr_mtx (dr->dt.di.dr_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1246 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,752f2040,732f7273,732f6372,6d2f7379,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c393f588,c393f520,d83fe8e4,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c3b10120,c3eedbd5,c393f520,c3eec7b9,...) at _witness_debugger+0x25 witness_checkorder(c3b10120,9,c3eec7b9,4de,0,...) at witness_checkorder+0x839 _sx_xlock(c3b10120,0,c3eec7b9,4de,1,...) at _sx_xlock+0x85 dbuf_dirty(c4414310,c44c7a00,30,0,0,...) at dbuf_dirty+0xa3f dmu_write(c41dbc00,21,0,2d58,0,...) at dmu_write+0x1a5 space_map_sync(c4292a58,1,c429282c,c41dbc00,c44c7a00,...) at space_map_sync+0x348 metaslab_sync(c4292800,10f,0,0,d83feb84,...) at metaslab_sync+0x213 vdev_sync(c4360000,10f,0,c44c6000,1,...) at vdev_sync+0x120 spa_sync(c40ee000,10f,0,0,0,...) at spa_sync+0x3de txg_sync_thread(c41dc000,d83fed28,c0ce0b9b,35b,c3d51550,...) at txg_sync_thread+0x1ac fork_exit(c3e2cb50,c41dc000,d83fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xd83fed60, ebp = 0 --- lock order reversal: 1st 0xc465c9e8 zfs (zfs) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/gfs.c:488 2nd 0xc4361214 zfsvfs->z_hold_mtx[i] (zfsvfs->z_hold_mtx[i]) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1116 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,746d5f64,5d695b78,20402029,7273752f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c39477f0,c3947788,d8222838,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4361214,c3f05c47,c3947788,c3f0044d,...) at _witness_debugger+0x25 witness_checkorder(c4361214,9,c3f0044d,45c,0,...) at witness_checkorder+0x839 _sx_xlock(c4361214,0,c3f0044d,45c,d8222890,...) at _sx_xlock+0x85 zfs_zget(c4361000,3,0,d8222908,0,...) at zfs_zget+0x56 zfs_root(c3cfc288,80000,d8222960,1,c3f0a480,...) at zfs_root+0x56 zfsctl_create(c4361000,d8222a04,d8222a28,0,198526,...) at zfsctl_create+0x97 zfs_mount(c3cfc288,c3f0aac0,c39dd660,c3976e80,0,...) at zfs_mount+0x653 vfs_donmount(c3ce02d0,0,c398f980,c398f980,c3a91d48,...) at vfs_donmount+0xb10 nmount(c3ce02d0,d8222cec,28205f10,1,0,...) at nmount+0x84 syscallenter(c3ce02d0,d8222ce4,c0c003fd,c0e49130,0,...) at syscallenter+0x263 syscall(d8222d28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, nmount), eip = 0x2819082b, esp = 0xbfbfceac, ebp = 0xbfbfcef8 --- lock order reversal: 1st 0xc46c0dd4 zp->z_name_lock (zp->z_name_lock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:220 2nd 0xc4127674 zfsvfs->z_hold_mtx[i] (zfsvfs->z_hold_mtx[i]) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1116 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,746d5f64,5d695b78,20402029,7273752f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c3947928,c3947788,d821e668,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4127674,c3f05c47,c3947788,c3f0044d,...) at _witness_debugger+0x25 witness_checkorder(c4127674,9,c3f0044d,45c,0,...) at witness_checkorder+0x839 _sx_xlock(c4127674,0,c3f0044d,45c,c4994fce,...) at _sx_xlock+0x85 zfs_zget(c4127000,203fb,0,d821e7c8,8,...) at zfs_zget+0x56 zfs_dirent_lock(d821e7cc,c46c0d9c,d821e844,d821e7c8,6,...) at zfs_dirent_lock+0x4fe zfs_dirlook(c46c0d9c,d821e844,d821eb44,0,0,...) at zfs_dirlook+0x90 zfs_lookup(d821eb58,0,c46c4b80,c3ce05a0,0,...) at zfs_lookup+0x2fd zfs_freebsd_lookup(d821e98c,c465c660,d821eb58,c465c660,d821e9ac,...) at zfs_freebsd_lookup+0x7b VOP_CACHEDLOOKUP_APV(c3f0ab60,d821e98c,d821eb58,d821eb44,c46c4b80,...) at VOP_CACHEDLOOKUP_APV+0xa5 vfs_cache_lookup(d821ea20,d821ea20,d821eb2c,200000,d821eb2c,...) at vfs_cache_lookup+0xd6 VOP_LOOKUP_APV(c3f0ab60,d821ea20,d821eb58,1f5,d821eb44,...) at VOP_LOOKUP_APV+0xa5 lookup(d821eb2c,c0cf2d3f,ee,c9,ffffff9c,...) at lookup+0x66b namei(d821eb2c,c090801b,c0d11923,c0cdceb4,3,...) at namei+0x57f kern_statat_vnhook(c3ce05a0,0,ffffff9c,2840e0c0,0,...) at kern_statat_vnhook+0x72 kern_statat(c3ce05a0,0,ffffff9c,2840e0c0,0,...) at kern_statat+0x3c kern_stat(c3ce05a0,2840e0c0,0,d821ebe8,488,...) at kern_stat+0x36 stat(c3ce05a0,d821ecec,d821ed28,c0ceabb6,0,...) at stat+0x2f syscallenter(c3ce05a0,d821ece4,d821ece4,0,246,...) at syscallenter+0x263 syscall(d821ed28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (188, FreeBSD ELF32, stat), eip = 0x2821695b, esp = 0xbfbfe76c, ebp = 0xbfbfe7e8 --- lock order reversal: 1st 0xc4127144 zfsvfs->z_teardown_inactive_lock (zfsvfs->z_teardown_inactive_lock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:4529 2nd 0xc4127674 zfsvfs->z_hold_mtx[i] (zfsvfs->z_hold_mtx[i]) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1359 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,746d5f64,5d695b78,20402029,7273752f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c39476b8,c3947788,d821e988,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4127674,c3f05c47,c3947788,c3f0044d,...) at _witness_debugger+0x25 witness_checkorder(c4127674,9,c3f0044d,54f,0,...) at witness_checkorder+0x839 _sx_xlock(c4127674,0,c3f0044d,54f,c4127674,...) at _sx_xlock+0x85 zfs_zinactive(c46c0c90,0,c3f05f98,11b1,c0f87830,...) at zfs_zinactive+0x6e zfs_inactive(c497f110,c46c4b80,0,d821ea3c,c0c1f695,...) at zfs_inactive+0x6f zfs_freebsd_inactive(d821ea54,c497f188,c497f110,c497f188,d821ea6c,...) at zfs_freebsd_inactive+0x29 VOP_INACTIVE_APV(c3f0ab60,d821ea54,c0cf38e6,93d,c0e145e0,...) at VOP_INACTIVE_APV+0xa5 vinactive(c497f188,0,c0cf38e6,8bc,0,...) at vinactive+0x8e vputx(d821eb8c,c095bb1e,c497f110,ffffffdf,c46c4b80,...) at vputx+0x2f8 vput(c497f110,ffffffdf,c46c4b80,0,c3ce05a0,...) at vput+0x10 kern_statat_vnhook(c3ce05a0,0,ffffff9c,2840e0c0,0,...) at kern_statat_vnhook+0xee kern_statat(c3ce05a0,0,ffffff9c,2840e0c0,0,...) at kern_statat+0x3c kern_stat(c3ce05a0,2840e0c0,0,d821ebe8,488,...) at kern_stat+0x36 stat(c3ce05a0,d821ecec,d821ed28,c0ceabb6,0,...) at stat+0x2f syscallenter(c3ce05a0,d821ece4,d821ece4,0,246,...) at syscallenter+0x263 syscall(d821ed28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (188, FreeBSD ELF32, stat), eip = 0x2821695b, esp = 0xbfbfe76c, ebp = 0xbfbfe7e8 --- lock order reversal: 1st 0xc499a320 dr->dt.di.dr_mtx (dr->dt.di.dr_mtx) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2243 2nd 0xc4af5000 dn->dn_struct_rwlock (dn->dn_struct_rwlock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2194 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,6f6c7772,20296b63,752f2040,732f7273,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c393f520,c3946dc8,d83fe7a4,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4af5000,c3ef0e87,c3946dc8,c3eec7b9,...) at _witness_debugger+0x25 witness_checkorder(c4af5000,1,c3eec7b9,892,0,...) at witness_checkorder+0x839 _sx_slock(c4af5000,0,c3eec7b9,892,20000,...) at _sx_slock+0x85 dbuf_check_blkptr(c49ae9e4,c3ee6b0f,c3eec7b9,8d7,c4af686c,...) at dbuf_check_blkptr+0x28f dbuf_sync_list(c499a334,c47b1400,c3eec7b9,8c3,c3ef1241,...) at dbuf_sync_list+0x354 dbuf_sync_list(c4af50e4,c47b1400,6e,0,c3ee771c,...) at dbuf_sync_list+0x1de dnode_sync(c4af5000,c47b1400,0,d83feab4,c3db0d10,...) at dnode_sync+0x10f9 dmu_objset_sync_dnodes(c41d0000,c47b1400,773,0,c435c080,...) at dmu_objset_sync_dnodes+0xdc dmu_objset_sync(c41d0000,c41a4000,c47b1400,0,c40ee590,...) at dmu_objset_sync+0x1d5 dsl_pool_sync(c41dc000,773,0,c47b0000,2,...) at dsl_pool_sync+0x10e spa_sync(c40ee000,773,0,0,0,...) at spa_sync+0x33c txg_sync_thread(c41dc000,d83fed28,c0ce0b9b,35b,c3d51550,...) at txg_sync_thread+0x1ac fork_exit(c3e2cb50,c41dc000,d83fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xd83fed60, ebp = 0 --- lock order reversal: (sleepable after non-sleepable) 1st 0xc70b6188 vnode interlock (vnode interlock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1882 2nd 0xc6ef3630 hdl->sa_lock (hdl->sa_lock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1427 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,732f6372,6d2f7379,6c75646f,7a2f7365,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c393f1e0,c3947a60,e2fbba2c,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c6ef3630,c3ef77e5,c3947a60,c3ef7235,...) at _witness_debugger+0x25 witness_checkorder(c6ef3630,9,c3ef7235,593,0,...) at witness_checkorder+0x839 _sx_xlock(c6ef3630,0,c3ef7235,593,e2fbbae8,...) at _sx_xlock+0x85 sa_lookup(c6ef3630,9,e2fbbae8,8,e2fbbaf8,...) at sa_lookup+0x4a zfs_freebsd_remove(e2fbbc00,0,0,0,c70b6110,...) at zfs_freebsd_remove+0x784 VOP_REMOVE_APV(c3f0ab60,e2fbbc00,c70b6110,e2fbbbd8,c4af3660,...) at VOP_REMOVE_APV+0xa5 kern_unlinkat(c41222d0,ffffff9c,bfbfe888,0,0,...) at kern_unlinkat+0x1fb kern_unlink(c41222d0,bfbfe888,0,e2fbbc7c,c0900a83,...) at kern_unlink+0x2f unlink(c41222d0,e2fbbcec,e2fbbd28,c0ceabb6,0,...) at unlink+0x22 syscallenter(c41222d0,e2fbbce4,e2fbbce4,0,0,...) at syscallenter+0x263 syscall(e2fbbd28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, unlink), eip = 0x28179edf, esp = 0xbfbfe84c, ebp = 0xbfbfea98 --- lock order reversal: 1st 0xc51d923c zp->z_parent_lock (zp->z_parent_lock) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:406 2nd 0xc4127584 zfsvfs->z_hold_mtx[i] (zfsvfs->z_hold_mtx[i]) _at_ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1116 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,746d5f64,5d695b78,20402029,7273752f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c39478c0,c3947788,e2fcd6d4,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c4127584,c3f05c47,c3947788,c3f0044d,...) at _witness_debugger+0x25 witness_checkorder(c4127584,9,c3f0044d,45c,0,...) at witness_checkorder+0x839 _sx_xlock(c4127584,0,c3f0044d,45c,0,...) at _sx_xlock+0x85 zfs_zget(c4127000,240af,0,e2fcd7c8,40,...) at zfs_zget+0x56 zfs_dirlook(c51d9218,e2fcd844,e2fcdb44,0,0,...) at zfs_dirlook+0x24b zfs_lookup(e2fcdb58,0,c46c4b80,c49855a0,0,...) at zfs_lookup+0x2fd zfs_freebsd_lookup(e2fcd98c,c4af3660,e2fcdb58,c4af3660,e2fcd9ac,...) at zfs_freebsd_lookup+0x7b VOP_CACHEDLOOKUP_APV(c3f0ab60,e2fcd98c,e2fcdb58,e2fcdb44,c46c4b80,...) at VOP_CACHEDLOOKUP_APV+0xa5 vfs_cache_lookup(e2fcda20,e2fcda20,e2fcdb2c,200000,e2fcdb2c,...) at vfs_cache_lookup+0xd6 VOP_LOOKUP_APV(c3f0ab60,e2fcda20,e2fcdb58,1f5,e2fcdb44,...) at VOP_LOOKUP_APV+0xa5 lookup(e2fcdb2c,c0cf2d3f,ee,c9,ffffff9c,...) at lookup+0x66b namei(e2fcdb2c,1,c393fee0,c39453c8,c,...) at namei+0x57f kern_statat_vnhook(c49855a0,0,ffffff9c,284a6040,0,...) at kern_statat_vnhook+0x72 kern_statat(c49855a0,0,ffffff9c,284a6040,0,...) at kern_statat+0x3c kern_stat(c49855a0,284a6040,0,e2fcdbe8,3,...) at kern_stat+0x36 stat(c49855a0,e2fcdcec,e2fcdd28,c0ceabb6,0,...) at stat+0x2f syscallenter(c49855a0,e2fcdce4,e2fcdce4,0,0,...) at syscallenter+0x263 syscall(e2fcdd28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (188, FreeBSD ELF32, stat), eip = 0x2817c95b, esp = 0xbfbfe90c, ebp = 0xbfbfea18 --- lock order reversal: 1st 0xc3557eec bufwait (bufwait) _at_ /usr/src/sys/kern/vfs_bio.c:2659 2nd 0xc46e2200 dirhash (dirhash) _at_ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0ce9121,7366752f,7366752f,7269645f,68736168,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f756b,c0cec28f,c3942168,c3945430,e2fca868,...) at kdb_backtrace+0x2a _witness_debugger(c0cec28f,c46e2200,c0d10768,c3945430,c0d103ed,...) at _witness_debugger+0x25 witness_checkorder(c46e2200,9,c0d103ed,11c,0,...) at witness_checkorder+0x839 _sx_xlock(c46e2200,0,c0d103ed,11c,c46650e8,...) at _sx_xlock+0x85 ufsdirhash_acquire(c3557e8c,d8adc3dc,24,d8adc3f0,e2fca938,...) at ufsdirhash_acquire+0x35 ufsdirhash_add(c46650e8,e2fca994,3f0,e2fca924,e2fca928,...) at ufsdirhash_add+0x13 ufs_direnter(c46a3770,c7ec9220,e2fca994,e2fcabcc,0,...) at ufs_direnter+0x6f9 ufs_makeinode(e2fcabcc,3f3,e2fcaae0,c08afcd3,c3cfc798,...) at ufs_makeinode+0x557 ufs_symlink(e2fcabf4,e2fcac0c,0,0,e2fcab38,...) at ufs_symlink+0x33 VOP_SYMLINK_APV(c0df9780,e2fcabf4,e2fcabcc,e2fcab38,c48f9400,...) at VOP_SYMLINK_APV+0xa5 kern_symlinkat(c4985870,bfbfec49,ffffff9c,bfbfec4b,0,...) at kern_symlinkat+0x28c kern_symlink(c4985870,bfbfec49,bfbfec4b,0,e2fcac7c,...) at kern_symlink+0x2e symlink(c4985870,e2fcacec,280daba8,1,0,...) at symlink+0x29 syscallenter(c4985870,e2fcace4,c0c003fd,c0e49130,0,...) at syscallenter+0x263 syscall(e2fcad28) at syscall+0x34 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (57, FreeBSD ELF32, symlink), eip = 0x280dabaf, esp = 0xbfbfd8bc, ebp = 0xbfbfea28 ---Received on Fri Dec 17 2010 - 06:56:04 UTC
This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:40:10 UTC