Write Failed message with 9.1-RC3
Reed A. Cartwright
cartwright at asu.edu
Tue Nov 27 05:15:32 UTC 2012
Mark,
Shutdown happens cleanly. My pciconf.log is attached. sysctl.conf is
empty. Kernel is uncustomized amd64:
FreeBSD herschel.biodesign.asu.edu 9.1-RC3 FreeBSD 9.1-RC3 #0 r242324:
Tue Oct 30 00:58:57 UTC 2012
root at farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
loader.conf:
zfs_load="YES"
geom_eli_load="YES"
ahci_load="YES"
vfs.root.mountfrom="zfs:zroot"
debug.acpi.max_tasks="128"
#vboxdrv_load="YES"
kern.maxfiles="65536"
kldstat:
Id Refs Address Size Name
1 46 0xffffffff80200000 1323388 kernel
2 1 0xffffffff81524000 2084d8 zfs.ko
3 2 0xffffffff8172d000 5c58 opensolaris.ko
4 1 0xffffffff81733000 1f988 geom_eli.ko
5 2 0xffffffff81753000 2b470 crypto.ko
6 2 0xffffffff8177f000 dde0 zlib.ko
7 1 0xffffffff81812000 15c2 fdescfs.ko
8 1 0xffffffff81814000 3dfc linprocfs.ko
9 2 0xffffffff81818000 1f3dc linux.ko
10 1 0xffffffff81838000 a0e linsysfs.ko
11 2 0xffffffff81839000 29f1 vboxnetflt.ko
12 2 0xffffffff8183c000 2c018 vboxdrv.ko
13 2 0xffffffff81869000 87b2 netgraph.ko
14 1 0xffffffff81872000 1579 ng_ether.ko
15 1 0xffffffff81874000 3f8a vboxnetadp.ko
16 1 0xffffffff81878000 ce8a ipfw.ko
17 1 0xffffffff81885000 21d green_saver.ko
ZFS Properties:
NAME PROPERTY VALUE
SOURCE
storage mountpoint legacy
local
storage atime off
local
storage/home mountpoint /home
local
storage/jails mountpoint /jails
local
storage/storage mountpoint
/storage local
zroot mountpoint legacy
local
zroot checksum
fletcher4 local
storage/home xattr off
temporary
storage/jails xattr off
temporary
storage/storage xattr off
temporary
storage/storage/tt xattr off
temporary
zroot xattr off
temporary
ZFS Status:
pool: storage
state: ONLINE
scan: scrub repaired 0 in 9h21m with 0 errors on Sat Nov 17 12:23:44 2012
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
da0 ONLINE 0 0 0
da1 ONLINE 0 0 0
da2 ONLINE 0 0 0
da3 ONLINE 0 0 0
da4 ONLINE 0 0 0
da5 ONLINE 0 0 0
da6 ONLINE 0 0 0
da7 ONLINE 0 0 0
cache
da8 ONLINE 0 0 0
errors: No known data errors
pool: zroot
state: ONLINE
scan: scrub repaired 0 in 0h14m with 0 errors on Sat Nov 17 03:16:09 2012
config:
NAME STATE READ WRITE CKSUM
zroot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
da11p2 ONLINE 0 0 0
da10p2 ONLINE 0 0 0
errors: No known data errors
On Mon, Nov 26, 2012 at 9:09 PM, Mark Saad <nonesuch at longcount.org> wrote:
>
>
>
> On Nov 26, 2012, at 4:01 PM, "Reed A. Cartwright" <cartwright at asu.edu> wrote:
>
>> I'm new to this list...
>>
>> I'm running a bioinformatics server using 9.1-RC3 (64 cores, 512GB
>> ram). I have a ZFS raid-z2 array attached to an LSI controller with a
>> SSD cache drive.
>
> Can you tell us more about this server . Can you post the output of pciconf -lv ,
> What do you have in loader.conf and sysctl.conf ? Do you se a custom kernel build; What are the changes you made to that config ?
>>
>> Since upgrading to 9.1-RC2/3 (for AVX support), I have been
>> experiencing hard drive lockups with the message "write failed"
>> printed to the console. After this reading from the hard drives no
>> longer work, but the machine is not locked up. If the appropriate
>> files are in the cache, I can log in and execute programs. I know the
>> LSI driver has been updated in 9.1 and I have updated my cards' bios
>> to match. It doesn't seem to make a difference.
>>
>> Once I was able to run top, and saw that many processes were stuck in
>> the 'tx->tx' state.
>
> What does your zfs config look like can you post the output if zpool status ? What zfz options have you set on pool and filesystens ?
>
> Lastly In a shutdown -h now , does the system properly shutdown ,does it crash and dump core ?
>>
>> So far, no corruption appears to have occurred in the drives.
>>
>> I'm about to downgrade to 9.0, but I wanted to know if anyone has any
>> idea what the issue is.
>>
>> --
>> Reed A. Cartwright, PhD
>> Assistant Professor of Genomics, Evolution, and Bioinformatics
>> School of Life Sciences
>> Center for Evolutionary Medicine and Informatics
>> The Biodesign Institute
>> Arizona State University
>> _______________________________________________
>> freebsd-stable at freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org"
>
> ---
> Mark saad | mark.saad at longcount.org
>
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org"
--
Reed A. Cartwright, PhD
Assistant Professor of Genomics, Evolution, and Bioinformatics
School of Life Sciences
Center for Evolutionary Medicine and Informatics
The Biodesign Institute
Arizona State University
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pciconf.log
Type: application/octet-stream
Size: 17091 bytes
Desc: not available
URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20121126/dddc29d5/attachment.obj>
More information about the freebsd-stable
mailing list