3ware 7006-2 RAID degradation on reboot
Jon Nathan
jon at rupture.net
Wed Sep 29 13:44:45 PDT 2004
Hi,
I'm running BETA6 with a 3ware 7006-2 SATA RAID controller. On reboot
(also shutdown -r now), it loses its RAID integrity each time. I
can rebuild it, but it takes a long time and is generally a hassle.
Is this a known problem? Below find local info:
root at zen:~> uname -a
FreeBSD zen.rupture.net 5.3-BETA6 FreeBSD 5.3-BETA6 #12: Wed Sep 29
17:57:25 EDT 2004 root at zen.rupture.net:/usr/obj/usr/src/sys/ZEN
i386
root at zen:~>
root at zen:~> tw_cli info c0
Controller: c0
-------------
Driver: 1.50.01.002
Model: 7006-2
FW: FE7X 1.05.00.063
BIOS: BE7X 1.08.00.048
Monitor: ME7X 1.01.00.038
Serial #: F14802A4170244
PCB: Rev4
PCHIP: 1.30-66
ACHIP: 3.20
# of units: 1
Unit 0: RAID 1 186.31 GB ( 390719920 blocks): DEGRADED
# of ports: 2
Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0)
Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0)
root at zen:~> tw_cli info c0 u0
Unit /c0/u0
---------------------
Status: DEGRADED
Unit Type: RAID 1
Stripe Size: N/A
Size: 186.31 GB (390719920 blocks)
# of subunits: 2
Subunit 0: CBOD: OK
Physical Port: 1
Logical Port: 0
Subunit 1: CBOD: DEGRADED
Physical Port: 0
Logical Port: 1
root at zen:~> tw_cli maint remove c0 p0
Removing port /c0/p0 ... Done.
root at zen:~> tw_cli maint rescan c0
Rescanning controller /c0 for units and drives ...Done.
root at zen:~> tw_cli maint rebuild c0 u0 p0
Rebuild started on unit /c0/u0
root at zen:~> tw_cli info c0 u0
Unit /c0/u0
---------------------
Status: REBUILDING (0%)
Unit Type: RAID 1
Stripe Size: N/A
Size: 186.31 GB (390719920 blocks)
# of subunits: 2
Subunit 0: CBOD: OK
Physical Port: 1
Logical Port: 0
Subunit 1: CBOD: DEGRADED
Physical Port: 0
Logical Port: 1
root at zen:~> tw_cli info c0
Controller: c0
-------------
Driver: 1.50.01.002
Model: 7006-2
FW: FE7X 1.05.00.063
BIOS: BE7X 1.08.00.048
Monitor: ME7X 1.01.00.038
Serial #: F14802A4170244
PCB: Rev4
PCHIP: 1.30-66
ACHIP: 3.20
# of units: 1
Unit 0: RAID 1 186.31 GB ( 390719920 blocks): REBUILDING (1%)
# of ports: 2
Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0)
Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0)
root at zen:~>
root at zen:~> dmesg
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 5.3-BETA6 #12: Wed Sep 29 17:57:25 EDT 2004
root at zen.rupture.net:/usr/obj/usr/src/sys/ZEN
ACPI APIC Table: <ASUS CUR-DLS >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel Pentium III (866.70-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x686 Stepping = 6
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 2147463168 (2047 MB)
avail memory = 2099101696 (2001 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 3
cpu1 (AP): APIC ID: 0
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <ASUS CUR-DLS> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
fxp0: <Intel 82559 Pro/100 Ethernet> port 0xd800-0xd83f mem 0xfd800000-0xfd8fffff,0xfe000000-0xfe000fff irq 20 at device 2.0 on pci0
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:e0:18:02:c7:ea
twe0: <3ware Storage Controller. Driver version 1.50.01.002> port 0xd400-0xd40f mem 0xfc800000-0xfcffffff irq 18 at device 5.0 on pci0
twe0: [GIANT-LOCKED]
twe0: AEN: <twe0: degraded unit for unknown unit 0>
twe0: 2 ports, Firmware FE7X 1.05.00.063, BIOS BE7X 1.08.00.048
pci0: <display, VGA> at device 7.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0xe800-0xe80f at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 UDMA33 controller> port 0xb800-0xb80f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
pcib1: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib1
fxp1: <Intel 82559 Pro/100 Ethernet> port 0xb400-0xb43f mem 0xf9000000-0xf90fffff,0xf9800000-0xf9800fff irq 23 at device 4.0 on pci1
miibus1: <MII bus> on fxp1
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: Ethernet address: 00:02:b3:11:33:32
pci1: <mass storage, SCSI> at device 5.0 (no driver attached)
pci1: <mass storage, SCSI> at device 5.1 (no driver attached)
speaker0 port 0x61 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A
sio1 port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0 port 0x778-0x77a,0x378-0x37f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
orm0: <ISA Option ROMs> at iomem 0xd4000-0xd4fff,0xd0000-0xd0fff,0xc0000-0xca7ff on isa0
sc0: <System console> on isa0
sc0: VGA <8 virtual consoles, flags=0x200>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
Profiling kernel, textsize=2570960 [c042b140..c069ec10]
cputime 5039, empty_loop 7, nullfunc_loop_profiled -89048, mcount 124477, mexitcount 17269
Profiling overheads: mcount: 5028+119435, -142430+266894; mexitcount: 5028+12230, -36123+53382 nsec
Profiling overheads: mcount: 768+18241, -21753+40762; mexitcount: 768+1868, -5517+8153 cycles
ATAPI_RESET time = 70us
acd0: CDROM <CD-540E/1.0A> at ata1-master UDMA33
twed0: <Unit 0, TwinStor, Degraded> on twe0
twed0: 190781MB (390719920 sectors)
SMP: AP CPU #1 Launched!
Mounting root from ufs:/dev/twed0s1a
twe0: AEN: <twed0: rebuild started>
twe0: AEN: <twe0: port 0: ATA UDMA downgrade>
root at zen:~>
This is a 2xPIII 866 host. Any advice on SMP options that I should
use would be appreciated as well. The below seems stable and happy,
with the 3ware exception. Stripped Kernel config:
machine i386
profile 2
device apic # I/O apic
cpu I686_CPU # aka Pentium Pro(tm)
options PERFMON
options DEVICE_POLLING
options HZ=1000
device speaker #Play IBM BASIC-style noises out your speaker
device isa # Required by npx(4)
options AUTO_EOI_1
device pci
device npx
device io
hints "ZEN.hints" # Default places to look for devices.
ident ZEN
maxusers 0
makeoptions CONF_CFLAGS=-fno-builtin #Don't allow use of memcmp, etc.
options MAXDSIZ=(1024UL*1024*1024)
options MAXSSIZ=(128UL*1024*1024)
options DFLDSIZ=(1024UL*1024*1024)
options BLKDEV_IOSIZE=8192
options PQ_CACHESIZE=512 # color for 512k cache
options INCLUDE_CONFIG_FILE # Include this file in kernel
options GEOM_BDE # Disk encryption.
options GEOM_BSD # BSD disklabels
options ROOTDEVNAME=\"ufs:twed0s1a\"
options SCHED_4BSD
options SMP # Symmetric MultiProcessor Kernel
options ADAPTIVE_GIANT
options PREEMPTION
options COMPAT_43
options COMPAT_FREEBSD4
options SYSVSHM
options SYSVSEM
options SYSVMSG
options KTRACE #kernel tracing
options COMPILING_LINT
options INET #Internet communications protocols
device ether #Generic Ethernet
device loop #Network loopback device
device bpf #Berkeley packet filter
device pf #PF OpenBSD packet-filter firewall
device pflog #logging support interface for PF
options ETHER_8022 # enable Ethernet_802.2 frame
options ACCEPT_FILTER_DATA
options ACCEPT_FILTER_HTTP
options FFS #Fast filesystem
options CD9660 #ISO 9660 filesystem
options PROCFS #Process filesystem (requires PSEUDOFS)
options PSEUDOFS #Pseudo-filesystem framework
options SOFTUPDATES
options UFS_DIRHASH
options QUOTA #enable disk quotas
device random
device mem
options _KPOSIX_PRIORITY_SCHEDULING
device scbus #base SCSI code
device pass #CAM passthrough driver
device pty #Pseudo ttys
options MSGBUF_SIZE=40960
device atkbdc
device atkbd
device vga
device sc
options MAXCONS=8 # number of virtual consoles
options SC_NO_SYSMOUSE
device asr
device twe # 3ware ATA RAID
device ata
device atadisk # ATA disk drives
device atapicd # ATAPI CDROM drives
options ATA_STATIC_ID
device fdc
device sio
device miibus
device fxp # Intel EtherExpress PRO/100B (82557, 82558)
device ppc
device ppbus
device lpt
device ppi
options INIT_PATH=/sbin/init:/stand/sysinstall
options SEMMAP=31
options SEMMNI=11
options SEMMNS=61
options SEMMNU=31
options SEMMSL=61
options SEMOPM=101
options SEMUME=11
options SHMALL=1025
options SHMMAX=(SHMMAXPGS*PAGE_SIZE+1)
options SHMMAXPGS=1025
options SHMMIN=2
options SHMMNI=33
options SHMSEG=9
options MSGMNB=2049 # Max number of chars in queue
options MSGMNI=41 # Max number of message queue identifiers
options MSGSEG=2049 # Max number of message segments
options MSGSSZ=16 # Size of a message segment
options MSGTQL=41 # Max number of messages in system
options NBUF=512 # Number of buffer headers
options NMBCLUSTERS=16384 # Number of mbuf clusters
One final question: How do I increase the number of available
pty's in 5.x? It seems to max out at about 40.
-jon
--
Jon Nathan
jon at rupture.net
More information about the freebsd-current
mailing list