3ware 7006-2 RAID degradation on reboot

Jon Nathan jon at rupture.net
Wed Sep 29 13:44:45 PDT 2004


Hi,

I'm running BETA6 with a 3ware 7006-2 SATA RAID controller.  On reboot
(also shutdown -r now), it loses its RAID integrity each time.  I
can rebuild it, but it takes a long time and is generally a hassle.
Is this a known problem?  Below find local info:

root at zen:~> uname -a
FreeBSD zen.rupture.net 5.3-BETA6 FreeBSD 5.3-BETA6 #12: Wed Sep 29
17:57:25 EDT 2004     root at zen.rupture.net:/usr/obj/usr/src/sys/ZEN
i386
root at zen:~> 
root at zen:~> tw_cli info c0
Controller: c0
-------------
Driver:   1.50.01.002
Model:    7006-2
FW:       FE7X 1.05.00.063
BIOS:     BE7X 1.08.00.048
Monitor:  ME7X 1.01.00.038
Serial #: F14802A4170244
PCB:      Rev4
PCHIP:    1.30-66
ACHIP:    3.20


# of units: 1
        Unit 0: RAID 1 186.31 GB ( 390719920 blocks): DEGRADED

# of ports: 2
        Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0)
        Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0)
root at zen:~> tw_cli info c0 u0
Unit /c0/u0
---------------------
Status:        DEGRADED
Unit Type:     RAID 1
Stripe Size:   N/A
Size:          186.31 GB (390719920 blocks)
# of subunits: 2

        Subunit 0:    CBOD: OK
        Physical Port: 1
        Logical  Port: 0

        Subunit 1:    CBOD: DEGRADED
        Physical Port: 0
        Logical  Port: 1
root at zen:~> tw_cli maint remove c0 p0
Removing port /c0/p0 ... Done.
root at zen:~> tw_cli maint rescan c0
Rescanning controller /c0 for units and drives ...Done.

root at zen:~> tw_cli maint rebuild c0 u0 p0
Rebuild started on unit /c0/u0

root at zen:~> tw_cli info c0 u0
Unit /c0/u0
---------------------
Status:        REBUILDING (0%)
Unit Type:     RAID 1
Stripe Size:   N/A
Size:          186.31 GB (390719920 blocks)
# of subunits: 2

        Subunit 0:    CBOD: OK
        Physical Port: 1
        Logical  Port: 0

        Subunit 1:    CBOD: DEGRADED
        Physical Port: 0
        Logical  Port: 1
root at zen:~> tw_cli info c0
Controller: c0
-------------
Driver:   1.50.01.002
Model:    7006-2
FW:       FE7X 1.05.00.063
BIOS:     BE7X 1.08.00.048
Monitor:  ME7X 1.01.00.038
Serial #: F14802A4170244
PCB:      Rev4
PCHIP:    1.30-66
ACHIP:    3.20


# of units: 1
        Unit 0: RAID 1 186.31 GB ( 390719920 blocks): REBUILDING (1%)

# of ports: 2
        Port 0: ST3200822A 3LJ18AKZ 186.31 GB (390721968 blocks): OK(unit 0)
        Port 1: ST3200822A 3LJ1977D 186.31 GB (390721968 blocks): OK(unit 0)
root at zen:~> 
root at zen:~> dmesg
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 5.3-BETA6 #12: Wed Sep 29 17:57:25 EDT 2004
    root at zen.rupture.net:/usr/obj/usr/src/sys/ZEN
ACPI APIC Table: <ASUS   CUR-DLS >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel Pentium III (866.70-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x686  Stepping = 6
  Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 2147463168 (2047 MB)
avail memory = 2099101696 (2001 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  3
 cpu1 (AP): APIC ID:  0
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <ASUS CUR-DLS> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
fxp0: <Intel 82559 Pro/100 Ethernet> port 0xd800-0xd83f mem 0xfd800000-0xfd8fffff,0xfe000000-0xfe000fff irq 20 at device 2.0 on pci0
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:e0:18:02:c7:ea
twe0: <3ware Storage Controller. Driver version 1.50.01.002> port 0xd400-0xd40f mem 0xfc800000-0xfcffffff irq 18 at device 5.0 on pci0
twe0: [GIANT-LOCKED]
twe0: AEN: <twe0: degraded unit for unknown unit 0>
twe0: 2 ports, Firmware FE7X 1.05.00.063, BIOS BE7X 1.08.00.048
pci0: <display, VGA> at device 7.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0xe800-0xe80f at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 UDMA33 controller> port 0xb800-0xb80f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
pcib1: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib1
fxp1: <Intel 82559 Pro/100 Ethernet> port 0xb400-0xb43f mem 0xf9000000-0xf90fffff,0xf9800000-0xf9800fff irq 23 at device 4.0 on pci1
miibus1: <MII bus> on fxp1
inphy1: <i82555 10/100 media interface> on miibus1
inphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: Ethernet address: 00:02:b3:11:33:32
pci1: <mass storage, SCSI> at device 5.0 (no driver attached)
pci1: <mass storage, SCSI> at device 5.1 (no driver attached)
speaker0 port 0x61 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A
sio1 port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0 port 0x778-0x77a,0x378-0x37f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
orm0: <ISA Option ROMs> at iomem 0xd4000-0xd4fff,0xd0000-0xd0fff,0xc0000-0xca7ff on isa0
sc0: <System console> on isa0
sc0: VGA <8 virtual consoles, flags=0x200>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
Profiling kernel, textsize=2570960 [c042b140..c069ec10]
cputime 5039, empty_loop 7, nullfunc_loop_profiled -89048, mcount 124477, mexitcount 17269
Profiling overheads: mcount: 5028+119435, -142430+266894; mexitcount: 5028+12230, -36123+53382 nsec
Profiling overheads: mcount: 768+18241, -21753+40762; mexitcount: 768+1868, -5517+8153 cycles
ATAPI_RESET time = 70us
acd0: CDROM <CD-540E/1.0A> at ata1-master UDMA33
twed0: <Unit 0, TwinStor, Degraded> on twe0
twed0: 190781MB (390719920 sectors)
SMP: AP CPU #1 Launched!
Mounting root from ufs:/dev/twed0s1a
twe0: AEN: <twed0: rebuild started>
twe0: AEN: <twe0: port 0: ATA UDMA downgrade>
root at zen:~> 

This is a 2xPIII 866 host.  Any advice on SMP options that I should
use would be appreciated as well.  The below seems stable and happy,
with the 3ware exception.  Stripped Kernel config:

machine         i386
profile         2
device          apic                    # I/O apic
cpu             I686_CPU                # aka Pentium Pro(tm)
options         PERFMON
options         DEVICE_POLLING
options         HZ=1000
device          speaker         #Play IBM BASIC-style noises out your speaker
device          isa             # Required by npx(4)
options         AUTO_EOI_1
device          pci
device          npx
device          io
hints           "ZEN.hints"             # Default places to look for devices.
ident           ZEN
maxusers        0
makeoptions     CONF_CFLAGS=-fno-builtin  #Don't allow use of memcmp, etc.
options         MAXDSIZ=(1024UL*1024*1024)
options         MAXSSIZ=(128UL*1024*1024)
options         DFLDSIZ=(1024UL*1024*1024)
options         BLKDEV_IOSIZE=8192
options         PQ_CACHESIZE=512        # color for 512k cache
options         INCLUDE_CONFIG_FILE     # Include this file in kernel
options         GEOM_BDE                # Disk encryption.
options         GEOM_BSD                # BSD disklabels
options         ROOTDEVNAME=\"ufs:twed0s1a\"
options         SCHED_4BSD
options         SMP                     # Symmetric MultiProcessor Kernel
options         ADAPTIVE_GIANT
options         PREEMPTION
options         COMPAT_43
options         COMPAT_FREEBSD4
options         SYSVSHM
options         SYSVSEM
options         SYSVMSG
options         KTRACE                  #kernel tracing
options         COMPILING_LINT
options         INET                    #Internet communications protocols
device          ether                   #Generic Ethernet
device          loop                    #Network loopback device
device          bpf                     #Berkeley packet filter
device          pf                      #PF OpenBSD packet-filter firewall
device          pflog                   #logging support interface for PF
options         ETHER_8022              # enable Ethernet_802.2 frame
options         ACCEPT_FILTER_DATA
options         ACCEPT_FILTER_HTTP
options         FFS                     #Fast filesystem
options         CD9660                  #ISO 9660 filesystem
options         PROCFS                  #Process filesystem (requires PSEUDOFS)
options         PSEUDOFS                #Pseudo-filesystem framework
options         SOFTUPDATES
options         UFS_DIRHASH
options         QUOTA                   #enable disk quotas
device          random
device          mem
options         _KPOSIX_PRIORITY_SCHEDULING
device          scbus           #base SCSI code
device          pass            #CAM passthrough driver
device          pty                     #Pseudo ttys
options         MSGBUF_SIZE=40960
device          atkbdc
device          atkbd
device          vga
device          sc
options         MAXCONS=8               # number of virtual consoles
options         SC_NO_SYSMOUSE
device          asr
device          twe             # 3ware ATA RAID
device          ata
device          atadisk         # ATA disk drives
device          atapicd         # ATAPI CDROM drives
options         ATA_STATIC_ID
device          fdc
device          sio
device          miibus
device          fxp             # Intel EtherExpress PRO/100B (82557, 82558)
device          ppc
device          ppbus
device          lpt
device          ppi
options         INIT_PATH=/sbin/init:/stand/sysinstall
options         SEMMAP=31
options         SEMMNI=11
options         SEMMNS=61
options         SEMMNU=31
options         SEMMSL=61
options         SEMOPM=101
options         SEMUME=11
options         SHMALL=1025
options         SHMMAX=(SHMMAXPGS*PAGE_SIZE+1)
options         SHMMAXPGS=1025
options         SHMMIN=2
options         SHMMNI=33
options         SHMSEG=9
options         MSGMNB=2049     # Max number of chars in queue
options         MSGMNI=41       # Max number of message queue identifiers
options         MSGSEG=2049     # Max number of message segments
options         MSGSSZ=16       # Size of a message segment
options         MSGTQL=41       # Max number of messages in system
options         NBUF=512        # Number of buffer headers
options         NMBCLUSTERS=16384       # Number of mbuf clusters


One final question:  How do I increase the number of available
pty's in 5.x?  It seems to max out at about 40.

-jon

-- 
Jon Nathan
jon at rupture.net



More information about the freebsd-current mailing list