8.0-BETA3/amd64 issues with Tyan S2882

[Michael Sinatra]

Hi,

I am using FreeBSD 8.0-BETA3 on an AMD64 Tyan S2882 system, and I am 
currently having issues with 8.0-BETA3.  The system was installed from 
an 8.0-BETA2 ISO and then csup'ed and rebuilt from source to get it to 
8.0-BETA3.  Note that the problems I describe below were the same for 
BETA2 and BETA3.  I have received the same results when using the mobo 
with 8G of RAM AND 16G.  The dmesg output below shows the 16G system. 
On both systems, I have flashed the BIOS with the latest version from 
Tyan (3.09).

FreeBSD 7.2-RELEASE works beautifully on both.  None of the problems 
below occur with that version.

Two big problems with this mobo and 8.0-BETA3:

1. LOR 'n' hang on halt/reboot:

Whenever rebooting or halting the system, I get an LOR and the system 
just hangs.  (See LOR output below.)  The system must be hard-reset or 
power-cycled, and then it boots fine (disks are properly sync'd so the 
filesystems are clean).  This looks similar to other umount-related LORs 
that have been reported on this list.

2. bge interface problems:

This mobo has three ethernet interfaces: one fxp and two bge (see dmesg 
output below for details).  Any one of these can be used for the SMDC 
management interface; this is selectable in the BIOS.  Regardless of the 
BIOS settings, the following occurs:

fxp0 appears to work properly
bge1 appears to work properly
bge0 hangs the system hard immediately on bringing the interface up

Note that I also removed the SMDC card and the results were the same.

The bge0 hang occurs regardless of whether one attempts to assign an 
address to the interface.  A simple "ifconfig bge0 up" will cause the 
system to hang.  (Note that ipv6 is enabled on this system and works 
properly on the other interfaces--stateless autoconfig works fine.)

Unfortunately, there's no LOR or panic, and no output is generated 
whatsoever when the interface is brought up.

Here's the dmesg for the system:

Note that the same symptoms occur even when using a GENERIC kernel; the 
custom kernel below is a GENERIC, minus the firewire stack, plus the 
following:

device          pf
device          pflog
options         GEOM_MIRROR

(The problems occur in the absence of any gmirror configuration, BTW.)

Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.0-BETA3 #0: Tue Aug 25 00:33:17 PDT 2009
     michael at sie1.net.berkeley.edu:/usr/obj/usr/src/sys/SIE1
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Opteron(tm) Processor 252 (2591.05-MHz K8-class CPU)
   Origin = "AuthenticAMD"  Id = 0x20f51  Stepping = 1
 
Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
   Features2=0x1<SSE3>
   AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
   AMD Features2=0x1<LAHF>
real memory  = 17179869184 (16384 MB)
avail memory = 16510205952 (15745 MB)
ACPI APIC Table: <A M I  OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 2 package(s) x 1 core(s)
  cpu0 (BSP): APIC ID:  0
  cpu1 (AP): APIC ID:  1
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ioapic1 <Version 1.1> irqs 24-27 on motherboard
ioapic2 <Version 1.1> irqs 28-31 on motherboard
kbd1 at kbdmux0
acpi0: <A M I OEMRSDT> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, fbf00000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci3: <ACPI PCI bus> on pcib1
ohci0: <OHCI (generic) USB controller> mem 0xfeafc000-0xfeafcfff irq 19 
at device 0.0 on pci3
ohci0: [ITHREAD]
usbus0: <OHCI (generic) USB controller> on ohci0
ohci1: <OHCI (generic) USB controller> mem 0xfeafd000-0xfeafdfff irq 19 
at device 0.1 on pci3
ohci1: [ITHREAD]
usbus1: <OHCI (generic) USB controller> on ohci1
atapci0: <SiI 3114 SATA150 controller> port 
0xbc00-0xbc07,0xb880-0xb883,0xb800-0xb807,0xac00-0xac03,0xa880-0xa88f 
mem 0xfeafec00-0xfeafefff irq 19 at device 5.0 on pci3
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci0
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci0
ata5: [ITHREAD]
vgapci0: <VGA-compatible display> port 0xb000-0xb0ff mem 
0xfd000000-0xfdffffff,0xfeaff000-0xfeafffff irq 18 at device 6.0 on pci3
fxp0: <Intel 82551 Pro/100 Ethernet> port 0xa800-0xa83f mem 
0xfeafb000-0xfeafbfff,0xfeaa0000-0xfeabffff irq 18 at device 8.0 on pci3
miibus0: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> PHY 1 on miibus0
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:e0:81:30:16:37
fxp0: [ITHREAD]
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <AMD 8111 UDMA133 controller> port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0
ata0: <ATA channel 0> on atapci1
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci1
ata1: [ITHREAD]
pci0: <serial bus, SMBus> at device 7.2 (no driver attached)
pci0: <bridge> at device 7.3 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci2: <ACPI PCI bus> on pcib2
ahd0: <Adaptec AIC7902 Ultra320 SCSI adapter> port 
0x8000-0x80ff,0x7800-0x78ff mem 0xfc8fc000-0xfc8fdfff irq 24 at device 
6.0 on pci2
ahd0: [ITHREAD]
aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
ahd1: <Adaptec AIC7902 Ultra320 SCSI adapter> port 
0x8800-0x88ff,0x8400-0x84ff mem 0xfc8fe000-0xfc8fffff irq 25 at device 
6.1 on pci2
ahd1: [ITHREAD]
aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
bge0: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x2003> 
mem 0xfc8b0000-0xfc8bffff,0xfc8a0000-0xfc8affff irq 24 at device 9.0 on pci2
miibus1: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> PHY 1 on miibus1
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
bge0: Ethernet address: 00:e0:81:30:16:6e
bge0: [ITHREAD]
bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x2003> 
mem 0xfc8e0000-0xfc8effff,0xfc8d0000-0xfc8dffff irq 25 at device 9.1 on pci2
miibus2: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> PHY 1 on miibus2
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
bge1: Ethernet address: 00:e0:81:30:16:6f
bge1: [ITHREAD]
pcib3: <ACPI PCI-PCI bridge> at device 11.0 on pci0
pci1: <ACPI PCI bus> on pcib3
acpi_button0: <Power Button> on acpi0
atrtc1: <AT realtime clock> port 0x70-0x71 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
uart0: console (9600,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart1: [FILTER]
ACPI Warning: \\_SB_.PCI0.SBRG.FDC_._FDE: Return type mismatch - found 
Package, expected Buffer 20090521 nspredef-1051
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 
on acpi0
fdc0: [FILTER]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
ppc0: <Parallel port> port 0x378-0x37f irq 7 on acpi0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppc0: [ITHREAD]
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
plip0: [ITHREAD]
lpt0: <Printer> on ppbus0
lpt0: [ITHREAD]
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
acpi_hpet0: <High Precision Event Timer> iomem 0xfec01000-0xfec013ff irq 
0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
powernow0: <Cool`n'Quiet K8> on cpu0
device_attach: powernow0 attach returned 6
cpu1: <ACPI CPU> on acpi0
powernow1: <Cool`n'Quiet K8> on cpu1
device_attach: powernow1 attach returned 6
orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atrtc0: <AT Real Time Clock> at port 0x70 irq 8 on isa0
atrtc0: Warning: Couldn't map I/O.
atrtc0: Warning: Couldn't map Interrupt.
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
acd0: CDROM <SONY CD-ROM CDU5212/5YS1> at ata0-master UDMA33
Waiting 5 seconds for SCSI devices to settle
ugen0.1: <AMD> at usbus0
uhub0: <AMD OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <AMD> at usbus1
uhub1: <AMD OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
uhub0: 3 ports with 3 removable, self powered
uhub1: 3 ports with 3 removable, self powered
da0 at ahd0 bus 0 target 0 lun 0
da0: <HITACHI HUS103073FL3800 SA19> Fixed Direct Access SCSI-3 device
da0: 320.000MB/s transfers (160.000MHz DT, offset 80, 16bit)
da0: Command Queueing enabled
da0: 70007MB (143374805 512 byte sectors: 255H 63S/T 8924C)
da1 at ahd0 bus 0 target 1 lun 0
da1: <HITACHI HUS103073FL3800 SA18> Fixed Direct Access SCSI-3 device
da1: 320.000MB/s transfers (160.000MHz DT, offset 80, 16bit)
da1: Command Queueing enabled
da1: 70007MB (143374805 512 byte sectors: 255H 63S/T 8924C)
SMP: AP CPU #1 Launched!
WARNING: WITNESS option enabled, expect reduced performance.

Here's the LOR from Problem #1 above:

Aug 26 13:49:55 sie1 reboot: rebooted by michael
Aug 26 13:49:56 sie1 syslogd: exiting on signal 15
Waiting (max 60 seconds) for system process `vnlru' to stop...done
Waiting (max 60 seconds) for system process `bufdaemon' to stop...done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining...1 1 1 0 0 done
All buffers synced.
lock order reversal:
  1st 0xffffff0006544448 ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1200
  2nd 0xffffff00066faba8 devfs (devfs) @ 
/usr/src/sys/ufs/ffs/ffs_vfsops.c:1194
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
_witness_debugger() at _witness_debugger+0x2e
witness_checkorder() at witness_checkorder+0x81e
__lockmgr_args() at __lockmgr_args+0xcf3
vop_stdlock() at vop_stdlock+0x39
VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b
_vn_lock() at _vn_lock+0x47
ffs_flushfiles() at ffs_flushfiles+0xb5
softdep_flushfiles() at softdep_flushfiles+0x63
ffs_unmount() at ffs_unmount+0x2e1
dounmount() at dounmount+0x2e6
vfs_unmountall() at vfs_unmountall+0x54
boot() at boot+0x7af
reboot() at reboot+0x68
syscall() at syscall+0x1af
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (55, FreeBSD ELF64, reboot), rip = 0x80078f85c, rsp = 
0x7fffffffeae8, rbp = 0 ---
Uptime: 18h56m56s

[Hangs after this and does not actually reboot or halt.]

thanks,
michael