em0 watchdog timeouts on 8-STABLE

Joshua Boyd boydjd at jbip.net
Wed Jun 22 15:24:47 UTC 2011


:(

I don't actually have problems normally with maxing out the throughput of
the network. Watchdogs only occur when I've got heavy I/O occurring during
ZFS scrubs across 2 mpt devices, at about 700MB/s. And then it doesn't
matter what kind of traffic I'm running through em0, it still throws
watchdogs. During the first occurrence it was actually pretty minimal
traffic, less than 100KB/s.

Are there any statistics that would be useful to you if I were to trigger
the watchdogs again?

On Wed, Jun 22, 2011 at 1:22 AM, Jack Vogel <jfvogel at gmail.com> wrote:

> I cannot repro this, I used your kernel config, this is on a Dell 1850 btw,
> I ran netperf stress from 3 clients, and have seen no watchdogs :(
>
> Jack
>
>
>
> On Tue, Jun 21, 2011 at 7:59 PM, Joshua Boyd <boydjd at jbip.net> wrote:
>
>> If needed, I can reproduce this on demand. Just need to know what sort of
>> statistics are needed when the problem is occurring. I've had to turn off my
>> weekly scrubs until I can figure out how to fix this problem.
>>
>>
>> On Wed, Jun 15, 2011 at 8:37 PM, Joshua Boyd <boydjd at jbip.net> wrote:
>>
>>> In the kernel. Here's my kernel configuration:
>>>
>>> http://pastebin.com/raw.php?i=4JL814m3
>>>
>>>  On Wed, Jun 15, 2011 at 8:20 PM, Jack Vogel <jfvogel at gmail.com> wrote:
>>>
>>>> I have hardware now, am working on reproducing this. Just curious, do
>>>> you have
>>>> the em driver defined in the kernel, or as a module?
>>>>
>>>> Jack
>>>>
>>>>
>>>> On Wed, Jun 15, 2011 at 2:09 AM, Joshua Boyd <boydjd at jbip.net> wrote:
>>>>
>>>>> On Wed, Jun 15, 2011 at 3:57 AM, Jeremy Chadwick
>>>>> <freebsd at jdc.parodius.com>wrote:
>>>>>
>>>>> > On Wed, Jun 15, 2011 at 03:14:43AM -0400, Joshua Boyd wrote:
>>>>> > > I recently updated my server to the latest 8-STABLE, and upgraded
>>>>> to v28
>>>>> > > ZFS. I have not had these problems on any other version of 8-STABLE
>>>>> or
>>>>> > > 7-STABLE, which this box was upgraded from some time ago.
>>>>> > >
>>>>> > > Now, during my weekly scrub, I get the following messages and em0
>>>>> is
>>>>> > > unresponsive:
>>>>> > >
>>>>> > > Jun 12 03:07:58 foghornleghorn kernel: em0: Watchdog timeout --
>>>>> resetting
>>>>> > > Jun 12 03:07:58 foghornleghorn kernel: em0: link state changed to
>>>>> DOWN
>>>>> > > Jun 12 03:08:01 foghornleghorn kernel: em0: link state changed to
>>>>> UP
>>>>> > > Jun 12 03:08:47 foghornleghorn kernel: em0: Watchdog timeout --
>>>>> resetting
>>>>> > > Jun 12 03:08:47 foghornleghorn kernel: em0: link state changed to
>>>>> DOWN
>>>>> > > Jun 12 03:08:50 foghornleghorn kernel: em0: link state changed to
>>>>> UP
>>>>> > >
>>>>> > > My scrub is scheduled to start at 03:00:00, so it looks like
>>>>> watchdog
>>>>> > > timeouts start occurring pretty quickly once I/O ramps up.
>>>>> > >
>>>>> > > Here's some possibly relevant information, let me know if anything
>>>>> else
>>>>> > > would be helpful to troubleshoot.
>>>>> > >
>>>>> > > FreeBSD foghornleghorn.res.openband.net 8.2-STABLE FreeBSD
>>>>> 8.2-STABLE
>>>>> > #17:
>>>>> > > Mon Jun  6 19:40:19 EDT 2011
>>>>> > > root at foghornleghorn.res.openband.net:
>>>>> /usr/obj/usr/src/sys/FOGHORNLEGHORN
>>>>> > >  amd64
>>>>> > >
>>>>> > > em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
>>>>> > 0xe800-0xe83f
>>>>> > > mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device
>>>>> 5.0 on
>>>>> > pci7
>>>>> > >
>>>>> > > em0 at pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>> rev=0x05
>>>>> > > hdr=0x00
>>>>> > >     vendor     = 'Intel Corporation'
>>>>> > >     device     = 'Gigabit Ethernet Controller (Copper) rev 5
>>>>> (82541PI)'
>>>>> > >     class      = network
>>>>> > >     subclass   = ethernet
>>>>> > >
>>>>> > > And, the SAS cards:
>>>>> > >
>>>>> > > dev.mpt.0.%desc: LSILogic SAS/SATA Adapter
>>>>> > > dev.mpt.0.%driver: mpt
>>>>> > > dev.mpt.0.%location: slot=0 function=0
>>>>> > > dev.mpt.0.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
>>>>> > > subdevice=0xa580 class=0x010000
>>>>> > > dev.mpt.0.%parent: pci1
>>>>> > > dev.mpt.0.debug: 3
>>>>> > > dev.mpt.0.role: 1
>>>>> > > dev.mpt.1.%desc: LSILogic SAS/SATA Adapter
>>>>> > > dev.mpt.1.%driver: mpt
>>>>> > > dev.mpt.1.%location: slot=0 function=0
>>>>> > > dev.mpt.1.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
>>>>> > > subdevice=0xa580 class=0x010000
>>>>> > > dev.mpt.1.%parent: pci2
>>>>> > > dev.mpt.1.debug: 3
>>>>> > > dev.mpt.1.role: 1
>>>>> > > dev.mpt.2.%desc: LSILogic SAS/SATA Adapter
>>>>> > > dev.mpt.2.%driver: mpt
>>>>> > > dev.mpt.2.%location: slot=0 function=0
>>>>> > > dev.mpt.2.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x1000
>>>>> > > subdevice=0x30a0 class=0x010000
>>>>> > > dev.mpt.2.%parent: pci6
>>>>> > > dev.mpt.2.debug: 3
>>>>> > > dev.mpt.2.role: 1
>>>>> >
>>>>> > Please provide output from the following commands (as root):
>>>>> >
>>>>> > # pciconf -lvcb
>>>>> >
>>>>>
>>>>> hostb0 at pci0:0:0:0: class=0x060000 card=0x59561002 chip=0x59561002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 GFX Dual Slot'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> pcib1 at pci0:0:2:0: class=0x060400 card=0x59561002 chip=0x59781002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> pcib2 at pci0:0:3:0: class=0x060400 card=0x59561002 chip=0x59791002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port B)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> pcib3 at pci0:0:4:0: class=0x060400 card=0x59561002 chip=0x597a1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> pcib4 at pci0:0:6:0: class=0x060400 card=0x59561002 chip=0x597c1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port C)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> pcib5 at pci0:0:7:0: class=0x060400 card=0x59561002 chip=0x597d1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port D)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> pcib6 at pci0:0:11:0: class=0x060400 card=0x59561002 chip=0x59801002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx1 port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> atapci4 at pci0:0:18:0: class=0x01018f card=0x81ef1043 chip=0x43801002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 Serial ATA Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>> ohci0 at pci0:0:19:0: class=0x0c0310 card=0x82881043 chip=0x43871002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI0)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> ohci1 at pci0:0:19:1: class=0x0c0310 card=0x82881043 chip=0x43881002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI1)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> ohci2 at pci0:0:19:2: class=0x0c0310 card=0x82881043 chip=0x43891002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI2)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> ohci3 at pci0:0:19:3: class=0x0c0310 card=0x82881043 chip=0x438a1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI3)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> ohci4 at pci0:0:19:4: class=0x0c0310 card=0x82881043 chip=0x438b1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI4)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> ehci0 at pci0:0:19:5: class=0x0c0320 card=0x82881043 chip=0x43861002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (EHCI)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>> none0 at pci0:0:20:0: class=0x0c0500 card=0x82881043 chip=0x43851002
>>>>> rev=0x14
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'ATI SMBus (ATI RD600/RS600)'
>>>>>    class      = serial bus
>>>>>    subclass   = SMBus
>>>>> atapci5 at pci0:0:20:1: class=0x01018a card=0x82881043 chip=0x438c1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'ATI RD600/RS600 IDE Controller (RD600/RS600)'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>> none1 at pci0:0:20:2: class=0x040300 card=0x82881043 chip=0x43831002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 High Definition Audio Controller'
>>>>>    class      = multimedia
>>>>>    subclass   = HDA
>>>>> isab0 at pci0:0:20:3: class=0x060100 card=0x82881043 chip=0x438d1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 PCI to LPC Bridge'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-ISA
>>>>> pcib7 at pci0:0:20:4: class=0x060401 card=0x00000000 chip=0x43841002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 PCI to PCI Bridge'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> hostb1 at pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x12001022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron HyperTransport
>>>>> Technology Configuration'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb2 at pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x12011022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Address Map'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb3 at pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x12021022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron DRAM Controller'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb4 at pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x12031022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Miscellaneous
>>>>> Control'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb5 at pci0:0:24:4: class=0x060000 card=0x00000000 chip=0x12041022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Link Control'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> mpt0 at pci0:1:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>> mpt1 at pci0:2:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>> atapci0 at pci0:3:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>> rev=0xb1
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = '6121 SATA2 Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>> mskc0 at pci0:4:0:0: class=0x020000 card=0x81f81043 chip=0x436411ab
>>>>> rev=0x12
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = 'Yukon PCI-E Gigabit Ethernet Controller (88E8056)'
>>>>>    class      = network
>>>>>    subclass   = ethernet
>>>>> atapci2 at pci0:5:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>> rev=0xb2
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = '6121 SATA2 Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>> mpt2 at pci0:6:0:0: class=0x010000 card=0x30a01000 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>> em0 at pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>> rev=0x05
>>>>> hdr=0x00
>>>>>    vendor     = 'Intel Corporation'
>>>>>    device     = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)'
>>>>>    class      = network
>>>>>    subclass   = ethernet
>>>>> vgapci0 at pci0:7:6:0: class=0x030000 card=0x00000000 chip=0x88115333
>>>>> rev=0x44
>>>>> hdr=0x00
>>>>>    vendor     = 'S3 Graphics Co., Ltd'
>>>>>    device     = '86C732 Trio32, 86C764 Trio64, 86C765 Trio64V+ Rev 01'
>>>>>    class      = display
>>>>>    subclass   = VGA
>>>>> none2 at pci0:7:8:0: class=0x0c0010 card=0x82941043 chip=0x581111c1
>>>>> rev=0x70
>>>>> hdr=0x00
>>>>>    vendor     = 'Lucent/Agere Systems (Was: AT&T MicroElectronics)'
>>>>>    device     = '1394A PCI PHY/Link Open Host Ctrlr I/F (FW322)'
>>>>>    class      = serial bus
>>>>>    subclass   = FireWire
>>>>> [josh at foghornleghorn /var/log]$ sudo su -
>>>>> foghornleghorn#  pciconf -lvcb
>>>>> hostb0 at pci0:0:0:0: class=0x060000 card=0x59561002 chip=0x59561002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 GFX Dual Slot'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>>    cap 08[c4] = HT slave
>>>>>    cap 08[40] = HT retry mode
>>>>>    cap 08[54] = HT unit ID clumping
>>>>>    cap 08[9c] = HT unknown d03c
>>>>> pcib1 at pci0:0:2:0: class=0x060400 card=0x59561002 chip=0x59781002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> pcib2 at pci0:0:3:0: class=0x060400 card=0x59561002 chip=0x59791002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port B)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> pcib3 at pci0:0:4:0: class=0x060400 card=0x59561002 chip=0x597a1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x2)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> pcib4 at pci0:0:6:0: class=0x060400 card=0x59561002 chip=0x597c1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port C)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x1)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> pcib5 at pci0:0:7:0: class=0x060400 card=0x59561002 chip=0x597d1002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port D)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x1)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> pcib6 at pci0:0:11:0: class=0x060400 card=0x59561002 chip=0x59801002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx1 port A)'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>> ecap 000b[100] = unknown 1
>>>>> ecap 0002[110] = VC 1 max VC0
>>>>> atapci4 at pci0:0:18:0: class=0x01018f card=0x81ef1043 chip=0x43801002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 Serial ATA Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>>    bar   [10] = type I/O Port, range 32, base 0x5000, size  8, enabled
>>>>>    bar   [14] = type I/O Port, range 32, base 0x4000, size  4, enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0x3000, size  8, enabled
>>>>>    bar   [1c] = type I/O Port, range 32, base 0x2000, size  4, enabled
>>>>>    bar   [20] = type I/O Port, range 32, base 0x1000, size 16, enabled
>>>>>    bar   [24] = type Memory, range 32, base 0xf71ff800, size 1024,
>>>>> enabled
>>>>>    cap 01[60] = powerspec 2  supports D0 D3  current D0
>>>>> ohci0 at pci0:0:19:0: class=0x0c0310 card=0x82881043 chip=0x43871002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI0)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71fe000, size 4096,
>>>>> enabled
>>>>> ohci1 at pci0:0:19:1: class=0x0c0310 card=0x82881043 chip=0x43881002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI1)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71fd000, size 4096,
>>>>> enabled
>>>>> ohci2 at pci0:0:19:2: class=0x0c0310 card=0x82881043 chip=0x43891002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI2)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71fc000, size 4096,
>>>>> enabled
>>>>> ohci3 at pci0:0:19:3: class=0x0c0310 card=0x82881043 chip=0x438a1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI3)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71fb000, size 4096,
>>>>> enabled
>>>>> ohci4 at pci0:0:19:4: class=0x0c0310 card=0x82881043 chip=0x438b1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (OHCI4)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71fa000, size 4096,
>>>>> enabled
>>>>> ehci0 at pci0:0:19:5: class=0x0c0320 card=0x82881043 chip=0x43861002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 USB Controller (EHCI)'
>>>>>    class      = serial bus
>>>>>    subclass   = USB
>>>>>    bar   [10] = type Memory, range 32, base 0xf71ff000, size 256,
>>>>> enabled
>>>>>    cap 01[c0] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>    cap 05[d0] = MSI supports 1 message
>>>>>    cap 0a[e4] = EHCI Debug Port at offset 0xe0 in map 0x14
>>>>> none0 at pci0:0:20:0: class=0x0c0500 card=0x82881043 chip=0x43851002
>>>>> rev=0x14
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'ATI SMBus (ATI RD600/RS600)'
>>>>>    class      = serial bus
>>>>>    subclass   = SMBus
>>>>>    bar   [10] = type I/O Port, range 32, base 0xb00, size 16, enabled
>>>>>    cap 08[b0] = HT MSI fixed address window disabled at 0xfee00000
>>>>> atapci5 at pci0:0:20:1: class=0x01018a card=0x82881043 chip=0x438c1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'ATI RD600/RS600 IDE Controller (RD600/RS600)'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>>    bar   [10] = type I/O Port, range 32, base 0x1f0, size  8, enabled
>>>>>    bar   [14] = type I/O Port, range 32, base 0x3f4, size  1, enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0x170, size  8, enabled
>>>>>    bar   [1c] = type I/O Port, range 32, base 0x374, size  1, enabled
>>>>>    bar   [20] = type I/O Port, range 32, base 0xff00, size 16, enabled
>>>>> none1 at pci0:0:20:2: class=0x040300 card=0x82881043 chip=0x43831002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 High Definition Audio Controller'
>>>>>    class      = multimedia
>>>>>    subclass   = HDA
>>>>>    bar   [10] = type Memory, range 64, base 0xf71f4000, size 16384,
>>>>> enabled
>>>>>    cap 01[50] = powerspec 2  supports D0 D3  current D0
>>>>> isab0 at pci0:0:20:3: class=0x060100 card=0x82881043 chip=0x438d1002
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 PCI to LPC Bridge'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-ISA
>>>>> pcib7 at pci0:0:20:4: class=0x060401 card=0x00000000 chip=0x43841002
>>>>> rev=0x00
>>>>> hdr=0x01
>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>    device     = 'IXP SB600 PCI to PCI Bridge'
>>>>>    class      = bridge
>>>>>    subclass   = PCI-PCI
>>>>> hostb1 at pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x12001022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron HyperTransport
>>>>> Technology Configuration'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>>    cap 08[80] = HT host
>>>>> hostb2 at pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x12011022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Address Map'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb3 at pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x12021022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron DRAM Controller'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> hostb4 at pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x12031022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Miscellaneous
>>>>> Control'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>>    cap 0f[f0] = unknown
>>>>> hostb5 at pci0:0:24:4: class=0x060000 card=0x00000000 chip=0x12041022
>>>>> rev=0x00
>>>>> hdr=0x00
>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Link Control'
>>>>>    class      = bridge
>>>>>    subclass   = HOST-PCI
>>>>> mpt0 at pci0:1:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>>    bar   [10] = type I/O Port, range 32, base 0x6000, size 256,
>>>>> disabled
>>>>>    bar   [14] = type Memory, range 64, base 0xf75fc000, size 16384,
>>>>> enabled
>>>>>    bar   [1c] = type Memory, range 64, base 0xf75e0000, size 65536,
>>>>> enabled
>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>> mpt1 at pci0:2:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>>    bar   [10] = type I/O Port, range 32, base 0x7000, size 256,
>>>>> disabled
>>>>>    bar   [14] = type Memory, range 64, base 0xf78fc000, size 16384,
>>>>> enabled
>>>>>    bar   [1c] = type Memory, range 64, base 0xf78e0000, size 65536,
>>>>> enabled
>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>> atapci0 at pci0:3:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>> rev=0xb1
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = '6121 SATA2 Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>>    bar   [10] = type I/O Port, range 32, base 0x9800, size  8, enabled
>>>>>    bar   [14] = type I/O Port, range 32, base 0x9400, size  4, enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0x9000, size  8, enabled
>>>>>    bar   [1c] = type I/O Port, range 32, base 0x8800, size  4, enabled
>>>>>    bar   [20] = type I/O Port, range 32, base 0x8400, size 16, enabled
>>>>>    bar   [24] = type Memory, range 32, base 0xf79ffc00, size 1024,
>>>>> enabled
>>>>>    cap 01[48] = powerspec 2  supports D0 D1 D3  current D0
>>>>>    cap 05[50] = MSI supports 1 message
>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>> x1(x1)
>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 2 corrected
>>>>> mskc0 at pci0:4:0:0: class=0x020000 card=0x81f81043 chip=0x436411ab
>>>>> rev=0x12
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = 'Yukon PCI-E Gigabit Ethernet Controller (88E8056)'
>>>>>    class      = network
>>>>>    subclass   = ethernet
>>>>>    bar   [10] = type Memory, range 64, base 0xf7afc000, size 16384,
>>>>> enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0xa800, size 256, enabled
>>>>>    cap 01[48] = powerspec 3  supports D0 D1 D2 D3  current D0
>>>>>    cap 03[50] = VPD
>>>>>    cap 05[5c] = MSI supports 1 message, 64 bit enabled with 1 message
>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>> x1(x1)
>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
>>>>> atapci2 at pci0:5:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>> rev=0xb2
>>>>> hdr=0x00
>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>    device     = '6121 SATA2 Controller'
>>>>>    class      = mass storage
>>>>>    subclass   = ATA
>>>>>    bar   [10] = type I/O Port, range 32, base 0xc800, size  8, enabled
>>>>>    bar   [14] = type I/O Port, range 32, base 0xc400, size  4, enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0xc000, size  8, enabled
>>>>>    bar   [1c] = type I/O Port, range 32, base 0xb800, size  4, enabled
>>>>>    bar   [20] = type I/O Port, range 32, base 0xb400, size 16, enabled
>>>>>    bar   [24] = type Memory, range 32, base 0xf7bffc00, size 1024,
>>>>> enabled
>>>>>    cap 01[48] = powerspec 2  supports D0 D1 D3  current D0
>>>>>    cap 05[50] = MSI supports 1 message
>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>> x1(x1)
>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
>>>>> mpt2 at pci0:6:0:0: class=0x010000 card=0x30a01000 chip=0x00581000
>>>>> rev=0x08
>>>>> hdr=0x00
>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>    class      = mass storage
>>>>>    subclass   = SCSI
>>>>>    bar   [10] = type I/O Port, range 32, base 0xd000, size 256,
>>>>> disabled
>>>>>    bar   [14] = type Memory, range 64, base 0xf7ffc000, size 16384,
>>>>> enabled
>>>>>    bar   [1c] = type Memory, range 64, base 0xf7fe0000, size 65536,
>>>>> enabled
>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>> em0 at pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>> rev=0x05
>>>>> hdr=0x00
>>>>>    vendor     = 'Intel Corporation'
>>>>>    device     = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)'
>>>>>    class      = network
>>>>>    subclass   = ethernet
>>>>>     bar   [10] = type Memory, range 32, base 0xfebe0000, size 131072,
>>>>> enabled
>>>>>    bar   [14] = type Memory, range 32, base 0xfebc0000, size 131072,
>>>>> enabled
>>>>>    bar   [18] = type I/O Port, range 32, base 0xe800, size 64, enabled
>>>>>    cap 01[dc] = powerspec 2  supports D0 D3  current D0
>>>>>    cap 07[e4] = PCI-X supports 2048 burst read, 1 split transaction
>>>>> vgapci0 at pci0:7:6:0: class=0x030000 card=0x00000000 chip=0x88115333
>>>>> rev=0x44
>>>>> hdr=0x00
>>>>>    vendor     = 'S3 Graphics Co., Ltd'
>>>>>    device     = '86C732 Trio32, 86C764 Trio64, 86C765 Trio64V+ Rev 01'
>>>>>    class      = display
>>>>>    subclass   = VGA
>>>>>    bar   [10] = type Memory, range 32, base 0xf8000000, size 67108864,
>>>>> enabled
>>>>> none2 at pci0:7:8:0: class=0x0c0010 card=0x82941043 chip=0x581111c1
>>>>> rev=0x70
>>>>> hdr=0x00
>>>>>    vendor     = 'Lucent/Agere Systems (Was: AT&T MicroElectronics)'
>>>>>    device     = '1394A PCI PHY/Link Open Host Ctrlr I/F (FW322)'
>>>>>    class      = serial bus
>>>>>    subclass   = FireWire
>>>>>    bar   [10] = type Memory, range 32, base 0xfeb8f000, size 4096,
>>>>> enabled
>>>>>    cap 01[44] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>
>>>>>
>>>>>
>>>>> > # vmstat -i
>>>>> >
>>>>>
>>>>> interrupt                          total       rate
>>>>> irq9: acpi0                            1          0
>>>>> irq16: atapci0+                        2          0
>>>>> irq17: ohci1 ohci3                     3          0
>>>>> irq18: mpt0 ohci2+               7066718         31
>>>>> irq19: mpt1 atapci*              7798877         34
>>>>> irq20: em0                      11715792         51
>>>>> irq22: atapci4                    628883          2
>>>>> cpu0: timer                    455853831       1999
>>>>> irq256: mskc0                   97098730        425
>>>>> cpu1: timer                    455845190       1999
>>>>> Total                         1036008027       4544
>>>>>
>>>>>
>>>>>
>>>>> > # sysctl -a | grep msi
>>>>> >
>>>>>
>>>>> hw.pci.honor_msi_blacklist: 1
>>>>> hw.pci.enable_msix: 1
>>>>> hw.pci.enable_msi: 1
>>>>>
>>>>>
>>>>>
>>>>> > # dmesg
>>>>> >
>>>>>
>>>>> Copyright (c) 1992-2011 The FreeBSD Project.
>>>>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993,
>>>>> 1994
>>>>> The Regents of the University of California. All rights reserved.
>>>>> FreeBSD is a registered trademark of The FreeBSD Foundation.
>>>>> FreeBSD 8.2-STABLE #17: Mon Jun  6 19:40:19 EDT 2011
>>>>>    root at foghornleghorn.res.openband.net:
>>>>> /usr/obj/usr/src/sys/FOGHORNLEGHORN
>>>>> amd64
>>>>> Timecounter "i8254" frequency 1193182 Hz quality 0
>>>>> CPU: AMD Phenom(tm) II X2 555 Processor (3209.77-MHz K8-class CPU)
>>>>>  Origin = "AuthenticAMD"  Id = 0x100f43  Family = 10  Model = 4
>>>>>  Stepping =
>>>>> 3
>>>>>
>>>>>
>>>>> Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
>>>>>  Features2=0x802009<SSE3,MON,CX16,POPCNT>
>>>>>  AMD
>>>>>
>>>>> Features=0xee500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM,3DNow!+,3DNow!>
>>>>>  AMD
>>>>>
>>>>> Features2=0x37ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT>
>>>>>  TSC: P-state invariant
>>>>> real memory  = 8589934592 (8192 MB)
>>>>> avail memory = 8257736704 (7875 MB)
>>>>> ACPI APIC Table: <092310 OEMAPIC >
>>>>> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
>>>>> FreeBSD/SMP: 1 package(s) x 2 core(s)
>>>>>  cpu0 (BSP): APIC ID:  0
>>>>>  cpu1 (AP): APIC ID:  1
>>>>> ioapic0 <Version 2.1> irqs 0-23 on motherboard
>>>>> acpi0: <092310 OEMRSDT> on motherboard
>>>>> acpi0: [ITHREAD]
>>>>> acpi0: Power Button (fixed)
>>>>> acpi0: reservation of fee00000, 1000 (3) failed
>>>>> acpi0: reservation of ffb80000, 80000 (3) failed
>>>>> acpi0: reservation of fff00000, 100000 (3) failed
>>>>> acpi0: reservation of 0, a0000 (3) failed
>>>>> acpi0: reservation of 100000, dff00000 (3) failed
>>>>> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
>>>>> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
>>>>> cpu0: <ACPI CPU> on acpi0
>>>>> cpu1: <ACPI CPU> on acpi0
>>>>> acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
>>>>> acpi0
>>>>> Timecounter "HPET" frequency 14318180 Hz quality 900
>>>>> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>>>>> pci0: <ACPI PCI bus> on pcib0
>>>>> pcib1: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci0
>>>>> pci1: <ACPI PCI bus> on pcib1
>>>>> mpt0: <LSILogic SAS/SATA Adapter> port 0x6000-0x60ff mem
>>>>> 0xf75fc000-0xf75fffff,0xf75e0000-0xf75effff irq 18 at device 0.0 on
>>>>> pci1
>>>>> mpt0: [ITHREAD]
>>>>> mpt0: MPI Version=1.5.20.0
>>>>> pcib2: <ACPI PCI-PCI bridge> irq 19 at device 3.0 on pci0
>>>>> pci2: <ACPI PCI bus> on pcib2
>>>>> mpt1: <LSILogic SAS/SATA Adapter> port 0x7000-0x70ff mem
>>>>> 0xf78fc000-0xf78fffff,0xf78e0000-0xf78effff irq 19 at device 0.0 on
>>>>> pci2
>>>>> mpt1: [ITHREAD]
>>>>> mpt1: MPI Version=1.5.20.0
>>>>> pcib3: <ACPI PCI-PCI bridge> irq 16 at device 4.0 on pci0
>>>>> pci3: <ACPI PCI bus> on pcib3
>>>>> atapci0: <Marvell 88SX6121 UDMA133 controller> port
>>>>> 0x9800-0x9807,0x9400-0x9403,0x9000-0x9007,0x8800-0x8803,0x8400-0x840f
>>>>> mem
>>>>> 0xf79ffc00-0xf79fffff irq 16 at device 0.0 on pci3
>>>>> atapci0: [ITHREAD]
>>>>> atapci1: <AHCI SATA controller> on atapci0
>>>>> atapci1: [ITHREAD]
>>>>> atapci1: AHCI v1.00 controller with 3 3Gbps ports, PM supported
>>>>> ata2: <ATA channel 0> on atapci1
>>>>> ata2: [ITHREAD]
>>>>> ata3: <ATA channel 1> on atapci1
>>>>> ata3: [ITHREAD]
>>>>> ata4: <ATA channel 0> on atapci0
>>>>> ata4: [ITHREAD]
>>>>> pcib4: <ACPI PCI-PCI bridge> irq 18 at device 6.0 on pci0
>>>>> pci4: <ACPI PCI bus> on pcib4
>>>>> mskc0: <Marvell Yukon 88E8056 Gigabit Ethernet> port 0xa800-0xa8ff mem
>>>>> 0xf7afc000-0xf7afffff irq 18 at device 0.0 on pci4
>>>>> msk0: <Marvell Technology Group Ltd. Yukon EC Ultra Id 0xb4 Rev 0x03>
>>>>> on
>>>>> mskc0
>>>>> msk0: Ethernet address: 00:1f:c6:e9:f8:7c
>>>>> miibus0: <MII bus> on msk0
>>>>> e1000phy0: <Marvell 88E1149 Gigabit PHY> PHY 0 on miibus0
>>>>> e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
>>>>> 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
>>>>> mskc0: [ITHREAD]
>>>>> pcib5: <ACPI PCI-PCI bridge> irq 19 at device 7.0 on pci0
>>>>> pci5: <ACPI PCI bus> on pcib5
>>>>> atapci2: <Marvell 88SX6121 UDMA133 controller> port
>>>>> 0xc800-0xc807,0xc400-0xc403,0xc000-0xc007,0xb800-0xb803,0xb400-0xb40f
>>>>> mem
>>>>> 0xf7bffc00-0xf7bfffff irq 19 at device 0.0 on pci5
>>>>> atapci2: [ITHREAD]
>>>>> atapci3: <AHCI SATA controller> on atapci2
>>>>> atapci3: [ITHREAD]
>>>>> atapci3: AHCI v1.00 controller with 3 3Gbps ports, PM supported
>>>>> ata5: <ATA channel 0> on atapci3
>>>>> ata5: [ITHREAD]
>>>>> ata6: <ATA channel 1> on atapci3
>>>>> ata6: [ITHREAD]
>>>>> ata7: <ATA channel 0> on atapci2
>>>>> ata7: [ITHREAD]
>>>>> pcib6: <ACPI PCI-PCI bridge> irq 19 at device 11.0 on pci0
>>>>> pci6: <ACPI PCI bus> on pcib6
>>>>> mpt2: <LSILogic SAS/SATA Adapter> port 0xd000-0xd0ff mem
>>>>> 0xf7ffc000-0xf7ffffff,0xf7fe0000-0xf7feffff irq 19 at device 0.0 on
>>>>> pci6
>>>>> mpt2: [ITHREAD]
>>>>> mpt2: MPI Version=1.5.19.0
>>>>> atapci4: <ATI IXP600 SATA300 controller> port
>>>>> 0x5000-0x5007,0x4000-0x4003,0x3000-0x3007,0x2000-0x2003,0x1000-0x100f
>>>>> mem
>>>>> 0xf71ff800-0xf71ffbff irq 22 at device 18.0 on pci0
>>>>> atapci4: [ITHREAD]
>>>>> atapci4: AHCI v1.10 controller with 4 3Gbps ports, PM supported
>>>>> ata8: <ATA channel 0> on atapci4
>>>>> ata8: port is not ready (timeout 0ms) tfd = 000001d0
>>>>> ata8: software reset clear timeout
>>>>> ata8: [ITHREAD]
>>>>> ata9: <ATA channel 1> on atapci4
>>>>> ata9: [ITHREAD]
>>>>> ata10: <ATA channel 2> on atapci4
>>>>> ata10: [ITHREAD]
>>>>> ata11: <ATA channel 3> on atapci4
>>>>> ata11: [ITHREAD]
>>>>> ohci0: <OHCI (generic) USB controller> mem 0xf71fe000-0xf71fefff irq 16
>>>>> at
>>>>> device 19.0 on pci0
>>>>> ohci0: [ITHREAD]
>>>>> usbus0: <OHCI (generic) USB controller> on ohci0
>>>>> ohci1: <OHCI (generic) USB controller> mem 0xf71fd000-0xf71fdfff irq 17
>>>>> at
>>>>> device 19.1 on pci0
>>>>> ohci1: [ITHREAD]
>>>>> usbus1: <OHCI (generic) USB controller> on ohci1
>>>>> ohci2: <OHCI (generic) USB controller> mem 0xf71fc000-0xf71fcfff irq 18
>>>>> at
>>>>> device 19.2 on pci0
>>>>> ohci2: [ITHREAD]
>>>>> usbus2: <OHCI (generic) USB controller> on ohci2
>>>>> ohci3: <OHCI (generic) USB controller> mem 0xf71fb000-0xf71fbfff irq 17
>>>>> at
>>>>> device 19.3 on pci0
>>>>> ohci3: [ITHREAD]
>>>>> usbus3: <OHCI (generic) USB controller> on ohci3
>>>>> ohci4: <OHCI (generic) USB controller> mem 0xf71fa000-0xf71fafff irq 18
>>>>> at
>>>>> device 19.4 on pci0
>>>>> ohci4: [ITHREAD]
>>>>> usbus4: <OHCI (generic) USB controller> on ohci4
>>>>> ehci0: <EHCI (generic) USB 2.0 controller> mem 0xf71ff000-0xf71ff0ff
>>>>> irq 19
>>>>> at device 19.5 on pci0
>>>>> ehci0: [ITHREAD]
>>>>> ehci0: AMD SB600/700 quirk applied
>>>>> usbus5: EHCI version 1.0
>>>>> usbus5: <EHCI (generic) USB 2.0 controller> on ehci0
>>>>> pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
>>>>> atapci5: <ATI IXP600 UDMA133 controller> port
>>>>> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on
>>>>> pci0
>>>>> ata0: <ATA channel 0> on atapci5
>>>>> ata0: [ITHREAD]
>>>>> pci0: <multimedia, HDA> at device 20.2 (no driver attached)
>>>>> isab0: <PCI-ISA bridge> at device 20.3 on pci0
>>>>> isa0: <ISA bus> on isab0
>>>>> pcib7: <ACPI PCI-PCI bridge> at device 20.4 on pci0
>>>>> pci7: <ACPI PCI bus> on pcib7
>>>>> em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
>>>>> 0xe800-0xe83f
>>>>> mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device 5.0 on
>>>>> pci7
>>>>> em0: [FILTER]
>>>>> em0: Ethernet address: 00:1b:21:4e:e5:2e
>>>>> vgapci0: <VGA-compatible display> mem 0xf8000000-0xfbffffff at device
>>>>> 6.0 on
>>>>> pci7
>>>>> pci7: <serial bus, FireWire> at device 8.0 (no driver attached)
>>>>> acpi_button0: <Power Button> on acpi0
>>>>> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
>>>>> acpi_hpet1: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
>>>>> acpi0
>>>>> device_attach: acpi_hpet1 attach returned 12
>>>>> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>>>>> uart0: [FILTER]
>>>>> orm0: <ISA Option ROMs> at iomem
>>>>> 0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff on isa0
>>>>> sc0: <System console> at flags 0x100 on isa0
>>>>> sc0: VGA <16 virtual consoles, flags=0x300>
>>>>> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
>>>>> isa0
>>>>> acpi_throttle0: <ACPI CPU Throttling> on cpu0
>>>>> acpi_throttle0: CLK_VAL field overlaps THT_EN bit
>>>>> device_attach: acpi_throttle0 attach returned 6
>>>>> hwpstate0: <Cool`n'Quiet 2.0> on cpu0
>>>>> Timecounters tick every 1.000 msec
>>>>> usbus0: 12Mbps Full Speed USB v1.0
>>>>> usbus1: 12Mbps Full Speed USB v1.0
>>>>> usbus2: 12Mbps Full Speed USB v1.0
>>>>> usbus3: 12Mbps Full Speed USB v1.0
>>>>> usbus4: 12Mbps Full Speed USB v1.0
>>>>> usbus5: 480Mbps High Speed USB v2.0
>>>>> ugen0.1: <ATI> at usbus0
>>>>> uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
>>>>> ugen1.1: <ATI> at usbus1
>>>>> uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
>>>>> ugen2.1: <ATI> at usbus2
>>>>> uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
>>>>> ugen3.1: <ATI> at usbus3
>>>>> uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
>>>>> ugen4.1: <ATI> at usbus4
>>>>> uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
>>>>> ugen5.1: <ATI> at usbus5
>>>>> uhub5: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
>>>>> ad16: 476940MB <Seagate ST3500641NS 3.AEP> at ata8-master UDMA100 SATA
>>>>> 3Gb/s
>>>>> uhub0: 2 ports with 2 removable, self powered
>>>>> uhub1: 2 ports with 2 removable, self powered
>>>>> uhub2: 2 ports with 2 removable, self powered
>>>>> uhub3: 2 ports with 2 removable, self powered
>>>>> uhub4: 2 ports with 2 removable, self powered
>>>>> da8 at mpt0 bus 0 scbus0 target 0 lun 0
>>>>> da8: <ATA ST31000528AS CC38> Fixed Direct Access SCSI-5 device
>>>>> da8: 300.000MB/s transfers
>>>>> da8: Command Queueing enabled
>>>>> da8: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da9 at mpt0 bus 0 scbus0 target 1 lun 0
>>>>> da9: <ATA Hitachi HDS72101 A39C> Fixed Direct Access SCSI-5 device
>>>>> da9: 300.000MB/s transfers
>>>>> da9: Command Queueing enabled
>>>>> da9: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da10 at mpt0 bus 0 scbus0 target 2 lun 0
>>>>> da10: <ATA SAMSUNG HD103SJ 00E4> Fixed Direct Access SCSI-5 device
>>>>> da10: 300.000MB/s transfers
>>>>> da10: Command Queueing enabled
>>>>> da10: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da11 at mpt0 bus 0 scbus0 target 3 lun 0
>>>>> da11: <ATA SAMSUNG HD103SJ 00E4> Fixed Direct Access SCSI-5 device
>>>>> da11: 300.000MB/s transfers
>>>>> da11: Command Queueing enabled
>>>>> da11: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da12 at mpt0 bus 0 scbus0 target 4 lun 0
>>>>> da12: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>> da12: 300.000MB/s transfers
>>>>> da12: Command Queueing enabled
>>>>> da12: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da13 at mpt0 bus 0 scbus0 target 5 lun 0
>>>>> da13: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>> da13: 300.000MB/s transfers
>>>>> da13: Command Queueing enabled
>>>>> da13: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da14 at mpt0 bus 0 scbus0 target 6 lun 0
>>>>> da14: <ATA Hitachi HDS72101 A39C> Fixed Direct Access SCSI-5 device
>>>>> da14: 300.000MB/s transfers
>>>>> da14: Command Queueing enabled
>>>>> da14: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da0 at mpt1 bus 0 scbus1 target 0 lun 0
>>>>> da0: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>> da0: 300.000MB/s transfers
>>>>> da0: Command Queueing enabled
>>>>> da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>> da1 at mpt1 bus 0 scbus1 target 1 lun 0
>>>>> da1: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>> da1: 300.000MB/s transfers
>>>>> da1: Command Queueing enabled
>>>>> da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>> da2 at mpt1 bus 0 scbus1 target 2 lun 0
>>>>> da2: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>> da2: 300.000MB/s transfers
>>>>> da2: Command Queueing enabled
>>>>> da2: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>> da3 at mpt1 bus 0 scbus1 target 3 lun 0
>>>>> da3: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>> da3: 300.000MB/s transfers
>>>>> da3: Command Queueing enabled
>>>>> da3: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>> da4 at mpt1 bus 0 scbus1 target 4 lun 0
>>>>> da4: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>> da4: 300.000MB/s transfers
>>>>> da4: Command Queueing enabled
>>>>> da4: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>> da5 at mpt1 bus 0 scbus1 target 5 lun 0
>>>>> da5: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>> da5: 300.000MB/s transfers
>>>>> da5: Command Queueing enabled
>>>>> da5: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da6 at mpt1 bus 0 scbus1 target 6 lun 0
>>>>> da6: <ATA ST31000340AS SD04> Fixed Direct Access SCSI-5 device
>>>>> da6: 300.000MB/s transfers
>>>>> da6: Command Queueing enabled
>>>>> da6: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> da7 at mpt1 bus 0 scbus1 target 7 lun 0
>>>>> da7: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>> da7: 300.000MB/s transfers
>>>>> da7: Command Queueing enabled
>>>>> da7: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>> SMP: AP CPU #1 Launched!
>>>>> uhub5: 10 ports with 10 removable, self powered
>>>>> GEOM: da7: geometry does not match label (16h,63s != 255h,63s).
>>>>> Trying to mount root from ufs:/dev/ad16s1a
>>>>> WARNING: / was not properly dismounted
>>>>> ZFS filesystem version 5
>>>>> ZFS storage pool version 28
>>>>> WARNING: /tmp was not properly dismounted
>>>>> WARNING: /usr was not properly dismounted
>>>>> WARNING: /var was not properly dismounted
>>>>> 0
>>>>> mpt1: request 0xffffff80002c57f0:2369 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c57f0:2369 function 0
>>>>> mpt1: mpt_wait_req(1) timed out
>>>>> mpt1: mpt_recover_commands: abort timed-out. Resetting controller
>>>>> mpt1: mpt_cam_event: 0x80
>>>>> mpt1: mpt_cam_event: 0x80
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c57f0:2369
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x12
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c5c70:2375 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c5c70:2375 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c5c70:2375
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c5c70:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c5fd0:2379 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c5fd0:2379 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c5fd0:2379
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c5fd0:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c6210:2383 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c6210:2383 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6210:2383
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c6210:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c6180:2387 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c6180:2387 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6180:2387
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c6180:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c62a0:2391 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c62a0:2391 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c62a0:2391
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c62a0:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c6720:2395 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c6720:2395 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6720:2395
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c6720:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: request 0xffffff80002c67b0:2399 timed out for ccb
>>>>> 0xffffff00063bb000
>>>>> (req->ccb 0xffffff00063bb000)
>>>>> mpt1: attempting to abort req 0xffffff80002c67b0:2399 function 0
>>>>> mpt1: completing timedout/aborted req 0xffffff80002c67b0:2399
>>>>> mpt1:
>>>>> abort of req 0xffffff80002c67b0:0 completed
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt1: mpt_cam_event: 0x16
>>>>> mpt0: request 0xffffff80002a69e0:2082 timed out for ccb
>>>>> 0xffffff0006389800
>>>>> (req->ccb 0xffffff0006389800)
>>>>> mpt0: attempting to abort req 0xffffff80002a69e0:2082 function 0
>>>>> mpt0: completing timedout/aborted req 0xffffff80002a69e0:2082
>>>>> mpt0: abort of req 0xffffff80002a69e0:0 completed
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: request 0xffffff80002a6c20:2086 timed out for ccb
>>>>> 0xffffff0006389800
>>>>> (req->ccb 0xffffff0006389800)
>>>>> mpt0: attempting to abort req 0xffffff80002a6c20:2086 function 0
>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6c20:2086
>>>>> mpt0: abort of req 0xffffff80002a6c20:0 completed
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: request 0xffffff80002a6cb0:2090 timed out for ccb
>>>>> 0xffffff0006389800
>>>>> (req->ccb 0xffffff0006389800)
>>>>> mpt0: attempting to abort req 0xffffff80002a6cb0:2090 function 0
>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6cb0:2090
>>>>> mpt0: abort of req 0xffffff80002a6cb0:0 completed
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: request 0xffffff80002a6b90:2094 timed out for ccb
>>>>> 0xffffff0006389800
>>>>> (req->ccb 0xffffff0006389800)
>>>>> mpt0: attempting to abort req 0xffffff80002a6b90:2094 function 0
>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6b90:2094
>>>>> mpt0: abort of req 0xffffff80002a6b90:0 completed
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> mpt0: mpt_cam_event: 0x16
>>>>> tun0: link state changed to UP
>>>>> (da8:mpt0:0:0:0): READ(10). CDB: 28 0 3e e2 6f 56 0 0 1 0
>>>>> (da8:mpt0:0:0:0): CAM status: SCSI Status Error
>>>>> (da8:mpt0:0:0:0): SCSI status: Check Condition
>>>>> (da8:mpt0:0:0:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da11:mpt0:0:3:0): READ(10). CDB: 28 0 1a b6 92 0 0 0 80 0
>>>>> (da11:mpt0:0:3:0): CAM status: SCSI Status Error
>>>>> (da11:mpt0:0:3:0): SCSI status: Check Condition
>>>>> (da11:mpt0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>> reset, or
>>>>> bus device reset occurred)
>>>>> (da2:mpt1:0:2:0): READ(10). CDB: 28 0 76 7b de 0 0 0 80 0
>>>>> (da2:mpt1:0:2:0): CAM status: SCSI Status Error
>>>>> (da2:mpt1:0:2:0): SCSI status: Check Condition
>>>>> (da2:mpt1:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da10:mpt0:0:2:0): READ(10). CDB: 28 0 1a ff 67 80 0 0 80 0
>>>>> (da10:mpt0:0:2:0): CAM status: SCSI Status Error
>>>>> (da10:mpt0:0:2:0): SCSI status: Check Condition
>>>>> (da10:mpt0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>> reset, or
>>>>> bus device reset occurred)
>>>>> (da5:mpt1:0:5:0): READ(10). CDB: 28 0 1a ff 67 80 0 0 80 0
>>>>> (da5:mpt1:0:5:0): CAM status: SCSI Status Error
>>>>> (da5:mpt1:0:5:0): SCSI status: Check Condition
>>>>> (da5:mpt1:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da7:mpt1:0:7:0): READ(10). CDB: 28 0 40 d7 da 80 0 0 80 0
>>>>> (da7:mpt1:0:7:0): CAM status: SCSI Status Error
>>>>> (da7:mpt1:0:7:0): SCSI status: Check Condition
>>>>> (da7:mpt1:0:7:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da6:mpt1:0:6:0): READ(10). CDB: 28 0 40 d7 da 80 0 0 80 0
>>>>> (da6:mpt1:0:6:0): CAM status: SCSI Status Error
>>>>> (da6:mpt1:0:6:0): SCSI status: Check Condition
>>>>> (da6:mpt1:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da0:mpt1:0:0:0): READ(10). CDB: 28 0 76 91 87 e3 0 0 1 0
>>>>> (da0:mpt1:0:0:0): CAM status: SCSI Status Error
>>>>> (da0:mpt1:0:0:0): SCSI status: Check Condition
>>>>> (da0:mpt1:0:0:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da3:mpt1:0:3:0): READ(10). CDB: 28 0 76 69 1 1c 0 0 1 0
>>>>> (da3:mpt1:0:3:0): CAM status: SCSI Status Error
>>>>> (da3:mpt1:0:3:0): SCSI status: Check Condition
>>>>> (da3:mpt1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da1:mpt1:0:1:0): READ(10). CDB: 28 0 76 69 1 1c 0 0 1 0
>>>>> (da1:mpt1:0:1:0): CAM status: SCSI Status Error
>>>>> (da1:mpt1:0:1:0): SCSI status: Check Condition
>>>>> (da1:mpt1:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da9:mpt0:0:1:0): READ(10). CDB: 28 0 1a b3 d7 0 0 0 80 0
>>>>> (da9:mpt0:0:1:0): CAM status: SCSI Status Error
>>>>> (da9:mpt0:0:1:0): SCSI status: Check Condition
>>>>> (da9:mpt0:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>> (da4:mpt1:0:4:0): READ(10). CDB: 28 0 53 3c c6 0 0 0 80 0
>>>>> (da4:mpt1:0:4:0): CAM status: SCSI Status Error
>>>>> (da4:mpt1:0:4:0): SCSI status: Check Condition
>>>>> (da4:mpt1:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
>>>>> or
>>>>> bus device reset occurred)
>>>>>
>>>>>
>>>>>
>>>>> >
>>>>> > --
>>>>> > | Jeremy Chadwick                                   jdc at parodius.com|
>>>>> > | Parodius Networking                       http://www.parodius.com/|
>>>>> > | UNIX Systems Administrator                   Mountain View, CA, US
>>>>> |
>>>>> > | Making life hard for others since 1977.               PGP 4BD6C0CB
>>>>> |
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>> Joshua Boyd
>>>>> _______________________________________________
>>>>> freebsd-stable at freebsd.org mailing list
>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
>>>>> To unsubscribe, send any mail to "
>>>>> freebsd-stable-unsubscribe at freebsd.org"
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Joshua Boyd
>>>
>>
>>
>>
>> --
>> Joshua Boyd
>>
>>
>> E-mail: boydjd at jbip.net
>> http://www.jbip.net
>>
>
>


-- 
Joshua Boyd

E-mail: boydjd at jbip.net
http://www.jbip.net


More information about the freebsd-stable mailing list