Problems with Chelsio driver in CURRENT...

Kip Macy kip.macy at gmail.com
Wed Feb 13 08:52:53 UTC 2008


Oops sorry ... What is the output of 'sysctl dev.cxgbc.0'?

 -Kip

On Feb 13, 2008 12:51 AM, Kip Macy <kip.macy at gmail.com> wrote:
> When you say a "recent kernel/world", I take it you're still running 7.0?
>
>  -Kip
>
>
>
>
>
> On Feb 12, 2008 11:38 PM,  <gnn at freebsd.org> wrote:
> > Hi,
> >
> > I have two MP/Multicore Xeon boxes with CX4 based Chelsio cards in
> > them.  If I boot 7.0-RC1 the cards can talk to each other.  If I build
> > a recent kernel/world (for instance from today) I cannot ping between
> > them.  I have tried using GENERIC as wella as a custom kernel.
> >
> > kodama8# ifconfig cxgb0
> > cxgb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
> >         options=1bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4>
> >         ether 00:07:43:05:20:68
> >         inet 172.16.0.2 netmask 0xffffff00 broadcast 172.16.0.255
> >         media: Ethernet 10Gbase-CX4 <full-duplex> (autoselect <full-duplex>)
> >         status: active
> > kodama8# ping 172.16.0.1
> > PING 172.16.0.1 (172.16.0.1): 56 data bytes
> > ^C
> > --- 172.16.0.1 ping statistics ---
> > 5 packets transmitted, 0 packets received, 100.0% packet loss
> > kodama8#
> >
> > kodama$ uname -a
> > FreeBSD kodama8.neville-neil.comA 7.0-RC1 FreeBSD 7.0-RC1 #0: Mon Dec 24 10:10:07 UTC 2007     root at driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  amd64
> > kodama8#
> >
> > nozomi8# ifconfig cxgb0
> > cxgb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
> >         options=1bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4>
> >         ether 00:07:43:05:20:43
> >         inet 172.16.0.1 netmask 0xffffff00 broadcast 172.16.0.255
> >         media: Ethernet 10Gbase-CX4 <full-duplex> (autoselect <full-duplex>)
> >         status: active
> > nozomi8#
> >
> > nozomi8# uname -a
> > FreeBSD nozomi8.neville-neil.com 8.0-CURRENT FreeBSD 8.0-CURRENT #2: Wed Feb 13 15:47:05 JST 2008     root at nozomi8.neville-neil.com:/usr/obj/scratch/FreeBSD.HEAD/src/sys/GENERIC  amd64
> > nozomi8#
> >
> >
> > The dmesg is at the end of this mail.
> >
> > Thoughts?
> >
> > Thanks,
> > George
> >
> >
> > nozomi8# dmesg
> > Copyright (c) 1992-2008 The FreeBSD Project.
> > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> >         The Regents of the University of California. All rights reserved.
> > FreeBSD is a registered trademark of The FreeBSD Foundation.
> > FreeBSD 8.0-CURRENT #2: Wed Feb 13 15:47:05 JST 2008
> >     root at nozomi8.neville-neil.com:/usr/obj/scratch/FreeBSD.HEAD/src/sys/GENERIC
> > WARNING: WITNESS option enabled, expect reduced performance.
> > Timecounter "i8254" frequency 1193182 Hz quality 0
> > CPU: Intel(R) Xeon(R) CPU           X5355  @ 2.66GHz (2666.68-MHz K8-class CPU)
> >   Origin = "GenuineIntel"  Id = 0x6f7  Stepping = 7
> >   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> >   Features2=0x4e3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
> >   AMD Features=0x20100800<SYSCALL,NX,LM>
> >   AMD Features2=0x1<LAHF>
> >   Cores per package: 4
> > usable memory = 8575602688 (8178 MB)
> > avail memory  = 8306462720 (7921 MB)
> > ACPI APIC Table: <PTLTD          APIC  >
> > FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
> >  cpu0 (BSP): APIC ID:  0
> >  cpu1 (AP): APIC ID:  1
> >  cpu2 (AP): APIC ID:  2
> >  cpu3 (AP): APIC ID:  3
> >  cpu4 (AP): APIC ID:  4
> >  cpu5 (AP): APIC ID:  5
> >  cpu6 (AP): APIC ID:  6
> >  cpu7 (AP): APIC ID:  7
> > ioapic0 <Version 2.0> irqs 0-23 on motherboard
> > ioapic1 <Version 2.0> irqs 24-47 on motherboard
> > kbd1 at kbdmux0
> > ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
> > acpi0: <PTLTD   RSDT> on motherboard
> > acpi0: [ITHREAD]
> > acpi0: Power Button (fixed)
> > Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
> > acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
> > acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
> > Timecounter "HPET" frequency 14318180 Hz quality 900
> > cpu0: <ACPI CPU> on acpi0
> > est0: <Enhanced SpeedStep Frequency Control> on cpu0
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est0 attach returned 6
> > p4tcc0: <CPU Frequency Thermal Control> on cpu0
> > cpu1: <ACPI CPU> on acpi0
> > est1: <Enhanced SpeedStep Frequency Control> on cpu1
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est1 attach returned 6
> > p4tcc1: <CPU Frequency Thermal Control> on cpu1
> > cpu2: <ACPI CPU> on acpi0
> > est2: <Enhanced SpeedStep Frequency Control> on cpu2
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est2 attach returned 6
> > p4tcc2: <CPU Frequency Thermal Control> on cpu2
> > cpu3: <ACPI CPU> on acpi0
> > est3: <Enhanced SpeedStep Frequency Control> on cpu3
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est3 attach returned 6
> > p4tcc3: <CPU Frequency Thermal Control> on cpu3
> > cpu4: <ACPI CPU> on acpi0
> > est4: <Enhanced SpeedStep Frequency Control> on cpu4
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est4 attach returned 6
> > p4tcc4: <CPU Frequency Thermal Control> on cpu4
> > cpu5: <ACPI CPU> on acpi0
> > est5: <Enhanced SpeedStep Frequency Control> on cpu5
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est5 attach returned 6
> > p4tcc5: <CPU Frequency Thermal Control> on cpu5
> > cpu6: <ACPI CPU> on acpi0
> > est6: <Enhanced SpeedStep Frequency Control> on cpu6
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est6 attach returned 6
> > p4tcc6: <CPU Frequency Thermal Control> on cpu6
> > cpu7: <ACPI CPU> on acpi0
> > est7: <Enhanced SpeedStep Frequency Control> on cpu7
> > est: CPU supports Enhanced Speedstep, but is not recognized.
> > est: cpu_vendor GenuineIntel, msr 82a082a0600082a
> > device_attach: est7 attach returned 6
> > p4tcc7: <CPU Frequency Thermal Control> on cpu7
> > pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> > pci0: <ACPI PCI bus> on pcib0
> > pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
> > pci1: <ACPI PCI bus> on pcib1
> > pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
> > pci2: <ACPI PCI bus> on pcib2
> > pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
> > pci3: <ACPI PCI bus> on pcib3
> > pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci3
> > pci4: <ACPI PCI bus> on pcib4
> > ahd0: <Adaptec AIC7902 Ultra320 SCSI adapter> port 0x2400-0x24ff,0x2000-0x20ff mem 0xd8b00000-0xd8b01fff irq 16 at device 2.0 on pci4
> > ahd0: [ITHREAD]
> > aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
> > ahd1: <Adaptec AIC7902 Ultra320 SCSI adapter> port 0x2c00-0x2cff,0x2800-0x28ff mem 0xd8b02000-0xd8b03fff irq 17 at device 2.1 on pci4
> > ahd1: [ITHREAD]
> > aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs
> > pcib5: <ACPI PCI-PCI bridge> at device 0.2 on pci3
> > pci5: <ACPI PCI bus> on pcib5
> > pcib6: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
> > pci6: <ACPI PCI bus> on pcib6
> > em0: <Intel(R) PRO/1000 Network Connection Version - 6.7.3> port 0x3000-0x301f mem 0xd8a20000-0xd8a3ffff,0xd8a00000-0xd8a1ffff irq 18 at device 0.0 on pci6
> > em0: Using MSI interrupt
> > em0: Ethernet address: 00:30:48:64:1e:20
> > em0: [FILTER]
> > em1: <Intel(R) PRO/1000 Network Connection Version - 6.7.3> port 0x3020-0x303f mem 0xd8a60000-0xd8a7ffff,0xd8a40000-0xd8a5ffff irq 19 at device 0.1 on pci6
> > em1: Using MSI interrupt
> > em1: Ethernet address: 00:30:48:64:1e:21
> > em1: [FILTER]
> > pcib7: <ACPI PCI-PCI bridge> at device 0.3 on pci1
> > pci7: <ACPI PCI bus> on pcib7
> > pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
> > pci8: <ACPI PCI bus> on pcib8
> > pcib9: <ACPI PCI-PCI bridge> at device 6.0 on pci0
> > pci9: <ACPI PCI bus> on pcib9
> > pci9: <network, ethernet> at device 0.0 (no driver attached)
> > pci0: <base peripheral> at device 8.0 (no driver attached)
> > pcib10: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
> > pci10: <ACPI PCI bus> on pcib10
> > uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1800-0x181f irq 17 at device 29.0 on pci0
> > uhci0: [GIANT-LOCKED]
> > uhci0: [ITHREAD]
> > usb0: <Intel 631XESB/632XESB/3100 USB controller USB-1> on uhci0
> > usb0: USB revision 1.0
> > uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
> > uhub0: 2 ports with 2 removable, self powered
> > uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1820-0x183f irq 19 at device 29.1 on pci0
> > uhci1: [GIANT-LOCKED]
> > uhci1: [ITHREAD]
> > usb1: <Intel 631XESB/632XESB/3100 USB controller USB-2> on uhci1
> > usb1: USB revision 1.0
> > uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
> > uhub1: 2 ports with 2 removable, self powered
> > uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1840-0x185f irq 18 at device 29.2 on pci0
> > uhci2: [GIANT-LOCKED]
> > uhci2: [ITHREAD]
> > usb2: <Intel 631XESB/632XESB/3100 USB controller USB-3> on uhci2
> > usb2: USB revision 1.0
> > uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
> > uhub2: 2 ports with 2 removable, self powered
> > ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xd8f00000-0xd8f003ff irq 17 at device 29.7 on pci0
> > ehci0: [GIANT-LOCKED]
> > ehci0: [ITHREAD]
> > usb3: EHCI version 1.0
> > usb3: companion controllers, 2 ports each: usb0 usb1 usb2
> > usb3: <Intel 63XXESB USB 2.0 controller> on ehci0
> > usb3: USB revision 2.0
> > uhub3: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3
> > uhub3: 6 ports with 6 removable, self powered
> > pcib11: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> > pci11: <ACPI PCI bus> on pcib11
> > vgapci0: <VGA-compatible display> port 0x4000-0x40ff mem 0xd0000000-0xd7ffffff,0xd8c00000-0xd8c0ffff irq 18 at device 1.0 on pci11
> > isab0: <PCI-ISA bridge> at device 31.0 on pci0
> > isa0: <ISA bus> on isab0
> > atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0
> > ata0: <ATA channel 0> on atapci0
> > ata0: [ITHREAD]
> > ata1: <ATA channel 1> on atapci0
> > ata1: [ITHREAD]
> > pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
> > acpi_button0: <Power Button> on acpi0
> > atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> > atkbd0: <AT Keyboard> irq 1 on atkbdc0
> > kbd0 at atkbd0
> > atkbd0: [GIANT-LOCKED]
> > atkbd0: [ITHREAD]
> > sio0: configured irq 4 not in bitmap of probed irqs 0
> > sio0: port may not be enabled
> > sio0: configured irq 4 not in bitmap of probed irqs 0
> > sio0: port may not be enabled
> > sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> > sio0: type 16550A, console
> > sio0: [FILTER]
> > sio1: configured irq 3 not in bitmap of probed irqs 0
> > sio1: port may not be enabled
> > sio1: configured irq 3 not in bitmap of probed irqs 0
> > sio1: port may not be enabled
> > sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
> > sio1: type 16550A
> > sio1: [FILTER]
> > fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
> > fdc0: [FILTER]
> > ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0
> > ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
> > ppc0: FIFO with 16/16/9 bytes threshold
> > ppbus0: <Parallel port bus> on ppc0
> > ppbus0: [ITHREAD]
> > plip0: <PLIP network interface> on ppbus0
> > lpt0: <Printer> on ppbus0
> > lpt0: Interrupt-driven port
> > ppi0: <Parallel I/O> on ppbus0
> > ppc0: [GIANT-LOCKED]
> > ppc0: [ITHREAD]
> > orm0: <ISA Option ROM> at iomem 0xc0000-0xcafff on isa0
> > sc0: <System console> at flags 0x100 on isa0
> > sc0: VGA <16 virtual consoles, flags=0x100>
> > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> > Timecounters tick every 1.000 msec
> > Waiting 5 seconds for SCSI devices to settle
> > acd0: DVDROM <ATAPI DVD D DH16D2P/HP53> at ata0-slave UDMA33
> > da0 at ahd0 bus 0 target 0 lun 0
> > da0: <SEAGATE ST3146855LW 0003> Fixed Direct Access SCSI-3 device
> > da0: 160.000MB/s transfers (80.000MHz DT, offset 63, 16bit)
> > da0: Command Queueing Enabled
> > da0: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C)
> > SMP: AP CPU #1 Launched!
> > SMP: AP CPU #2 Launched!
> > SMP: AP CPU #3 Launched!
> > SMP: AP CPU #5 Launched!
> > SMP: AP CPU #6 Launched!
> > SMP: AP CPU #7 Launched!
> > SMP: AP CPU #4 Launched!
> > WARNING: WITNESS option enabled, expect reduced performance.
> > lock order reversal:
> >  1st 0xffffff0003426e28 devfs (devfs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061
> >  2nd 0xffffff000348fda0 devfsmount (devfsmount) @ /scratch/FreeBSD.HEAD/src/sys/fs/devfs/devfs_vnops.c:201
> > KDB: stack backtrace:
> > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> > witness_checkorder() at witness_checkorder+0x605
> > _sx_xlock() at _sx_xlock+0x52
> > devfs_allocv() at devfs_allocv+0x136
> > devfs_root() at devfs_root+0x52
> > set_rootvnode() at set_rootvnode+0x2c
> > vfs_mountroot() at vfs_mountroot+0x310
> > start_init() at start_init+0x62
> > fork_exit() at fork_exit+0x12a
> > fork_trampoline() at fork_trampoline+0xe
> > --- trap 0, rip = 0, rsp = 0xffffffffac266d30, rbp = 0 ---
> > Trying to mount root from ufs:/dev/da0s1a
> > lock order reversal:
> >  1st 0xffffff0003426668 ufs (ufs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061
> >  2nd 0xffffff00034ed000 vfslock (vfslock) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:364
> > KDB: stack backtrace:
> > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> > witness_checkorder() at witness_checkorder+0x605
> > _lockmgr() at _lockmgr+0x4e3
> > vfs_busy() at vfs_busy+0xdf
> > lookup() at lookup+0x8a6
> > namei() at namei+0x2cb
> > kern_unlink() at kern_unlink+0x8e
> > vfs_mountroot_try() at vfs_mountroot_try+0x41f
> > vfs_mountroot() at vfs_mountroot+0x3fd
> > start_init() at start_init+0x62
> > fork_exit() at fork_exit+0x12a
> > fork_trampoline() at fork_trampoline+0xe
> > --- trap 0, rip = 0, rsp = 0xffffffffac266d30, rbp = 0 ---
> > lock order reversal:
> >  1st 0xffffff00010ec070 user map (user map) @ /scratch/FreeBSD.HEAD/src/sys/vm/vm_map.c:3111
> >  2nd 0xffffff0003426288 ufs (ufs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061
> > KDB: stack backtrace:
> > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
> > witness_checkorder() at witness_checkorder+0x605
> > _lockmgr() at _lockmgr+0x4e3
> > ffs_lock() at ffs_lock+0x6d
> > VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b
> > _vn_lock() at _vn_lock+0x8b
> > vget() at vget+0x125
> > vnode_pager_lock() at vnode_pager_lock+0x14a
> > vm_fault() at vm_fault+0x1e5
> > trap_pfault() at trap_pfault+0x128
> > trap() at trap+0x4f2
> > calltrap() at calltrap+0x8
> > --- trap 0xc, rip = 0x400146, rsp = 0x7fffffffee80, rbp = 0x7fffffffeeb8 ---
> > em1: link state changed to UP
> > cxgbc0: <Chelsio T310 RNIC, 1 port> mem 0xd8801000-0xd8801fff,0xd8000000-0xd87fffff,0xd8800000-0xd8800fff irq 18 at device 0.0 on pci9
> > cxgb0: <Port 0 10GBASE-CX4> on cxgbc0
> > cxgb0: Ethernet address: 00:07:43:05:20:43
> > Failed to allocate cluster
> > Failed to allocate cluster
> > Failed to allocate cluster
> > Failed to allocate cluster
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting
> > up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > setting up interrupt for port=0
> > cxgbc0: [ITHREAD]
> > bind qsets
> > cxgbc0: starting thread for 0
> > device_map=0x1
> > adding adapter 0xffffffff8134f000
> > cxgbc0: offload started
> > offload opened
> > cxgb0: link state changed to UP
> > cxgbc0: enabling interrupts on port=0
> > nozomi8#
> > _______________________________________________
> > freebsd-net at freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-net
> > To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
> >
>


More information about the freebsd-current mailing list