ixl 40G bad performance?
Luigi Rizzo
rizzo at iet.unipi.it
Mon Oct 19 14:20:26 UTC 2015
i would look at the following:
- c states and clock speed - make sure you never go below C1,
and fix the clock speed to max.
Sure these parameters also affect the 10G card, but there
may be strange interaction that trigger the power saving
modes in different ways
- interrupt moderation (may affect ping latency,
do not remember how it is set in ixl but probably a sysctl
- number of queues (32 is a lot i wouldn't use more than 4-8),
may affect cpu-socket affinity
- tso and flow director - i have seen bad effects of
accelerations so i would run the iperf test with
of these features disabled on both sides, and then enable
them one at a time
- queue sizes - the driver seems to use 1024 slots which is
about 1.5 MB queued, which in turn means you have 300us
(and possibly half of that) to drain the queue at 40Gbit/s.
150-300us may seem an eternity, but if a couple of cores fall
into c7 your budget is gone and the loss will trigger a
retransmission and window halving etc.
cheers
luigi
On Mon, Oct 19, 2015 at 6:52 AM, Eggert, Lars <lars at netapp.com> wrote:
> Hi,
>
> I'm running a few simple tests on -CURRENT with a pair of dual-port Intel XL710 boards, which are seen by the kernel as:
>
> ixl0: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.3> mem 0xdc800000-0xdcffffff,0xdd808000-0xdd80ffff irq 32 at device 0.0 on pci3
> ixl0: Using MSIX interrupts with 33 vectors
> ixl0: f4.40 a1.4 n04.53 e80001dca
> ixl0: Using defaults for TSO: 65518/35/2048
> ixl0: Ethernet address: 68:05:ca:32:0b:98
> ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl0: netmap queues/slots: TX 32/1024, RX 32/1024
> ixl1: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.3> mem 0xdc000000-0xdc7fffff,0xdd800000-0xdd807fff irq 32 at device 0.1 on pci3
> ixl1: Using MSIX interrupts with 33 vectors
> ixl1: f4.40 a1.4 n04.53 e80001dca
> ixl1: Using defaults for TSO: 65518/35/2048
> ixl1: Ethernet address: 68:05:ca:32:0b:99
> ixl1: PCI Express Bus: Speed 8.0GT/s Width x8
> ixl1: netmap queues/slots: TX 32/1024, RX 32/1024
> ixl0: link state changed to UP
> ixl1: link state changed to UP
>
> I have two identical machines connected with patch cables (no switch). iperf performance is bad:
>
> # iperf -c 10.0.1.2
> ------------------------------------------------------------
> Client connecting to 10.0.1.2, TCP port 5001
> TCP window size: 32.5 KByte (default)
> ------------------------------------------------------------
> [ 3] local 10.0.1.1 port 19238 connected with 10.0.1.2 port 5001
> [ ID] Interval Transfer Bandwidth
> [ 3] 0.0-10.0 sec 3.91 GBytes 3.36 Gbits/sec
>
> As is flood ping latency:
>
> # sudo ping -f 10.0.1.2
> PING 10.0.1.2 (10.0.1.2): 56 data bytes
> .^C
> --- 10.0.1.2 ping statistics ---
> 41927 packets transmitted, 41926 packets received, 0.0% packet loss
> round-trip min/avg/max/stddev = 0.084/0.116/0.145/0.002 ms
>
> Any ideas on what's going on here? Testing 10G ix interfaces between the same two machines results in 9.39 Gbits/sec and flood ping latencies of 17 usec.
>
> Thanks,
> Lars
>
> PS: Full dmesg attached.
>
> Copyright (c) 1992-2015 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 11.0-CURRENT #2 483de3c(muclab)-dirty: Mon Oct 19 11:01:16 CEST 2015
> elars at laurel.muccbc.hq.netapp.com:/usr/home/elars/obj/usr/home/elars/src/sys/MUCLAB amd64
> FreeBSD clang version 3.7.0 (tags/RELEASE_370/final 246257) 20150906
> VT(vga): resolution 640x480
> CPU: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz (2000.05-MHz K8-class CPU)
> Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7
> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> Features2=0x1fbee3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
> AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
> AMD Features2=0x1<LAHF>
> XSAVE Features=0x1<XSAVEOPT>
> VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
> TSC: P-state invariant, performance statistics
> real memory = 137438953472 (131072 MB)
> avail memory = 133484290048 (127300 MB)
> Event timer "LAPIC" quality 600
> ACPI APIC Table: < >
> FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
> FreeBSD/SMP: 2 package(s) x 8 core(s) x 2 SMT threads
> cpu0 (BSP): APIC ID: 0
> cpu1 (AP): APIC ID: 1
> cpu2 (AP): APIC ID: 2
> cpu3 (AP): APIC ID: 3
> cpu4 (AP): APIC ID: 4
> cpu5 (AP): APIC ID: 5
> cpu6 (AP): APIC ID: 6
> cpu7 (AP): APIC ID: 7
> cpu8 (AP): APIC ID: 8
> cpu9 (AP): APIC ID: 9
> cpu10 (AP): APIC ID: 10
> cpu11 (AP): APIC ID: 11
> cpu12 (AP): APIC ID: 12
> cpu13 (AP): APIC ID: 13
> cpu14 (AP): APIC ID: 14
> cpu15 (AP): APIC ID: 15
> cpu16 (AP): APIC ID: 32
> cpu17 (AP): APIC ID: 33
> cpu18 (AP): APIC ID: 34
> cpu19 (AP): APIC ID: 35
> cpu20 (AP): APIC ID: 36
> cpu21 (AP): APIC ID: 37
> cpu22 (AP): APIC ID: 38
> cpu23 (AP): APIC ID: 39
> cpu24 (AP): APIC ID: 40
> cpu25 (AP): APIC ID: 41
> cpu26 (AP): APIC ID: 42
> cpu27 (AP): APIC ID: 43
> cpu28 (AP): APIC ID: 44
> cpu29 (AP): APIC ID: 45
> cpu30 (AP): APIC ID: 46
> cpu31 (AP): APIC ID: 47
> ioapic0 <Version 2.0> irqs 0-23 on motherboard
> ioapic1 <Version 2.0> irqs 24-47 on motherboard
> ioapic2 <Version 2.0> irqs 48-71 on motherboard
> random: entropy device external interface
> module_register_init: MOD_LOAD (vesa, 0xffffffff8094fb90, 0) error 19
> netmap: loaded module
> vtvga0: <VT VGA driver> on motherboard
> smbios0: <System Management BIOS> at iomem 0xf04d0-0xf04ee on motherboard
> smbios0: Version: 2.7, BCD Revision: 2.7
> cryptosoft0: <software crypto> on motherboard
> aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
> acpi0: <SUPERM SMCI--MB> on motherboard
> acpi0: Power Button (fixed)
> cpu0: <ACPI CPU> on acpi0
> cpu1: <ACPI CPU> on acpi0
> cpu2: <ACPI CPU> on acpi0
> cpu3: <ACPI CPU> on acpi0
> cpu4: <ACPI CPU> on acpi0
> cpu5: <ACPI CPU> on acpi0
> cpu6: <ACPI CPU> on acpi0
> cpu7: <ACPI CPU> on acpi0
> cpu8: <ACPI CPU> on acpi0
> cpu9: <ACPI CPU> on acpi0
> cpu10: <ACPI CPU> on acpi0
> cpu11: <ACPI CPU> on acpi0
> cpu12: <ACPI CPU> on acpi0
> cpu13: <ACPI CPU> on acpi0
> cpu14: <ACPI CPU> on acpi0
> cpu15: <ACPI CPU> on acpi0
> cpu16: <ACPI CPU> on acpi0
> cpu17: <ACPI CPU> on acpi0
> cpu18: <ACPI CPU> on acpi0
> cpu19: <ACPI CPU> on acpi0
> cpu20: <ACPI CPU> on acpi0
> cpu21: <ACPI CPU> on acpi0
> cpu22: <ACPI CPU> on acpi0
> cpu23: <ACPI CPU> on acpi0
> cpu24: <ACPI CPU> on acpi0
> cpu25: <ACPI CPU> on acpi0
> cpu26: <ACPI CPU> on acpi0
> cpu27: <ACPI CPU> on acpi0
> cpu28: <ACPI CPU> on acpi0
> cpu29: <ACPI CPU> on acpi0
> cpu30: <ACPI CPU> on acpi0
> cpu31: <ACPI CPU> on acpi0
> attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
> Event timer "RTC" frequency 32768 Hz quality 0
> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
> Timecounter "HPET" frequency 14318180 Hz quality 950
> Event timer "HPET" frequency 14318180 Hz quality 350
> Event timer "HPET1" frequency 14318180 Hz quality 340
> Event timer "HPET2" frequency 14318180 Hz quality 340
> Event timer "HPET3" frequency 14318180 Hz quality 340
> Event timer "HPET4" frequency 14318180 Hz quality 340
> Event timer "HPET5" frequency 14318180 Hz quality 340
> Event timer "HPET6" frequency 14318180 Hz quality 340
> Event timer "HPET7" frequency 14318180 Hz quality 340
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> pcib1: <ACPI PCI-PCI bridge> irq 26 at device 1.0 on pci0
> pci1: <ACPI PCI bus> on pcib1
> pcib2: <ACPI PCI-PCI bridge> irq 26 at device 1.1 on pci0
> pci2: <ACPI PCI bus> on pcib2
> igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.2> port 0x8020-0x803f mem 0xdf820000-0xdf83ffff,0xdf844000-0xdf847fff irq 27 at device 0.0 on pci2
> igb0: Using MSIX interrupts with 9 vectors
> igb0: Ethernet address: 00:25:90:9b:73:2e
> igb0: Bound queue 0 to cpu 0
> igb0: Bound queue 1 to cpu 1
> igb0: Bound queue 2 to cpu 2
> igb0: Bound queue 3 to cpu 3
> igb0: Bound queue 4 to cpu 4
> igb0: Bound queue 5 to cpu 5
> igb0: Bound queue 6 to cpu 6
> igb0: Bound queue 7 to cpu 7
> igb0: netmap queues/slots: TX 8/1024, RX 8/1024
> igb1: <Intel(R) PRO/1000 Network Connection, Version - 2.5.2> port 0x8000-0x801f mem 0xdf800000-0xdf81ffff,0xdf840000-0xdf843fff irq 30 at device 0.1 on pci2
> igb1: Using MSIX interrupts with 9 vectors
> igb1: Ethernet address: 00:25:90:9b:73:2f
> igb1: Bound queue 0 to cpu 8
> igb1: Bound queue 1 to cpu 9
> igb1: Bound queue 2 to cpu 10
> igb1: Bound queue 3 to cpu 11
> igb1: Bound queue 4 to cpu 12
> igb1: Bound queue 5 to cpu 13
> igb1: Bound queue 6 to cpu 14
> igb1: Bound queue 7 to cpu 15
> igb1: netmap queues/slots: TX 8/1024, RX 8/1024
> pcib3: <ACPI PCI-PCI bridge> irq 33 at device 2.0 on pci0
> pci3: <ACPI PCI bus> on pcib3
> pci3: <network, ethernet> at device 0.0 (no driver attached)
> pci3: <network, ethernet> at device 0.1 (no driver attached)
> pcib4: <ACPI PCI-PCI bridge> irq 33 at device 2.2 on pci0
> pci4: <ACPI PCI bus> on pcib4
> pcib5: <ACPI PCI-PCI bridge> irq 41 at device 3.0 on pci0
> pci5: <ACPI PCI bus> on pcib5
> pcib6: <ACPI PCI-PCI bridge> irq 41 at device 3.2 on pci0
> pci6: <ACPI PCI bus> on pcib6
> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.1.0> port 0x7020-0x703f mem 0xdf180000-0xdf1fffff,0xdf604000-0xdf607fff irq 42 at device 0.0 on pci6
> ix0: Using MSIX interrupts with 33 vectors
> ix0: Ethernet address: 90:e2:ba:77:d4:9c
> ix0: PCI Express Bus: Speed 5.0GT/s Width x8
> ix0: netmap queues/slots: TX 32/2048, RX 32/2048
> ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.1.0> port 0x7000-0x701f mem 0xdf100000-0xdf17ffff,0xdf600000-0xdf603fff irq 45 at device 0.1 on pci6
> ix1: Using MSIX interrupts with 33 vectors
> ix1: Ethernet address: 90:e2:ba:77:d4:9d
> ix1: PCI Express Bus: Speed 5.0GT/s Width x8
> ix1: netmap queues/slots: TX 32/2048, RX 32/2048
> pcib7: <ACPI PCI-PCI bridge> irq 16 at device 17.0 on pci0
> pci7: <ACPI PCI bus> on pcib7
> isci0: <Intel(R) C600 Series Chipset SAS Controller (SATA mode)> port 0x6000-0x60ff mem 0xde07c000-0xde07ffff,0xddc00000-0xddffffff irq 16 at device 0.0 on pci7
> pci0: <simple comms> at device 22.0 (no driver attached)
> pci0: <simple comms> at device 22.1 (no driver attached)
> ehci0: <Intel Patsburg USB 2.0 controller> mem 0xdf923000-0xdf9233ff irq 16 at device 26.0 on pci0
> usbus0: EHCI version 1.0
> usbus0 on ehci0
> pcib8: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
> pci8: <ACPI PCI bus> on pcib8
> pcib9: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0
> pci9: <ACPI PCI bus> on pcib9
> pcib10: <PCI-PCI bridge> at device 0.0 on pci9
> pci10: <PCI bus> on pcib10
> pcib11: <PCI-PCI bridge> at device 0.0 on pci10
> pci11: <PCI bus> on pcib11
> pcib12: <PCI-PCI bridge> at device 0.0 on pci11
> pci12: <PCI bus> on pcib12
> vgapci0: <VGA-compatible display> mem 0xdb000000-0xdbffffff,0xdf000000-0xdf003fff,0xde800000-0xdeffffff irq 19 at device 0.0 on pci12
> vgapci0: Boot video device
> pcib13: <PCI-PCI bridge> at device 1.0 on pci10
> pci13: <PCI bus> on pcib13
> ehci1: <Intel Patsburg USB 2.0 controller> mem 0xdf922000-0xdf9223ff irq 23 at device 29.0 on pci0
> usbus1: EHCI version 1.0
> usbus1 on ehci1
> pcib14: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> pci14: <ACPI PCI bus> on pcib14
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> isa0: <ISA bus> on isab0
> ahci0: <Intel Patsburg AHCI SATA controller> port 0x9050-0x9057,0x9040-0x9043,0x9030-0x9037,0x9020-0x9023,0x9000-0x901f mem 0xdf921000-0xdf9217ff irq 18 at device 31.2 on pci0
> ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
> ahcich0: <AHCI channel> at channel 0 on ahci0
> ahcich1: <AHCI channel> at channel 1 on ahci0
> ahcich2: <AHCI channel> at channel 2 on ahci0
> ahcich3: <AHCI channel> at channel 3 on ahci0
> ahcich4: <AHCI channel> at channel 4 on ahci0
> ahcich5: <AHCI channel> at channel 5 on ahci0
> ahciem0: <AHCI enclosure management bridge> on ahci0
> ichsmb0: <Intel Patsburg SMBus controller> port 0x1180-0x119f mem 0xdf920000-0xdf9200ff irq 18 at device 31.3 on pci0
> smbus0: <System Management Bus> on ichsmb0
> smb0: <SMBus generic I/O> on smbus0
> pcib15: <ACPI Host-PCI bridge> on acpi0
> pci15: <ACPI PCI bus> on pcib15
> pcib16: <ACPI Host-PCI bridge> on acpi0
> pci16: <ACPI PCI bus> on pcib16
> pcib17: <ACPI PCI-PCI bridge> irq 57 at device 2.0 on pci16
> pci17: <ACPI PCI bus> on pcib17
> pcib18: <ACPI PCI-PCI bridge> irq 64 at device 3.0 on pci16
> pci18: <ACPI PCI bus> on pcib18
> pcib19: <ACPI PCI-PCI bridge> irq 64 at device 3.2 on pci16
> pci19: <ACPI PCI bus> on pcib19
> pcib20: <ACPI Host-PCI bridge> on acpi0
> pci20: <ACPI PCI bus> on pcib20
> acpi_button0: <Power Button> on acpi0
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> uart0: console (115200,n,8,1)
> uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
> ipmi0: <IPMI System Interface> port 0xca2,0xca3 on acpi0
> ipmi0: KCS mode found at io 0xca2 on acpi
> ichwd0 on isa0
> ichwd0: ICH WDT present but disabled in BIOS or hardware
> device_attach: ichwd0 attach returned 6
> ichwd0 at port 0x430-0x437,0x460-0x47f on isa0
> ichwd0: ICH WDT present but disabled in BIOS or hardware
> device_attach: ichwd0 attach returned 6
> orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0
> coretemp0: <CPU On-Die Thermal Sensors> on cpu0
> est0: <Enhanced SpeedStep Frequency Control> on cpu0
> coretemp1: <CPU On-Die Thermal Sensors> on cpu1
> est1: <Enhanced SpeedStep Frequency Control> on cpu1
> coretemp2: <CPU On-Die Thermal Sensors> on cpu2
> est2: <Enhanced SpeedStep Frequency Control> on cpu2
> coretemp3: <CPU On-Die Thermal Sensors> on cpu3
> est3: <Enhanced SpeedStep Frequency Control> on cpu3
> coretemp4: <CPU On-Die Thermal Sensors> on cpu4
> est4: <Enhanced SpeedStep Frequency Control> on cpu4
> coretemp5: <CPU On-Die Thermal Sensors> on cpu5
> est5: <Enhanced SpeedStep Frequency Control> on cpu5
> coretemp6: <CPU On-Die Thermal Sensors> on cpu6
> est6: <Enhanced SpeedStep Frequency Control> on cpu6
> coretemp7: <CPU On-Die Thermal Sensors> on cpu7
> est7: <Enhanced SpeedStep Frequency Control> on cpu7
> coretemp8: <CPU On-Die Thermal Sensors> on cpu8
> est8: <Enhanced SpeedStep Frequency Control> on cpu8
> coretemp9: <CPU On-Die Thermal Sensors> on cpu9
> est9: <Enhanced SpeedStep Frequency Control> on cpu9
> coretemp10: <CPU On-Die Thermal Sensors> on cpu10
> est10: <Enhanced SpeedStep Frequency Control> on cpu10
> coretemp11: <CPU On-Die Thermal Sensors> on cpu11
> est11: <Enhanced SpeedStep Frequency Control> on cpu11
> coretemp12: <CPU On-Die Thermal Sensors> on cpu12
> est12: <Enhanced SpeedStep Frequency Control> on cpu12
> coretemp13: <CPU On-Die Thermal Sensors> on cpu13
> est13: <Enhanced SpeedStep Frequency Control> on cpu13
> coretemp14: <CPU On-Die Thermal Sensors> on cpu14
> est14: <Enhanced SpeedStep Frequency Control> on cpu14
> coretemp15: <CPU On-Die Thermal Sensors> on cpu15
> est15: <Enhanced SpeedStep Frequency Control> on cpu15
> coretemp16: <CPU On-Die Thermal Sensors> on cpu16
> est16: <Enhanced SpeedStep Frequency Control> on cpu16
> coretemp17: <CPU On-Die Thermal Sensors> on cpu17
> est17: <Enhanced SpeedStep Frequency Control> on cpu17
> coretemp18: <CPU On-Die Thermal Sensors> on cpu18
> est18: <Enhanced SpeedStep Frequency Control> on cpu18
> coretemp19: <CPU On-Die Thermal Sensors> on cpu19
> est19: <Enhanced SpeedStep Frequency Control> on cpu19
> coretemp20: <CPU On-Die Thermal Sensors> on cpu20
> est20: <Enhanced SpeedStep Frequency Control> on cpu20
> coretemp21: <CPU On-Die Thermal Sensors> on cpu21
> est21: <Enhanced SpeedStep Frequency Control> on cpu21
> coretemp22: <CPU On-Die Thermal Sensors> on cpu22
> est22: <Enhanced SpeedStep Frequency Control> on cpu22
> coretemp23: <CPU On-Die Thermal Sensors> on cpu23
> est23: <Enhanced SpeedStep Frequency Control> on cpu23
> coretemp24: <CPU On-Die Thermal Sensors> on cpu24
> est24: <Enhanced SpeedStep Frequency Control> on cpu24
> coretemp25: <CPU On-Die Thermal Sensors> on cpu25
> est25: <Enhanced SpeedStep Frequency Control> on cpu25
> coretemp26: <CPU On-Die Thermal Sensors> on cpu26
> est26: <Enhanced SpeedStep Frequency Control> on cpu26
> coretemp27: <CPU On-Die Thermal Sensors> on cpu27
> est27: <Enhanced SpeedStep Frequency Control> on cpu27
> coretemp28: <CPU On-Die Thermal Sensors> on cpu28
> est28: <Enhanced SpeedStep Frequency Control> on cpu28
> coretemp29: <CPU On-Die Thermal Sensors> on cpu29
> est29: <Enhanced SpeedStep Frequency Control> on cpu29
> coretemp30: <CPU On-Die Thermal Sensors> on cpu30
> est30: <Enhanced SpeedStep Frequency Control> on cpu30
> coretemp31: <CPU On-Die Thermal Sensors> on cpu31
> est31: <Enhanced SpeedStep Frequency Control> on cpu31
> fuse-freebsd: version 0.4.4, FUSE ABI 7.8
> Timecounters tick every 1.000 msec
> iw_cxgb: Chelsio T3 RDMA Driver loaded
> IPsec: Initialized Security Association Processing.
> ipfw2 (+ipv6) initialized, divert loadable, nat enabled, default to accept, logging disabled
> DUMMYNET 0 with IPv6 initialized (100409)
> load_dn_sched dn_sched FIFO loaded
> load_dn_sched dn_sched PRIO loaded
> load_dn_sched dn_sched QFQ loaded
> load_dn_sched dn_sched RR loaded
> load_dn_sched dn_sched WF2Q+ loaded
> ipmi0: IPMI device rev. 1, firmware rev. 2.35, version 2.0
> ipmi0: Number of channels 3
> ipmi0: Attached watchdog
> usbus0: 480Mbps High Speed USB v2.0
> usbus1: 480Mbps High Speed USB v2.0
> ugen0.1: <Intel> at usbus0
> uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
> ugen1.1: <Intel> at usbus1
> uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
> ses0 at ahciem0 bus 0 scbus7 target 0 lun 0
> ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
> ses0: SEMB SES Device
> ada0 at ahcich0 bus 0 scbus1 target 0 lun 0
> ada0: <INTEL SSDSC2BW180A3F 400i> ACS-2 ATA SATA 3.x device
> ada0: Serial Number CVCV3102050X180EGN
> ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
> ada0: Command Queueing enabled
> ada0: 171705MB (351651888 512 byte sectors)
> ada0: quirks=0x1<4K>
> random: unblocking device.
> Sending DHCP Discover packet from interface igb0 (00:25:90:9b:73:2e)
> Sending DHCP Discover packet from interface igb1 (00:25:90:9b:73:2f)
> Sending DHCP Discover packet from interface ix0 (90:e2:ba:77:d4:9c)
> Sending DHCP Discover packet from interface ix1 (90:e2:ba:77:d4:9d)
> ix0: link state changed to UP
> ix1: link state changed to UP
> uhub1: 2 ports with 2 removable, self powered
> uhub0: 2 ports with 2 removable, self powered
> ugen1.2: <vendor 0x8087> at usbus1
> uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
> ugen0.2: <vendor 0x8087> at usbus0
> uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
> uhub3: 6 ports with 6 removable, self powered
> uhub2: 8 ports with 8 removable, self powered
> ugen0.3: <American Megatrends Inc.> at usbus0
> ukbd0: <Keyboard Interface> on usbus0
> ums0: <Mouse Interface> on usbus0
> ums0: 3 buttons and [Z] coordinates ID=0
> igb0: link state changed to UP
> Received DHCP Offer packet on igb0 from 192.168.0.2 (accepted) (no root path) (boot_file)
> Received DHCP Offer packet on igb0 from 192.168.0.2 (ignored) (no root path) (boot_file)
> Received DHCP Offer packet on igb0 from 192.168.0.2 (ignored) (no root path) (boot_file)
> Sending DHCP Request packet from interface igb0 (00:25:90:9b:73:2e)
> Received DHCP Ack packet on igb0 from 192.168.0.2 (accepted) (got root path)
> DHCP timeout for interface igb1
> DHCP timeout for interface ix0
> DHCP timeout for interface ix1
> Wired loader interface (IP 192.168.11.1) is igb0
> igb0 at 192.168.11.1 server 192.168.0.2 boot file /pxe/pxelinux.0
> subnet mask 255.255.0.0 router 192.168.0.2 rootfs 192.168.0.10:/muclab/image/machines/phobos2 hostname phobos2
> Adjusted interface igb0
> Shutdown interface igb1
> Shutdown interface ix0
> ix0: link state changed to DOWN
> Shutdown interface ix1
> ix1: link state changed to DOWN
> SMP: AP CPU #31 Launched!
> SMP: AP CPU #10 Launched!
> SMP: AP CPU #25 Launched!
> SMP: AP CPU #14 Launched!
> SMP: AP CPU #30 Launched!
> SMP: AP CPU #12 Launched!
> SMP: AP CPU #17 Launched!
> SMP: AP CPU #7 Launched!
> SMP: AP CPU #28 Launched!
> SMP: AP CPU #13 Launched!
> SMP: AP CPU #24 Launched!
> SMP: AP CPU #6 Launched!
> SMP: AP CPU #27 Launched!
> SMP: AP CPU #8 Launched!
> SMP: AP CPU #29 Launched!
> SMP: AP CPU #11 Launched!
> SMP: AP CPU #20 Launched!
> SMP: AP CPU #15 Launched!
> SMP: AP CPU #26 Launched!
> SMP: AP CPU #9 Launched!
> SMP: AP CPU #22 Launched!
> SMP: AP CPU #5 Launched!
> SMP: AP CPU #18 Launched!
> SMP: AP CPU #4 Launched!
> SMP: AP CPU #21 Launched!
> SMP: AP CPU #16 Launched!
> SMP: AP CPU #3 Launched!
> SMP: AP CPU #1 Launched!
> SMP: AP CPU #23 Launched!
> SMP: AP CPU #2 Launched!
> SMP: AP CPU #19 Launched!
> Timecounter "TSC" frequency 2000045308 Hz quality 1000
> hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/4/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
> Trying to mount root from nfs: []...
> NFS ROOT: 192.168.0.10:/muclab/image/machines/phobos2
> ixl0: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.3> mem 0xdc800000-0xdcffffff,0xdd808000-0xdd80ffff irq 32 at device 0.0 on pci3
> ixl0: Using MSIX interrupts with 33 vectors
> ixl0: f4.40 a1.4 n04.53 e80001dca
> ixl0: Using defaults for TSO: 65518/35/2048
> ixl0: Ethernet address: 68:05:ca:32:15:d0
> ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
> queues is 0xfffffe0008d03000
> ixl0: netmap queues/slots: TX 32/1024, RX 32/1024
> ixl1: <Intel(R) Ethernet Connection XL710 Driver, Version - 1.4.3> mem 0xdc000000-0xdc7fffff,0xdd800000-0xdd807fff irq 32 at device 0.1 on pci3
> ixl1: Using MSIX interrupts with 33 vectors
> ixl1: f4.40 a1.4 n04.53 e80001dca
> ixl1: Using defaults for TSO: 65518/35/2048
> ixl1: Ethernet address: 68:05:ca:32:15:d1
> ixl1: PCI Express Bus: Speed 8.0GT/s Width x8
> queues is 0xfffffe0009227000
> ixl1: netmap queues/slots: TX 32/1024, RX 32/1024
> ix0: link state changed to UP
> ix1: link state changed to UP
> ixl0: link state changed to UP
> ixl1: link state changed to UP
>
--
-----------------------------------------+-------------------------------
Prof. Luigi RIZZO, rizzo at iet.unipi.it . Dip. di Ing. dell'Informazione
http://www.iet.unipi.it/~luigi/ . Universita` di Pisa
TEL +39-050-2217533 . via Diotisalvi 2
Mobile +39-338-6809875 . 56122 PISA (Italy)
-----------------------------------------+-------------------------------
More information about the freebsd-net
mailing list