[Bug 230465] ixl: not working in netmap mode
bugzilla-noreply at freebsd.org
bugzilla-noreply at freebsd.org
Tue Jan 29 11:25:26 UTC 2019
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=230465
--- Comment #20 from Charles Goncalves <halfling at halfling.com.br> ---
(In reply to Vincenzo Maffione from comment #19)
Oh yes now I remember it's about 5 months. I had set this to max_queues = 1 (in
/boot/loader.conf) to test with pkt-gen, because with max_queues = 8 doens't
work.
Output of pkt-gen with hw.ixl.max_queues=1:
# pkt-gen -i ixl0 -f tx
945.763330 main [2593] interface is ixl0
945.763376 main [2727] running on 1 cpus (have 8)
945.763602 extract_ip_range [468] range is 10.0.0.1:1234 to 10.0.0.1:1234
945.763619 extract_ip_range [468] range is 10.1.0.1:1234 to 10.1.0.1:1234
945.907652 main [2822] mapped 294020KB at 0x801600000
Sending on netmap:ixl0: 1 queues, 1 threads and 1 cpus.
10.0.0.1 -> 10.1.0.1 (00:00:00:00:00:00 -> ff:ff:ff:ff:ff:ff)
945.907746 main [2919] Sending 512 packets every 0.000000000 s
945.907791 start_threads [2274] Wait 2 secs for phy reset
947.974562 start_threads [2276] Ready...
947.974737 sender_body [1464] start, fd 3 main_fd 3
947.989037 sender_body [1546] drop copy
949.001809 main_thread [2364] 4.285 Mpps (4.401 Mpkts 2.112 Gbps in 1027068
usec) 343.53 avg_batch 0 min_space
950.016811 main_thread [2364] 4.265 Mpps (4.329 Mpkts 2.078 Gbps in 1015002
usec) 341.05 avg_batch 99999 min_space
951.053574 main_thread [2364] 4.212 Mpps (4.367 Mpkts 2.096 Gbps in 1036763
usec) 341.39 avg_batch 99999 min_space
952.054597 main_thread [2364] 4.262 Mpps (4.266 Mpkts 2.048 Gbps in 1001023
usec) 341.66 avg_batch 99999 min_space
Now with hw.ixl.max_queues=8:
# pkt-gen -i ixl0 -f tx
734.500918 main [2593] interface is ixl0
734.500963 main [2727] running on 1 cpus (have 8)
734.501188 extract_ip_range [468] range is 10.0.0.1:1234 to 10.0.0.1:1234
734.501205 extract_ip_range [468] range is 10.1.0.1:1234 to 10.1.0.1:1234
734.651421 main [2822] mapped 294020KB at 0x801600000
Sending on netmap:ixl0: 8 queues, 1 threads and 1 cpus.
10.0.0.1 -> 10.1.0.1 (00:00:00:00:00:00 -> ff:ff:ff:ff:ff:ff)
734.651514 main [2919] Sending 512 packets every 0.000000000 s
734.651558 start_threads [2274] Wait 2 secs for phy reset
736.666615 start_threads [2276] Ready...
736.666799 sender_body [1464] start, fd 3 main_fd 3
737.506822 sender_body [1538] poll error on 3 ring 0-7
737.677616 main_thread [2364] 8.103 Kpps (8.191 Kpkts 3.932 Mbps in 1010813
usec) 511.94 avg_batch 0 min_space
737.856747 main_thread [2391] ouch, thread 0 exited with error
Sent 8191 packets 491460 bytes 16 events 60 bytes each in -1548760736.67
seconds.
Speed: -0.000 pps Bandwidth: -0.003 bps (raw -0.004 bps). Average batch: 511.94
pkts
Then with max_queues=8 I have errors in my /var/log/messages:
Jan 29 09:21:29 rt1 kernel: 888.923727 [1637] nm_txsync_prologue ixl0
TX1: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
kring->nr_hwtail >= n' h 0 c 0 t -1678351873 rh 512 rc 512 rt -1678351873 hc
512 ht -1678351873
Jan 29 09:21:29 rt1 kernel: 888.981468 [1758] netmap_ring_reinit called
for ixl0 TX1
Jan 29 09:21:29 rt1 kernel: 888.998372 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.013966 [1787] netmap_ring_reinit ixl0
TX1 reinit, cur 0 -> 512 tail -1678351873 -> -1678351873
Jan 29 09:21:29 rt1 kernel: 889.041778 [1637] nm_txsync_prologue ixl0
TX2: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
kring->nr_hwtail >= n' h 0 c 0 t -1676512769 rh 512 rc 512 rt -1676512769 hc
512 ht -1676512769
Jan 29 09:21:29 rt1 kernel: 889.099769 [1758] netmap_ring_reinit called
for ixl0 TX2
Jan 29 09:21:29 rt1 kernel: 889.116664 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.132258 [1787] netmap_ring_reinit ixl0
TX2 reinit, cur 0 -> 512 tail -1676512769 -> -1676512769
Jan 29 09:21:29 rt1 kernel: 889.160084 [1637] nm_txsync_prologue ixl0
TX3: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
kring->nr_hwtail >= n' h 0 c 0 t -1674673665 rh 512 rc 512 rt -1674673665 hc
512 ht -1674673665
Jan 29 09:21:29 rt1 kernel: 889.218053 [1758] netmap_ring_reinit called
for ixl0 TX3
Jan 29 09:21:29 rt1 kernel: 889.234957 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.250560 [1787] netmap_ring_reinit ixl0
TX3 reinit, cur 0 -> 512 tail -1674673665 -> -1674673665
Jan 29 09:21:29 rt1 kernel: 889.278372 [1637] nm_txsync_prologue ixl0
TX4: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
kring->nr_hwtail >= n' h 0 c 0 t -1672834561 rh 512 rc 512 rt -1672834561 hc
512 ht -1672834561
Jan 29 09:21:29 rt1 kernel: 889.336348 [1758] netmap_ring_reinit called
for ixl0 TX4
Jan 29 09:21:29 rt1 kernel: 889.353258 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.368847 [1787] netmap_ring_reinit ixl0
TX4 reinit, cur 0 -> 512 tail -1672834561 -> -1672834561
Jan 29 09:21:29 rt1 kernel: 889.396679 [1637] nm_txsync_prologue ixl0
TX5: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
kring->nr_hwtail >= n' h 0 c 0 t -1670995457 rh 512 rc 512 rt -1670995457 hc
512 ht -1670995457
Jan 29 09:21:29 rt1 kernel: 889.454648 [1758] netmap_ring_reinit called
for ixl0 TX5
Jan 29 09:21:29 rt1 kernel: 889.471553 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.487148 [1787] netmap_ring_reinit ixl0
TX5 reinit, cur 0 -> 512 tail -1670995457 -> -1670995457
Jan 29 09:21:29 rt1 kernel: 889.514967 [1637] nm_txsync_prologue ixl0
TX6: fail 'kring->nr_hwcur >= n || kring->rhead >= n || kring->rtail >= n ||
Jan 29 09:21:29 rt1 kernel: kring->nr_hwtail >= n' h 0 c 0 t -1669156353 rh 512
rc 512 rt -1669156353 hc 512 ht -1669156353
Jan 29 09:21:29 rt1 kernel: 889.572947 [1758] netmap_ring_reinit called
for ixl0 TX6
Jan 29 09:21:29 rt1 kernel: 889.589850 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.605444 [1787] netmap_ring_reinit ixl0
TX6 reinit, cur 0 -> 512 tail -1669156353 -> -1669156353
Jan 29 09:21:29 rt1 kernel: 889.633261 [1758] netmap_ring_reinit called
for ixl0 TX7
Jan 29 09:21:29 rt1 kernel: 889.650170 [1783] netmap_ring_reinit total 1
errors
Jan 29 09:21:29 rt1 kernel: 889.665760 [1787] netmap_ring_reinit ixl0
TX7 reinit, cur 0 -> 512 tail -1667321345 -> -1667321345
I also test this in my netmap application and with these tests I think that
when a application try to write in txring > 0 like TX1, TX2 or so this error
occurs
--
You are receiving this mail because:
You are on the CC list for the bug.
More information about the freebsd-net
mailing list