"PHY read timeout" with bce2 & 3 on FreeBSD 8.0

[Charles Owens]

Pyun YongHyeon wrote:
> On Mon, Jan 18, 2010 at 10:40:55AM -0500, Charles Owens wrote:
>> Hello,
>>
>> I'm working with a system (IBM System x3550 M2) that has four onboard
>> bce(4) NICs.  Using FreeBSD 8.0, the first two seem to function fine,
>> but the second two do not, yielding messages like this when a cable is
>> inserted:
>>
>> Jan 12 10:37:19 dmz55 kernel: <2<>N2M>NINM IM INISMI AI S AIIS SAA
>> 22cc2,,c ,  E2EIcIES,SIAS  AA
>> E  I00
>> Jan 12 10:37:19 dmz55 kernel:
>> Jan 12 10:37:19 dmz55 kernel: S0
>> Jan 12 10:37:19 dmz55 kernel:
>> Jan 12 10:37:19 dmz55 kernel: <<22>>A
>> Jan 12 10:37:19 dmz55 kernel:
>> Jan 12 10:37:19 dmz55 kernel: 0
>> Jan 12 10:37:28 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
>> Error: PHY read timeout!
>>  phy = 1, reg = 0x0001
>>
>>
>> What's are the best next steps to take in figuring this out?  Thanks in
>> advance for any assistance.  Kernel boot log appending below.
>>
> 
> Are you using ASF/IMPI/UMP on bce2 or bce3?
> If so would you try attached patch? Publicly available datasheet
> lacks details on management firmware handling so I'm not sure what
> is really happening here.
> davidch may shed light on this(CCed).


Ok, I've got the patch in place plus the PRINTF buffer option that David
suggested.  More observations:

* bce2 and 3 now seem usable.  Could this be the patch?  Or maybe I just
 was moving too fast before.
* Trouble (similar error messages then eventually reboot) begins only
when I plug into the IMM management port.  Why is this related to the
bce ports?

Below are the error logs.  Note that I've got now got bce2 configured as
the active NIC on local LAN.  You can see here that I unplug bce2.  What
you don't see is that I plug cable into the IMM port, wait 10 seconds or
so, then move the cable back to bce2.  Within a second or two the error
messages start flowing... and finally the system reboots about a minute
later.


Jan 20 06:50:02 dmz55 kernel: bce2: link state changed to DOWN
Jan 20 06:50:23 dmz55 kernel: NMI ISNAM I ISNAM 2IcN ,I2M cSE,AI
IISESA2AIcS,  AE I00S
Jan 20 06:50:23 dmz55 kernel:
Jan 20 06:50:23 dmz55 kernel: A
Jan 20 06:50:23 dmz55 kernel: 2c0,
Jan 20 06:50:23 dmz55 kernel: E
Jan 20 06:50:23 dmz55 kernel: ISA 0
Jan 20 06:50:23 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error: PHY read timeout! phy = 1, reg = 0x0001
Jan 20 06:50:23 dmz55 last message repeated 3 times
Jan 20 06:50:23 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error: PHY read timeout! phy = 1, reg = 0x0000
Jan 20 06:50:23 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error:
PHY read timeout! phy = 1, reg = 0x0004
Jan 20 06:50:23 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error:
PHY read timeout! phy = 1, reg = 0x0005
Jan 20 06:50:23 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error:
PHY read timeout! phy = 1, reg = 0x0019
Jan 20 06:50:24 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1533):
Error:
PHY read timeout! phy = 1, reg = 0x0001
Jan 20 06:50:24 dmz55 last message repeated 3 times

... etc., with eventually some of these showing up as well:

Jan 20 06:50:37 dmz55 kernel: bce2: /usr/src/sys/dev/bce/if_bce.c(1608):
PHY write timeout!



Thanks,
Charles