From nobody Mon Apr 18 16:44:39 2022 X-Original-To: freebsd-usb@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 83C9311D78C9 for ; Mon, 18 Apr 2022 16:44:46 +0000 (UTC) (envelope-from maheshmv@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kht7x3Sm0z3FTy for ; Mon, 18 Apr 2022 16:44:45 +0000 (UTC) (envelope-from maheshmv@juniper.net) Received: from pps.filterd (m0108162.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 23HNV5dk030438 for ; Mon, 18 Apr 2022 09:44:44 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; h=from : to : cc : subject : date : message-id : content-type : mime-version; s=PPS1017; bh=Klb+7Vmaiu4DuBLCYAAlAqH1VCiZMi3nkuK1KKxrxUs=; b=S9Z6Mzag0u0l6oFUKK1q1ZOAkrzkBTQhPGn8rEjSEzG8FulcG459/eDQuEL3D53IvElo GhmQcFK42eftlstAMk5kCEgfJNqksFN+0D/xaqG0zLNKRRZ0aDcIGFhidka2HbfeRdbo 4IFSf1gjtC3AO4axPPfKVYRbw+j6pyf9B5N3+HomEM2M9yiqJxMhmB2M6CdJfyDn3yTB QY0vS9VQEgQnajE+Toz4gG2OYfgDGUNoqlp/Bd4XSnTo21W0WcRCSdDmRZDNZI2qnlXZ EIIkUoZmwlGVROElDG5JCtczPDop/WaB2kJ0CakBni8LB4s1zeQlQ1e5zRfGfM5pkj6E sg== Received: from nam10-bn7-obe.outbound.protection.outlook.com (mail-bn7nam10lp2101.outbound.protection.outlook.com [104.47.70.101]) by mx0b-00273201.pphosted.com (PPS) with ESMTPS id 3ffv29kuw7-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 18 Apr 2022 09:44:44 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=L52EEl4DWIcSS0Tm4493TYCaPcwDcUHI/p6VHeNwVOOaGcRW3k+L/+bc7feo8GmtbLWyGccPcV2kP/G/RU96fkNqX4Z4iG7KrtJcB8JSNo/91JO1HOxDER+ZGAXuLSXmUy1HlBD7/lfMF7e9GHv11nfafxlVGyaGdntqhRiOGR8/TxZPNzHQhTyUZg5fM8mH+0yTLdHOHqRxww3HTADy3LoFijI/ISAKNHKa/T/8LTaheuAMDSWSuf/p6wVEg/Kfhz0WSzKXLiKIZpAAx+hjN7ezHCSLhC2t4yHqOXcZF5Cilb/sBM1fB4z+1/ZiXDdBULClxyHcuhMwmPcFGoB9ww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Klb+7Vmaiu4DuBLCYAAlAqH1VCiZMi3nkuK1KKxrxUs=; b=QQY0+bbMcOITjksC20I/flXROBoVH5mgR6UqQORB/3HgqUubZIbSqnIKWUVH5oWjIHmmtBYriAV6JeS91JNLrlWLsSbw29cqu88ZqypRepNYcUNLRW4EwM0nZLy7e/Kzotvm3aM9ecQc7rsqbXK9LyVPa1oUZbT5cxkB7meFH/O8Cmbzv9a095Z1OK0dn/fOqNcqyAumpxLtj3Km323vMIxMrhhUKQTz8YNo6sojoZ50FDBK8Za4+CzQv7hT6lc1cONzzp8G6SvRJy8faR2gm56bMGXKq7euV0Am8l7NzOYbcxnE57aqYBlYUBpu0kWb88u/kNZDYOjZJuI+s1srKQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=juniper.net; dmarc=pass action=none header.from=juniper.net; dkim=pass header.d=juniper.net; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=juniper.net; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Klb+7Vmaiu4DuBLCYAAlAqH1VCiZMi3nkuK1KKxrxUs=; b=exVkvA84mdHnwg2lVouEgZDpfp/338QOWLlhrwJRi+2ht7dpLnLezae5t3SLTC8SRv/HI4y+b/1zxkT1vB4AygPumkJyIR6Hp51k1FmlWN4yhR5Y2TD/raOOpPU2irP3gVynnYCcRS10bvEi1tzU/RGHroirzkCkvt7JPpnHwoI= Received: from PH0PR05MB7782.namprd05.prod.outlook.com (2603:10b6:510:2e::15) by MWHPR05MB2797.namprd05.prod.outlook.com (2603:10b6:300:60::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.12; Mon, 18 Apr 2022 16:44:39 +0000 Received: from PH0PR05MB7782.namprd05.prod.outlook.com ([fe80::dcf8:871b:8c8:d861]) by PH0PR05MB7782.namprd05.prod.outlook.com ([fe80::dcf8:871b:8c8:d861%9]) with mapi id 15.20.5186.013; Mon, 18 Apr 2022 16:44:39 +0000 From: Mahesh Vardhamanaiah To: "freebsd-usb@freebsd.org" CC: Steve Kiernan , Justin Hibbits , Kumara N Babu , Kamal Prasad Subject: xhci data toggle out of sync Thread-Topic: xhci data toggle out of sync Thread-Index: AdhTQr++8E6+F6ZGRBqXwK+xCmSdEw== Date: Mon, 18 Apr 2022 16:44:39 +0000 Message-ID: Accept-Language: en-IN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.9.0.81 dlp-reaction: no-action msip_labels: MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Enabled=true; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SetDate=2022-04-18T16:44:36Z; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Method=Standard; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_Name=0633b888-ae0d-4341-a75f-06e04137d755; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_SiteId=bea78b3c-4cdb-4130-854a-1d193232e5f4; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ActionId=bf01b001-5708-49c9-86d5-61d52d71a802; MSIP_Label_0633b888-ae0d-4341-a75f-06e04137d755_ContentBits=2 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 3410d078-3636-4a7a-72c3-08da215abb0f x-ms-traffictypediagnostic: MWHPR05MB2797:EE_ x-ms-exchange-atpmessageproperties: SA|SL x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: IH0Cbjqz1jx0ZuDh0HgeM4TmLGJGfYNGzLiTh/BbH9a7ihGXh/VQEAMIpahSqPgAF8EExk8fVjHcoS4krHkTnWNwtnKeqFQrkC4lU7SxOmPvL9tdoWu23SbBN87JGTnTCkD3PcKonfpPkK9qtG5W1yfQbxReg2E4vwT+jveIDvI2gZR96WjVVfXOug4fWbW1nKqVVXN9YtdH5anjxlUyfQnC4IBPjmya/UEOKA4FD0YdITW6Vw7vwAhDPq7iOhJy4UJwLH/46cS6hxmdcSN2VC9ck/AZGT9UgRCFTFftWlqf9mKZhZAML5xg666YEXG5IVAp+qMaKhJUJzxqKxxSXP5dRjB3dnlkrgB9dQN3AZfM3hmH3ai8hQeGOhlRWC7VFY/qA7uE3ATJ055ooHn77hVvbWohDhIAAAwjENRJKHCZYZkTpWJuSsuLcZTV3vMZT6Sm24zibULQTUgxareiyVqhITibv/M4TYzWzN0omCrDoQGwPlT4r4NtDTx6VciCLahumAfW/AjEY2cZJUzzwIVVPkMSF/EI8ycBJAldlC8Ig8gV8MaLHFnY0eW4QGYF13ykNVJIoGYHKPBLPEQW8lqgMqYIQABCyv0UqzoNJtVgTpcTJec44xaXUt7Fcd+HxMHI68Hd8Gj5e+J9GzK1ay27y5DJ7KJ5L2JE36kE0wZkrSTJBYxWWukn5BUardzFxXH5uOZw1+M/0Bl0XTyb8VCfVVqlf/6eGP4cyG5mcNI= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH0PR05MB7782.namprd05.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(84040400005)(83380400001)(33656002)(107886003)(26005)(38100700002)(66556008)(6916009)(38070700005)(54906003)(76116006)(4326008)(66446008)(66946007)(8676002)(64756008)(508600001)(66476007)(316002)(2906002)(8936002)(52536014)(55016003)(5660300002)(6506007)(122000001)(9686003)(71200400001)(186003)(86362001)(7696005)(205293001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?vLs2CgMCgNIIUnCWw1EKYUkBcjEuVIa6F8IFiGJgsCR+8Ec53wXr9ixU7G0b?= =?us-ascii?Q?gm/ffMCKxVhjSNMa767aVNpN0Twms54WhZK0dm14QHqF0tbYHRPjGyRChsY1?= =?us-ascii?Q?x+CcTNw0W1l7nHtMDt3pabmnYUywJn3pgO+5cBQ5KgorfyW0Nz7W3pzbuHd9?= =?us-ascii?Q?PHEf2bWbjxiSG7dNDZ4wadp0yUOtnzDKktqGIGXwyeepXHypdsvn8KfFZPe2?= =?us-ascii?Q?xOJBLyaqjo6chxpRucby6hK3LMuLyGjGz1D10GwUGLIWYsqOqPi6lyd3rlCe?= =?us-ascii?Q?/z81FMEdPl+aKqqTMoLVXmCjos9HKt4i1UKk6NRcLrjUHU1mG3mPOMhBmb7c?= =?us-ascii?Q?VUtAq6GwWi8Wo732KX3eUlIXCO2F/8+uKvjosBrLyEOXAOBiFHmow8f0p/7G?= =?us-ascii?Q?JytZ0kwNhewwUdvke6k3g5c+veX8XeOvycZWSrqFZwc+w6ToeOJdm1uXrrg9?= =?us-ascii?Q?B9xlQkopDcdWw5C2nuyT7xv4qw7Vx2VP9jqo0HjhI9YSna0oDI3LiCAMWPeI?= =?us-ascii?Q?K9dZHTbQjjZ9alwIu1LrU3QOfj8+hCuCKprC7Au3LowHX8g+f6wm8QSCjrvg?= =?us-ascii?Q?wuKM37Yxuie4Va7VIsqzsikJJ4q/ltVcAn7cw+IB1Ks9suzFekRARs2fUqKx?= =?us-ascii?Q?s1jrwdWeetQd27Wdl3vvZNi/uU7pdOejI2j0YCLIa4DzFx5wCEnHuOHfinQa?= =?us-ascii?Q?d1ghe6gF4sb679SmKmRaAYDdaKsCfwpOeB/wLXxo/37wiX8IQW9tshwlpZeA?= =?us-ascii?Q?YV8ZQGVyFD+AqW4vMp1+rRyqlH7MHX8YnYBTERFeQC+bKdyXNX6UjkpdBElS?= =?us-ascii?Q?h7BipXM5QAZ2tgm/o0MnCkvd0ztppkMlF8XgBz3cz+cWPqwBfX78mPfbkTAe?= =?us-ascii?Q?CNyZlciV3icfBjnkmtooCWij4uuzvx8j1DlYVKtPMA/sD1iMVFGfUJahrv+N?= =?us-ascii?Q?tCo84CDMWv3vxPXHYKmDP7r+P7lkoyDDrFSZhlajfng2hdiubr+cCPaWhdVM?= =?us-ascii?Q?v0h4z95u4lJx29zrrFf1vce7iJpaXz91nfYBxxi4jQlBOHtnvKxgKOftqHpj?= =?us-ascii?Q?Mzmab/wlOiaT8PnLyzVGd40laKeqY+OOLJ8hAU7mbxwKLt8f1tQ6H6MVFJK/?= =?us-ascii?Q?6+H6p7Bt8JMbbqRGvktjdRJPfXrQwzaBzL94V36Y5rqrmT3qxvBvYzqz8U9q?= =?us-ascii?Q?o1eYmWWFHbUsmxAefN2G8IyOFsUTKdIpHZf5PAUiq4Ue9DHeZCSUpxXsoRT0?= =?us-ascii?Q?0GKafxvkgWePUKVi/rjViQBAytflBfAdIqiS48+nvb6DrJcrq6DLhBy+pZ1r?= =?us-ascii?Q?VS7WyQIzW6uI/4MAEj5Oaq+ze2ZHWxJxGlA9147fqZWQeMEpt/dl5DkkT0u6?= =?us-ascii?Q?fGaMm32DF0bNds1YOhgrLT5HSW/gw6dKdCNrKdzrUgycVzf25/x4eNPHNe+B?= =?us-ascii?Q?vDn/xk3hTayY87UDLg/fZl4Xr3gPhyAg3BkMU+3gxuPrL+qyJj3I+Ka2KlOj?= =?us-ascii?Q?UjPI1Lx7MVpNrsJVwP3jWOcI8BnJFSf5jaaOBSWSOsdaBk3GNDhEdwCkScKN?= =?us-ascii?Q?5YtQeKoEJYtEwQaf483019kcO4GCsMW0xE01cMpfn/+HPeFungSObIcZhEN9?= =?us-ascii?Q?6H+11TJUmtO6i7MsjD7y4QMQIB+B9DOrWK5cACmrB4miNFssWFQXaAcd4Dqm?= =?us-ascii?Q?Y7MyFKr3aE9IzKPFqlJY7TjEsZ7cz0x93ood91hvteBWMMtMtTozjimssIAI?= =?us-ascii?Q?2Ja54CuhFQ=3D=3D?= Content-Type: multipart/alternative; boundary="_000_PH0PR05MB778212B54B636F87C246F62AD5F39PH0PR05MB7782namp_" List-Id: FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-usb List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-usb@freebsd.org X-BeenThere: freebsd-usb@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH0PR05MB7782.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3410d078-3636-4a7a-72c3-08da215abb0f X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Apr 2022 16:44:39.5147 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: NV4PpZnnyp8wX1T3AAOHlg994ThJjn1suslhQ7WESTpL+BNA1M0DEPJc+ynWfs7g9lR1YRRCGGGQ9I7JU4bL1A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR05MB2797 X-Proofpoint-GUID: NuSQP-Y9fqMNsFY-s6kLA_rR2B3xHbcm X-Proofpoint-ORIG-GUID: NuSQP-Y9fqMNsFY-s6kLA_rR2B3xHbcm X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.858,Hydra:6.0.486,FMLib:17.11.64.514 definitions=2022-04-18_02,2022-04-15_01,2022-02-23_01 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 clxscore=1011 spamscore=0 impostorscore=0 mlxscore=0 malwarescore=0 suspectscore=0 priorityscore=1501 mlxlogscore=736 adultscore=0 lowpriorityscore=0 bulkscore=0 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2202240000 definitions=main-2204180098 X-Rspamd-Queue-Id: 4Kht7x3Sm0z3FTy X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=juniper.net header.s=PPS1017 header.b=S9Z6Mzag; dkim=pass header.d=juniper.net header.s=selector1 header.b=exVkvA84; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=reject) header.from=juniper.net; spf=pass (mx1.freebsd.org: domain of maheshmv@juniper.net designates 67.231.152.164 as permitted sender) smtp.mailfrom=maheshmv@juniper.net X-Spamd-Result: default: False [-4.83 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.979]; RCVD_COUNT_FIVE(0.00)[5]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-usb@freebsd.org]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; RCVD_IN_DNSWL_NONE(0.00)[67.231.152.164:from,104.47.70.101:received]; NEURAL_HAM_SHORT(-0.85)[-0.854]; MLMMJ_DEST(0.00)[freebsd-usb]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1] X-ThisMailContainsUnwantedMimeParts: N --_000_PH0PR05MB778212B54B636F87C246F62AD5F39PH0PR05MB7782namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi all, Need your help regarding an urgent issue where we are observing an issue w= ith Freebsd stable/12. The data toggles for BOT endpoint (DATA0/DATA1) are out of sync with respect to EP and the system experien= ces the READ(10) errors. The READ(10) error recovers within couple of retries most of the times but few cases we have observed that th= e read retries gets exhausted and system moves to unusable state (continuous g_vfs_done() errors) . We are using Junos but the xhci driver= etc.. are all pristine stable 12 drivers no Juniper specific changes. This issue was never observed with Linux kernel 5.4.2 on the same HW suspec= ting if it's a xhci driver error recovery issue. Errors Seen on console (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 00 28 cf 28 00 00 40 00 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 00 28 cf 28 00 00 40 00 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain FreeBSD/arm (Amnesiac) (ttyu0) login: Please let us know is there a place holder to upload the traces and provide= a link here ? Thanks, Mahesh Juniper Business Use Only --_000_PH0PR05MB778212B54B636F87C246F62AD5F39PH0PR05MB7782namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi all,

 

 Need your help regarding an urgent issue where we are observing an is= sue with Freebsd stable/12. The data toggles for BOT endpoint

 (DATA0/DATA1) are out of sync with = respect to EP and  the  system experiences the  READ(10) err= ors. The READ(10) error recovers within

 couple of retries most of the times= but few cases we have observed that the read retries gets exhausted  = and  system moves to unusable state

(continuous g_vfs_done() errors) . We are= using Junos but  the  xhci driver etc.. are all pristine stable = 12 drivers no Juniper specific  changes.

This issue was never observed with Linux = kernel 5.4.2 on the same HW suspecting if it’s a xhci driver error re= covery issue.


 Errors Seen on console

 (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 00 28 cf 28 00 00 40 00<= br>
 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an err= or

 (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain

 (da0:umass-sim0:0:0:0): READ(10). CDB: 28 00 00 28 cf 28 00 00 40 00<= br>
 (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an err= or

 (da0:umass-sim0:0:0:0): Retrying command, 2 more tries remain

 FreeBSD/arm (Amnesiac) (ttyu0)

 login:

 

Please let us know is there a place holde= r to upload the traces and provide a link here ?

Thanks,

Mahesh


Juniper Business= Use Only

--_000_PH0PR05MB778212B54B636F87C246F62AD5F39PH0PR05MB7782namp_--