From nobody Tue Jun 07 18:33:22 2022 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EADF9835B6A for ; Tue, 7 Jun 2022 18:33:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHfBC5bnbz3KTp for ; Tue, 7 Jun 2022 18:33:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id A16862013D for ; Tue, 7 Jun 2022 18:33:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 257IXNTe045035 for ; Tue, 7 Jun 2022 18:33:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 257IXNVK045034 for bugs@FreeBSD.org; Tue, 7 Jun 2022 18:33:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 241679] /usr/bin/sort fails if UTF-8 input is received from stdin Date: Tue, 07 Jun 2022 18:33:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andreas.baumgaertner@tisco.at X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Unable to Reproduce X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1654626803; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/wQ6VCSb0xSbL0m2McyIdGwuVjEZEs8JbwBV0kJntpo=; b=hzFANjsZGjUZl3DdyKx098ncqiDiBVfx3cUfRev+khd7U9DgPacC16OmZgOr1XUY42axPZ z1YxBxfIFXpyiEhphEsYJNqvzxGGJPTQOqXy3f0/iEGxQDWMbugXsfeehzTDdzL2PSTtzy D7GUzO2w7BYo7L/dTm8tsT8bmb3qdf2GWtR/t2UhidlXIALlurdvZRyACdul9TtIdk+xYp lUJE47vGbYa7VZoM0j1gJrWNvJLrBvHcYNmDIgsV3wod4WuOcEeDG5wPSxiuTF8WaezjRd aPtt8jlOptnVl0bWIwzsnVk1iU84/XjwrlMzvWFg580wxIssHqZMEvu8aRPA5g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1654626803; a=rsa-sha256; cv=none; b=nTNLg3WYEQoXcbbqZuWW5iIW0UFIiKhUnUm85P5UgR7QhqO+pPLBcTKFH2R2GeaohQpgBf mSEP2nv1hzWc9oITvsZ00aON/QmyqcOSNe3Vz8OtIgug00d5r9iivcEM9fLet720/tu0cW b8lZqhEsmSBypLonebYrtkua7nSWN/IlMuOU9yTdqQ1jwvMIjPXf3hHFbgXRdyLHeOojyT deOg58ZwGzevp0bWRR+IcwNznh9sYpvyzsT9VzpaPtfIgekad+nDAfMFIfT3WXBrWwZMmN rpbaPAyplTkwZpwCxQaGLqZLTaejli7UYCtF0VFh6BxAIOmqMf/T1ryBQsLVUg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241679 Andreas Baumg=C3=A4rtner changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |andreas.baumgaertner@tisco. | |at --- Comment #5 from Andreas Baumg=C3=A4rtner --- Here is how to reproduce the issue: FreeBSD 12.3-RELEASE-p2 FreeBSD 12.3-RELEASE-p5 host: /tmp# echo $LANG en_US.UTF-8 host: /tmp# cat a | sort sort: Illegal byte sequence host: /tmp# cut -d" " -f 1 a cut: a: Illegal byte sequence host: /tmp# sort a gel=C3=B6scht host: /tmp# sort a > b host: /tmp# diff a b 1c1 < gel=E2=96=92scht --- > gel=C3=B6scht host: /tmp# file a b a: ISO-8859 text b: UTF-8 Unicode text host: /tmp# hexdump -c a 0000000 g e l =E2=96=92 s c h t \n 0000009 host: /tmp# hexdump -c b 0000000 g e l =E2=96=92 =E2=96=92 s c h t \n 000000a host: /tmp# hexdump -x a 0000000 6567 f66c 6373 7468 000a 0000009 host: /tmp# hexdump -x b 0000000 6567 c36c 73b6 6863 0a74 000000a host: /tmp# ls -l a b -rw-r--r-- 1 root wheel 9 Jun 7 20:11 a -rw-r--r-- 1 root wheel 10 Jun 7 20:20 b host: /tmp#=20 my initial issue was with a directory (here in reverse to reproduce) host: /tmp# mkdir `cat a` host: /tmp# find . -type d | sort sort: Illegal byte sequence host: /tmp# rmdir gel\366scht/ host: /tmp#=20 I'm unable to re-open the bug from here. --=20 You are receiving this mail because: You are the assignee for the bug.=