From nobody Fri Mar 20 20:50:14 2026 X-Original-To: ports-bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4fcvpJ26cDz6W37G for ; Fri, 20 Mar 2026 20:50:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4fcvpH1M38z3t75 for ; Fri, 20 Mar 2026 20:50:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1774039816; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=t4ibfUHRgIXDzngfE8f0DYcAisScDlPO4oK5rTekhls=; b=NW57fqSFkHaS7nYzdoIb4e/M5pKkUOJvHDwxNBcx8tGMgM/hmBizp+JvOOyFdtm6BvAP3i J5JxWGFyzLcZ6+kpO9XNa40Ndvh1uYLCytGkcYc4lTXJKWq6yrJSP+3sBHcGHF3cHaa7bA m1n9JDCOaobJIuPVKkNWApr3TT1R1AGG2V9lqJrR69vAEuQB+k167MidI9FqBH9dZTHb3W NGPzT0b6EtBFibR3LfkFzTzubQx7+uwN4rYzgPwr6gmIeJeZl5FLWxsmFfJYex9K81nLKa Ub4MhA2Z+2zQrcK1sUtmCqi40aIYdDOtRU9vY61STsnk9E/dDmf+lV+1gOmo4Q== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1774039815; a=rsa-sha256; cv=none; b=Li/IEbQ96yMz33YLOaSDOc9urz2bRintdPyBvkOjgIF1cqWpKFOoAnBhDSJ6jYVyHO4Vg8 PnXuKHOFI2aqIwWly8OtAwsmCOVKednWFsQXuKK5YCOnlrDGEdyACeleaZgTH1ol9vZsow yRJARpZCP9GNTmztDkbxL2GWLrpZjFZ7JvPaAcvPCVjeCpNQLJsOmDNkWoX2Lq7kExRSy9 PKdGtS2E4L31BFy147ddVDZEpZrEjp4k+zdNFBR6FGm2ht4KYrPZmDQ6RhCw4GklJEdxda wV1yWcE938Xxyv7podzJHP74CWZYBcBZVCYsdbC7gAmdRLxO5RqzYNjEgsEzcQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1774039815; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=t4ibfUHRgIXDzngfE8f0DYcAisScDlPO4oK5rTekhls=; b=ufNx5Hke74fIw2Vt3KxinVwypcADkTNjZnJdab7ccj+jq0eMaIkoMRErdBIJ8aBGNUUcNU Q64QAFZQm4vVzc9KncRpzGJnZdkkS02Md3xmcNuYe8t0N1yyqaML4Z3tw55Nyr8P4whY0p CajSB9ByVZK5KqUhDQTfUpXwu6yj8HndwcAZwZfdl3x93W+0ljZDYN6NTdAjBTNW0YipjN fX+nXe0wuJANPfNOC1+vdB1ynCy5vfjb+M5Kr1Ydj0JIUuH4Zr4peAHaCi3Kd8kgQFvoO7 L8Lqx0XTwBpw/w9mCnijyn8B7Yo4dheymbVxBzroGkX5ODNrSsXW7GlxzXNVag== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4fcvpH0s2pzhsl for ; Fri, 20 Mar 2026 20:50:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 62KKoFtO063154 for ; Fri, 20 Mar 2026 20:50:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 62KKoEKe063153 for ports-bugs@FreeBSD.org; Fri, 20 Mar 2026 20:50:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: ports-bugs@FreeBSD.org Subject: [Bug 293943] textproc/sonic: Make tokenizer features optional via OPTIONS, adopt port Date: Fri, 20 Mar 2026 20:50:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: wadegimpbc@tuta.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ports-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc attachments.created Message-ID: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Ports bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-ports-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-ports-bugs@freebsd.org Sender: owner-freebsd-ports-bugs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D293943 Bug ID: 293943 Summary: textproc/sonic: Make tokenizer features optional via OPTIONS, adopt port Product: Ports & Packages Version: Latest Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: Individual Port(s) Assignee: ports-bugs@FreeBSD.org Reporter: wadegimpbc@tuta.com CC: fuz@FreeBSD.org Created attachment 268960 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D268960&action= =3Dedit Patch to add tokenizer OPTIONS and adopt port This patch makes the Japanese and Chinese word segmentation features option= al via FreeBSD OPTIONS helpers, and adopts the port. Currently the port unconditionally downloads a ~100MB UniDic Japanese dictionary (unidic-mecab-2.1.2_src.zip) for every build, regardless of whet= her the user needs Japanese tokenization. Upstream removed tokenizer-japanese f= rom default cargo features in v1.4.2 because it 10x'd the final binary size. Th= is patch brings the port in line with upstream's intent. Changes: MAINTAINER changed to wadegimpbc@tuta.com Added CHINESE and JAPANESE OPTIONS using OPTIONS helpers OPTIONS_DEFAULT includes CHINESE (matching upstream's default features) UniDic download now conditional on JAPANESE option CARGO_FEATURES uses --no-default-features with allocator-jemalloc as base, = per cargo.mk convention (lines 23-26, 192, 197-200) Upstream Cargo.toml default features: ["allocator-jemalloc", "tokenizer-chinese"] Note: I do not have a FreeBSD build environment to test this patch. Review = and build testing by a committer would be appreciated. Patch attached. --=20 You are receiving this mail because: You are the assignee for the bug.=