Re: git: 6259f7882a8d - main - textproc/py-tokenizer: Add new port

From: Ruslan Makhmatkhanov <rm_at_FreeBSD.org>
Date: Wed, 27 Aug 2025 14:19:03 UTC
Juraj Lutter wrote on 8/27/25 2:14 PM:
> The branch main has been updated by otis:
> 
> URL: https://cgit.FreeBSD.org/ports/commit/?id=6259f7882a8dc19deaf79bbbb7d28c2fce54aa34
> 
> commit 6259f7882a8dc19deaf79bbbb7d28c2fce54aa34
> Author:     Juraj Lutter <otis@FreeBSD.org>
> AuthorDate: 2025-08-27 11:13:40 +0000
> Commit:     Juraj Lutter <otis@FreeBSD.org>
> CommitDate: 2025-08-27 11:13:40 +0000
> 
>      textproc/py-tokenizer: Add new port
>      
>      Add textproc/py-tokenizer, a tokenizer for Icelandic text.
> ---

[...]

> +++ b/textproc/py-tokenizer/Makefile
> @@ -0,0 +1,21 @@
> +PORTNAME=	tokenizer
> +PORTVERSION=	3.5.0
> +CATEGORIES=	textproc python
> +MASTER_SITES=	PYPI
> +PKGNAMEPREFIX=	${PYTHON_PKGNAMEPREFIX}
> +
> +MAINTAINER=	otis@FreeBSD.org
> +COMMENT=	Tokenizer for Icelandic text
> +WWW=		https://github.com/mideind/Tokenizer

[...]

> diff --git a/textproc/py-tokenizer/pkg-descr b/textproc/py-tokenizer/pkg-descr
> new file mode 100644
> index 000000000000..665fa0186f94
> --- /dev/null
> +++ b/textproc/py-tokenizer/pkg-descr
> @@ -0,0 +1,11 @@
> +This python utility package helps to create lazy modules. A lazy module defers
> +loading (some of) its attributes until these attributes are first accessed. The
> +module's lazy attributes in turn are attributes of other modules. These other
> +modules will be imported/loaded only when (and if) associated attributes are
> +used. A lazy import strategy can drastically reduce runtime and memory
> +consumption.
> +
> +Additionally, this package provides a utility for optional imports with which
> +one can import a module globally while triggering associated import errors only
> +at use-sites (when and if a dependency is actually required, for example in the
> +context of a specific functionality).
> 

This description doesn't seems belong to tokenizer package.

-- 
Regards,
Ruslan

T.O.S. Of Reality