From nobody Sun Oct 09 22:38:06 2022 X-Original-To: dev-commits-ports-main@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MlxlM18Kpz4djL4; Sun, 9 Oct 2022 22:38:07 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MlxlL5Xbxz3vff; Sun, 9 Oct 2022 22:38:06 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665355086; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ihpzwK+/HqZz9UcY1vGXRkshv7h8VUdWgSu1yw5D6Vk=; b=AKkb8UydLFnq0MOZvDXl9217hfbl3mrIDxb6REMTZUwCN7OHLz9j811MyjYnBs9Sy8dTOP sK4o6DxhPGStKNmxOXz/0vmhn/sLoK4EW3STE1EJ/kh06Qd1PKUtPI202c2gl6qTe+pGQv puJbjU+Q+fzHXlPrIDDKuTqSpzJYoQ4554q3NjZ1IyTtO9Hs90c4Tm344j75ufJamBx0ku DZzBVo5o+6l3bpHyYFMtPKfRn33uCMxW1eLxewUWxJhy5epn3ZBRYlhpxLPoL8dWfddI5c 7JL+GjnW2g7mUHf5XJrdm+LxkNzRXyK2dvGQDZoS5E8FuHaj5GSuv9q3ExG8gA== Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4MlxlL4fQczQYd; Sun, 9 Oct 2022 22:38:06 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from gitrepo.freebsd.org ([127.0.1.44]) by gitrepo.freebsd.org (8.16.1/8.16.1) with ESMTP id 299Mc605074111; Sun, 9 Oct 2022 22:38:06 GMT (envelope-from git@gitrepo.freebsd.org) Received: (from git@localhost) by gitrepo.freebsd.org (8.16.1/8.16.1/Submit) id 299Mc6R8074110; Sun, 9 Oct 2022 22:38:06 GMT (envelope-from git) Date: Sun, 9 Oct 2022 22:38:06 GMT Message-Id: <202210092238.299Mc6R8074110@gitrepo.freebsd.org> To: ports-committers@FreeBSD.org, dev-commits-ports-all@FreeBSD.org, dev-commits-ports-main@FreeBSD.org From: Yuri Victorovich Subject: git: d3903fc482a1 - main - misc/py-apache-beam: New port: Apache Beam SDK for Python List-Id: Commits to the main branch of the FreeBSD ports repository List-Archive: https://lists.freebsd.org/archives/dev-commits-ports-main List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-ports-main@freebsd.org X-BeenThere: dev-commits-ports-main@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: yuri X-Git-Repository: ports X-Git-Refname: refs/heads/main X-Git-Reftype: branch X-Git-Commit: d3903fc482a1c207e4089ca98d3b3c1070524c1a Auto-Submitted: auto-generated ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1665355086; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=ihpzwK+/HqZz9UcY1vGXRkshv7h8VUdWgSu1yw5D6Vk=; b=yEDEWpyT+2df04tnuQoBEDqnXyw95jJTXYGRD2J75n0sMnbR3F4SUBD0pPhkZh3th2ySnZ pkSAyyN8bfw/XWQGQ5UKYWmMs9fAa0rNuCjY0u09d26lDUxJS1Ye6XSAKtrGoWG7bFY7XE 5jgrfG1ec/hEyLAovZpPBQ+ZEXYRboS2NekJE/mA0xoHtPbtrSSdI3QRTIX2IuFlyS5LQz GcQ6OQGf2I5I6Nj+varTM3d40CtLZSP82HVOla/fq/7Bkz1Zgd+NZ3YXycepFvxTVM0AKS X+O5XrziLSNAB7pkZMpMxBA23CPZRr8sXVX2Q+IyPM01McyBFTXW11puSlgUkA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1665355086; a=rsa-sha256; cv=none; b=ZrHKinpL8klMb16v+NJ+QRtN+LBW9YLZP93Wgm20Bvz02FRbI2k5FFxgENl1FiLmFGjeEQ mNpxkh9k6rV7MC4Ns5Msj4Hr1KehOmmAf1mAnJzSkGYzSIoI3ByOZiKmGGPZ9ikvZ03Bc8 CYomJhUOANAJbiny0gw8vh1frB4JG/7+KpnlEZq2jBCDKYcxveq7eyjAg94X7r4H8GnuwP yXDoeCL5Tv1K+i6UT4mnNH4dTtHdBbEVtoDzG++Mkj7ha7CyLdU/0pI4IbSt6NKcpTO3x8 vVmEMnrwzw5Np0ZrwoGLmSh1R8nIxa+Eb6dsfeYSD7YNSXjslaQkgEQFbo9knQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N The branch main has been updated by yuri: URL: https://cgit.FreeBSD.org/ports/commit/?id=d3903fc482a1c207e4089ca98d3b3c1070524c1a commit d3903fc482a1c207e4089ca98d3b3c1070524c1a Author: Yuri Victorovich AuthorDate: 2022-10-09 22:22:46 +0000 Commit: Yuri Victorovich CommitDate: 2022-10-09 22:38:02 +0000 misc/py-apache-beam: New port: Apache Beam SDK for Python --- misc/Makefile | 1 + misc/py-apache-beam/Makefile | 55 +++++++++++++++++++++++++++++++++++++++++++ misc/py-apache-beam/distinfo | 3 +++ misc/py-apache-beam/pkg-descr | 17 +++++++++++++ 4 files changed, 76 insertions(+) diff --git a/misc/Makefile b/misc/Makefile index 4654406d5d30..727d806a6a1e 100644 --- a/misc/Makefile +++ b/misc/Makefile @@ -375,6 +375,7 @@ SUBDIR += py-SimpleSoapy SUBDIR += py-SoapySDR SUBDIR += py-alive-progress + SUBDIR += py-apache-beam SUBDIR += py-boost-histogram SUBDIR += py-cinder SUBDIR += py-colorbrewer diff --git a/misc/py-apache-beam/Makefile b/misc/py-apache-beam/Makefile new file mode 100644 index 000000000000..ced61edb4664 --- /dev/null +++ b/misc/py-apache-beam/Makefile @@ -0,0 +1,55 @@ +PORTNAME= apache-beam +DISTVERSION= 2.41.0 +CATEGORIES= misc +MASTER_SITES= CHEESESHOP +PKGNAMEPREFIX= ${PYTHON_PKGNAMEPREFIX} + +MAINTAINER= yuri@FreeBSD.org +COMMENT= Apache Beam SDK for Python +WWW= https://beam.apache.org/ + +LICENSE= APACHE20 + +BUILD_DEPENDS= ${PYTHON_PKGNAMEPREFIX}pip>0:devel/py-pip@${PY_FLAVOR} +RUN_DEPENDS= ${PYTHON_PKGNAMEPREFIX}cloudpickle>=2.1.0:devel/py-cloudpickle@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}crcmod>=1.7:devel/py-crcmod@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}dateutil>=2.8.0:devel/py-dateutil@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}dill>=0.3.1.1:devel/py-dill@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}fastavro>0:textproc/py-fastavro@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}grpcio>=1.33.1>0:devel/py-grpcio@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}hdfs>=2.1.0:www/py-hdfs@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}httplib2>=0.8:www/py-httplib2@${PY_FLAVOR} \ + ${PYNUMPY} \ + ${PYTHON_PKGNAMEPREFIX}orjson<4.0:devel/py-orjson@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}proto-plus>=1.7.1:devel/py-proto-plus@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}protobuf>=3.12.2:devel/py-protobuf@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pydot>=1.2.0:graphics/py-pydot@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pymongo>=3.8.0:databases/py-pymongo@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pytz>=2018.3:devel/py-pytz@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}requests>=2.24.0:www/py-requests@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}typing-extensions>=3.7.0:devel/py-typing-extensions@${PY_FLAVOR} +TEST_DEPENDS= ${PYTHON_PKGNAMEPREFIX}cryptography>=36.0.0:security/py-cryptography@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}freezegun>=0.3.12:devel/py-freezegun@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}joblib>=0.3.12:devel/py-joblib@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}mock>=1.0.1:devel/py-mock@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pandas>0:math/py-pandas@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}parameterized>=0.7.1:devel/py-parameterized@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}psycopg2>=2.8.5:databases/py-psycopg2@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}PyHamcrest>=1.9:textproc/py-pyhamcrest@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pytest-timeout>=1.3.3:devel/py-pytest-timeout@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}pytest-xdist>=1.29.0:devel/py-pytest-xdist@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}requests-mock>=1.7:www/py-requests-mock@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}tenacity>=5.0.2:devel/py-tenacity@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}scikit-learn>=0.20.0:science/py-scikit-learn@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}sqlalchemy14>=1.3:databases/py-sqlalchemy14@${PY_FLAVOR} \ + ${PYTHON_PKGNAMEPREFIX}yaml>=3.12:devel/py-yaml@${PY_FLAVOR} + # testcontainers[mysql]>=3.0.3 is also required + +USES= python:3.6+ zip +USE_PYTHON= distutils cython concurrent autoplist pytest # 5 tests fail, depending on pyarrow, MySqlContainer, threadpoolctl + +post-install: + # strip binaries + @${FIND} ${STAGEDIR}${PREFIX} -name "*${PYTHON_EXT_SUFFIX}.so" | ${XARGS} ${STRIP_CMD} + +.include diff --git a/misc/py-apache-beam/distinfo b/misc/py-apache-beam/distinfo new file mode 100644 index 000000000000..933a53385135 --- /dev/null +++ b/misc/py-apache-beam/distinfo @@ -0,0 +1,3 @@ +TIMESTAMP = 1665344114 +SHA256 (apache-beam-2.41.0.zip) = c1a0456a5b48c3481bf20dc904e4d812515144336873b322f17ba188e2fabd92 +SIZE (apache-beam-2.41.0.zip) = 2860736 diff --git a/misc/py-apache-beam/pkg-descr b/misc/py-apache-beam/pkg-descr new file mode 100644 index 000000000000..c419e98626ec --- /dev/null +++ b/misc/py-apache-beam/pkg-descr @@ -0,0 +1,17 @@ +Apache Beam is a unified programming model for Batch and Streaming data +processing. + +Beam provides a general approach to expressing embarrassingly parallel data +processing pipelines and supports three categories of users, each of which have +relatively disparate backgrounds and needs. + +* End Users: Writing pipelines with an existing SDK, running it on an existing + runner. These users want to focus on writing their application logic and have + everything else just work. +* SDK Writers: Developing a Beam SDK targeted at a specific user community + (Java, Python, Scala, Go, R, graphical, etc). These users are language geeks + and would prefer to be shielded from all the details of various runners and + their implementations. +* Runner Writers: Have an execution environment for distributed processing and + would like to support programs written against the Beam Model. Would prefer to + be shielded from details of multiple SDKs.