From 5ab38980db98f491c4cc83abbf7feb26f9ef11d9 Mon Sep 17 00:00:00 2001 From: Andy Grove Date: Mon, 2 Nov 2026 18:05:08 -0700 Subject: [PATCH 1/3] docs: add a Download page for the source release ASF release policy requires a project download page that links the source release through the mirror system, with the signature, checksum and KEYS served from downloads.apache.org. The user guide linked to the raw dist.apache.org SVN path and gave no way to verify the download. Add a Download page, point the build-from-source guide at it, and add a post-release step to update the page and to link it from the announcement. --- .../contributor-guide/release_process.md | 24 ++++++- docs/source/download.md | 62 +++++++++++++++++++ docs/source/index.md | 1 + docs/source/user-guide/latest/source.md | 7 +-- 4 files changed, 89 insertions(+), 5 deletions(-) create mode 100644 docs/source/download.md diff --git a/docs/source/contributor-guide/release_process.md b/docs/source/contributor-guide/release_process.md index 0dac5641c8a..aa06705c782 100644 --- a/docs/source/contributor-guide/release_process.md +++ b/docs/source/contributor-guide/release_process.md @@ -75,6 +75,7 @@ instructions on each step. - [ ] Promote Maven artifacts to production - [ ] Push the release tag - [ ] Bring the finalized change log into main + - [ ] Update the download page - [ ] Close the vote and announce the release - [ ] Post release: - [ ] Register the release with Apache Reporter @@ -444,6 +445,9 @@ deployed to https://datafusion.apache.org/comet/ by the documentation publishing Note that the download links in the installation guide will not work until the release is finalized, but having the documentation available could be useful for anyone testing out the release candidate during the voting period. +The [Download](https://datafusion.apache.org/comet/download.html) page is not part of this step. It is updated only after +the release is published; see [Update the download page](#update-the-download-page). + ## Publishing the Release Candidate This part of the process can mostly only be performed by a PMC member. @@ -596,11 +600,29 @@ git tag 0.13.0 git push apache 0.13.0 ``` +### Update the download page + +ASF release policy requires the project website to have a download page for the source release, and the +announcement to link to it. Update `docs/source/download.md` to point at the new release: change the version in the +links and commands, the changelog link and the user guide links, and create a pull request against `main`. + +Wait at least one hour after the tarball is uploaded to the release repository, so that it has reached +`downloads.apache.org` and the mirrors, before merging the pull request. Do not merge it before the release is +published, because ASF release policy forbids linking to unreleased packages. + +Check that the tarball link redirects to a mirror and that the signature, checksum and `KEYS` links resolve. The +tarball must be linked through the mirror system (`https://www.apache.org/dyn/closer.lua/...`), and the signature, +checksum and `KEYS` links must point at `https://downloads.apache.org/`, not at a mirror. Send the announcement +email only after the updated page is live on the website. + +### Announce the release + Reply to the vote thread to close the vote and announce the release. The announcement email should include: - The release version - A link to the release notes / changelog -- A link to the download page or Maven coordinates +- A link to the [Download](https://datafusion.apache.org/comet/download.html) page for the source release (required by + ASF release policy), and optionally the Maven coordinates - Thanks to everyone who contributed and voted ## Post Release diff --git a/docs/source/download.md b/docs/source/download.md new file mode 100644 index 00000000000..7e9f48f3873 --- /dev/null +++ b/docs/source/download.md @@ -0,0 +1,62 @@ + -Official source releases can be downloaded from https://dist.apache.org/repos/dist/release/datafusion/ +Official source releases are available from the [Download](https://datafusion.apache.org/comet/download.html) page, +together with the signature, checksum and instructions for verifying the download. ```console -# Pick the latest version +# Pick the version you downloaded export COMET_VERSION=$COMET_VERSION -# Download the tarball -curl -O "https://dist.apache.org/repos/dist/release/datafusion/datafusion-comet-$COMET_VERSION/apache-datafusion-comet-$COMET_VERSION.tar.gz" # Unpack tar -xzf apache-datafusion-comet-$COMET_VERSION.tar.gz cd apache-datafusion-comet-$COMET_VERSION From aeea29cbdf413e16a70cc236ae91ede87e4879a6 Mon Sep 17 00:00:00 2001 From: Andy Grove Date: Wed, 11 Nov 2026 14:10:20 -0700 Subject: [PATCH 2/3] docs: link the download page and its mentions by path, and to the latest user guide --- docs/source/contributor-guide/release_process.md | 6 +++--- docs/source/download.md | 4 ++-- docs/source/user-guide/latest/source.md | 2 +- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/docs/source/contributor-guide/release_process.md b/docs/source/contributor-guide/release_process.md index 244667d89b3..5993e00f63a 100644 --- a/docs/source/contributor-guide/release_process.md +++ b/docs/source/contributor-guide/release_process.md @@ -444,7 +444,7 @@ deployed to https://datafusion.apache.org/comet/ by the documentation publishing Note that the download links in the installation guide will not work until the release is finalized, but having the documentation available could be useful for anyone testing out the release candidate during the voting period. -The [Download](https://datafusion.apache.org/comet/download.html) page is not part of this step. It is updated only after +The [Download](../download.md) page is not part of this step. It is updated only after the release is published; see [Update the download page](#update-the-download-page). ## Publishing the Release Candidate @@ -603,7 +603,7 @@ git push apache 0.13.0 ASF release policy requires the project website to have a download page for the source release, and the announcement to link to it. Update `docs/source/download.md` to point at the new release: change the version in the -links and commands, the changelog link and the user guide links, and create a pull request against `main`. +links and commands and the changelog link, and create a pull request against `main`. Wait at least one hour after the tarball is uploaded to the release repository, so that it has reached `downloads.apache.org` and the mirrors, before merging the pull request. Do not merge it before the release is @@ -620,7 +620,7 @@ Reply to the vote thread to close the vote and announce the release. The announc - The release version - A link to the release notes / changelog -- A link to the [Download](https://datafusion.apache.org/comet/download.html) page for the source release (required by +- A link to the [Download](../download.md) page for the source release (required by ASF release policy), and optionally the Maven coordinates - Thanks to everyone who contributed and voted diff --git a/docs/source/download.md b/docs/source/download.md index 7e9f48f3873..8e73fb8d1ad 100644 --- a/docs/source/download.md +++ b/docs/source/download.md @@ -31,7 +31,7 @@ Foundation and must not be taken from a mirror. The public keys of the release m [KEYS](https://downloads.apache.org/datafusion/KEYS) file. The release notes are in the [changelog](changelog/1.2.0.md). -See [Building Comet From Source](https://datafusion.apache.org/comet/user-guide/1.1/source.html) for how to build the tarball. +See [Building Comet From Source](user-guide/latest/source.md) for how to build the tarball. ## Verifying the download @@ -53,7 +53,7 @@ The `gpg --verify` command should report a good signature. See the Pre-built Comet jar files for Linux are published to [Maven Central](https://central.sonatype.com/namespace/org.apache.datafusion) as a convenience. They are built from -the source release above. See the [installation guide](https://datafusion.apache.org/comet/user-guide/1.1/installation.html) for the links and for the +the source release above. See the [installation guide](user-guide/latest/installation.md) for the links and for the supported Spark versions. ## Older releases diff --git a/docs/source/user-guide/latest/source.md b/docs/source/user-guide/latest/source.md index 7e12b0c20aa..7302d14ba07 100644 --- a/docs/source/user-guide/latest/source.md +++ b/docs/source/user-guide/latest/source.md @@ -32,7 +32,7 @@ To use this version of Comet, see the following section on building from the Git -Official source releases are available from the [Download](https://datafusion.apache.org/comet/download.html) page, +Official source releases are available from the [Download](../../download.md) page, together with the signature, checksum and instructions for verifying the download. ```console From 23c9d886a0b683eb5f4135e714768c9947da2d0c Mon Sep 17 00:00:00 2001 From: Andy Grove Date: Mon, 16 Nov 2026 09:00:13 -0700 Subject: [PATCH 3/3] docs: link the download page to the released user guide, and close its license header user-guide/latest/ on the site is the development snapshot, built with the IF_RELEASE blocks stripped, so the Building From Source and installation guide links opened snapshot text instead of the 1.2.0 release instructions. Link user-guide/1.2/ by path, which resolves because the docs are built from docs/temp where generate-versions.py adds that directory, and restore the release step that updates these links. The license header comment was never closed, so the whole page rendered as an HTML comment with no title. Close it, and reword a shell comment that Pygments failed to lex. Co-Authored-By: Claude Opus 5.5 --- docs/source/contributor-guide/release_process.md | 2 +- docs/source/download.md | 7 ++++--- 2 files changed, 5 insertions(+), 4 deletions(-) diff --git a/docs/source/contributor-guide/release_process.md b/docs/source/contributor-guide/release_process.md index 5993e00f63a..4076f7164a6 100644 --- a/docs/source/contributor-guide/release_process.md +++ b/docs/source/contributor-guide/release_process.md @@ -603,7 +603,7 @@ git push apache 0.13.0 ASF release policy requires the project website to have a download page for the source release, and the announcement to link to it. Update `docs/source/download.md` to point at the new release: change the version in the -links and commands and the changelog link, and create a pull request against `main`. +links and commands, the changelog link and the user guide links, and create a pull request against `main`. Wait at least one hour after the tarball is uploaded to the release repository, so that it has reached `downloads.apache.org` and the mirrors, before merging the pull request. Do not merge it before the release is diff --git a/docs/source/download.md b/docs/source/download.md index 8e73fb8d1ad..40ebe808305 100644 --- a/docs/source/download.md +++ b/docs/source/download.md @@ -15,6 +15,7 @@ KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. +--> # Download @@ -31,14 +32,14 @@ Foundation and must not be taken from a mirror. The public keys of the release m [KEYS](https://downloads.apache.org/datafusion/KEYS) file. The release notes are in the [changelog](changelog/1.2.0.md). -See [Building Comet From Source](user-guide/latest/source.md) for how to build the tarball. +See [Building Comet From Source](user-guide/1.2/source.md) for how to build the tarball. ## Verifying the download It is essential that you verify the integrity of the downloaded file using the PGP signature and the checksum. ```console -# Import the release managers' public keys +# Import the public keys of the release managers curl -O "https://downloads.apache.org/datafusion/KEYS" gpg --import KEYS # Verify the signature and the checksum @@ -53,7 +54,7 @@ The `gpg --verify` command should report a good signature. See the Pre-built Comet jar files for Linux are published to [Maven Central](https://central.sonatype.com/namespace/org.apache.datafusion) as a convenience. They are built from -the source release above. See the [installation guide](user-guide/latest/installation.md) for the links and for the +the source release above. See the [installation guide](user-guide/1.2/installation.md) for the links and for the supported Spark versions. ## Older releases