Explore deploying site builds over scp rather than WebDAV
Basics
Logistics
Basics
Logistics
Description
Environment
None
Activity
Show:
Ian Young June 29, 2021 at 12:43 PM
Uploaded.
Philip Smart June 29, 2021 at 8:52 AM
As usual, I forgot to ask to upload the maven ssh wagon to our Nexus. @Ian Young when you have time, would you be able to upload the following artifact.
org.apache.maven.wagon:wagon-ssh:3.4.3Philip Smart June 28, 2021 at 6:23 PM
Will need a new property in the java-parent to separate site deployment from site URLs e.g.
<shibboleth.site.deploy.scp.url>//shibboleth.net/home/javasites/staging/</shibboleth.site.deploy.scp.url>And reference that in the IdP et al.
Philip Smart June 28, 2021 at 1:48 PM
Added the wagon-ssh (SCP) provider to the parent POM.
Philip Smart June 15, 2021 at 4:52 PM
When we move to Nexus 3, the SCP approach will not work. Nexus 3 does not support direct uploads to the filesystem for serving sites, everything needs to go through their HTTP API, which leads us back to WebDav. Because of this https://shibboleth.atlassian.net/browse/GEN-292#icft=GEN-292 will look to prepare Apache as a way of serving the static Maven sites.
Fixed
Pinned fields
Click on the next to a field label to start pinning.
Details
Details
Assignee
Philip SmartReporter
Philip SmartCreated May 28, 2021 at 10:53 AM
Updated January 18, 2023 at 1:07 PM
Resolved July 2, 2021 at 9:25 AM
We currently deploy Maven site builds using WebDAV. WebDAV uploads site builds one file at a time. Given the sheer number of files involved in a site build of either the IdP or opensaml, this seems too much for 'something' server-side and can often fail with various connection related issues.
Deploying site builds using SCP instead has the benefit of the build happening locally before being compressed into a single file to upload. See https://maven.apache.org/plugins/maven-site-plugin/deploy-mojo.html
It is not clear how this actually works e.g. where does it SCP it to, how does it unpack it remotely, and where the result goes. This issue tracks any relevant investigation into this.