OSG 24 News¶
Supported OS Versions: EL8, EL9 (see this document for details)
OSG 24 is the second release series following our annual release schedule and includes support for the ARM CPU architecture. The initial release includes GlideinWMS 3.10.7, HTCondor 24.0.1, HTCondor 24.1.1, HTCondor-CE 24.0, and XRootD 5.7.0.
OSG 24 will be supported for approximately two years total.
Latest News¶
November 26, 2024: HTCondor 24.0.2; Upcoming: HTCondor 24.2.1¶
- HTCondor 24.0.2
- Add
STARTER_ALWAYS_HOLD_ON_OOM
to minimize confusion about memory usage - Fix bug that caused
condor_ssh_to_job
sftp
andscp
modes to fail - Fix
KeyboardIdle
attribute in dynamic slots that could prevent job start - No longer signals the OAuth credmon when there is no work to do
- Fix rare
condor_schedd crash
when a$$()
macro could not be expanded - By default, put Docker jobs on hold when CPU architecture doesn't match
- Add
- Upcoming
- HTCondor 24.2.1
- Fixed DAGMan's direct submission of late materialization jobs
- New
primary_unix_group
submit command that sets the job's primary group - Initial implementation of broken slot detection and reporting
- New job attributes
FirstJobMatchDate
andInitialWaitDuration
condor_ssh_to_job
now sets the supplemental groups in ApptainerMASTER_NEW_BINARY_RESTART
now accepts theFAST
parameter- Avoid blocking on dead collectors at shutdown
- HTCondor 24.2.1
November 13, 2024: XRootD 5.7.1-1.4¶
- XRootD 5.7.1-1.4
- Reduce XCache error rate under load
October 31, 2024: Initial Release¶
Where is the OSG 24 worker node tarball?
We plan to distribute the worker node tarball within the next week. Stay tuned for updates!
This initial release contains the following notable changes compared to the current OSG 23 release:
-
- Improvements from the HTCondor 23.x feature series
- Improved tracking and enforcement of disk usage by using LVM
- Enhancements to the htcondor CLI tool
- cgroup v2 support for tracking and enforcement of CPU and memory usage
- Leverage cgroups to hide GPUs not allocated to the job
- DAGMan can now produce job credentials when using direct submit
- New submit commands to aid in matching specific GPU requirements
- New implementation of the Python bindings, htcondor2 and classad2
- Improved default security configuration
- Significant reduction in memory and CPU usage on the Central Manager
- Additional highlights:
- Support for GPUs using AMD's HIP 6 library
- Fix bugs when -divide or -repeat was used in GPU detection
- Proper error message and hold when Docker emits multi-line error message
- Fix issue where an unresponsive libvirtd blocked an EP from starting up
- The htcondor CLI now works on Windows
- Improvements from the HTCondor 23.x feature series
-
- Remove obsolete GSI configuration
- Fix certificate subject parsing in
condor_ce_host_network_check
-
Pelican 7.10.11: the initial release of Pelican in the main line of the OSG Software Stack. Pelican is the new foundational software for the OSDF. Administrators of hosts installing
pelican
for the client are encouraged to upgrade to 7.10.11.OSDF origins / caches
For operators of existing OSDF caches or origins (formerly
stash-cache
orstash-origin
, respectively), we recommend waiting for the release of Pelican 7.11 and accompanyingosdf-server
RPMs before upgrading. -
HTCondor 24.1.1 in OSG Upcoming
- All of the changes from the HTCondor 24.0.1 LTS release
- Can print contents of stored OAuth2 credential with htcondor CLI tool
- In DAGMan, inline submit descriptions work when not submitting directly
- By default, put Docker jobs on hold when CPU architecture doesn't match
- Detects and deletes invalid checkpoint and reschedules job
-
OSG PKI tools 3.7.1-2: fix an issue with missing
python3-*
dependencies -
ospool-ap
replaces theosg-flock
RPM
Package removals¶
The following packages were removed from OSG 24:
hosted-ce-tools
: moved into relevant container imagesvoms
: available in EPELx509-token-issuer
: removed due to lack of demand
Container images¶
Where are the other OSG images?
We intend to release atlas-xcache
, cms-xcache
, frontier-squid
, oidc-agent
, osg-wn
container images by the
end of the year.
stash-cache
and stash-origin
images will be replaced by pelican_platform/osdf-cache
and
/pelican_platform/osdf-origin
images, respectively.
The following container images have new tags for OSG 24:
Image name | Tags |
---|---|
hub.opensciencegrid.org/osg-htc/ospool-ep |
24-release |
Announcements¶
Updates to critical packages also announced by email and are sent to the following recipients and lists: