Skip to content

OSG Technology Area Meeting, 3 August 2021

Announcements

Triage Duty

  • This week: Carl
  • Next week: Mat
  • 7 (+1) open FreshDesk tickets
  • 0 (+0) open GGUS ticket

Jira (as of Monday)

# of tickets Δ State
153 +5 Open
26 +1 Selected for Dev
39 +3 In Progress
11 -1 Dev Complete
3 +0 Ready for Testing
5 +2 Ready for Release

OSG Software Team

  • Tim makeup doc focus: EL8 interest is increasing
  • Doc focus Aug 20
  • Release
    • AI (TimT): SciTokens credmon?
    • AI (Carl): Move Gratia sub-tickets into RFT
    • AI (Carl): Improve default ProbeConfig directory configuration
  • GSI Transition
    • AI (Carl): Directly query OSG COManage's LDAP for OSGID (SOFTWARE-4528)
    • AI (Mat): Add API token authentication to Topology (SOFTWARE-4134)
    • AI (BrianL): Get XRootD tests running with proxies again (SOFTWARE-4604)
  • OSG VO Backfill Containers
    • AI (Mat): Add support for limiting resources available to the osgvo-docker-pilot (SOFTWARE-4634)
    • AI (BrianL): Add CI tests
  • Other
    • AI (Mat): Review comments on cvmfsexec doc changes
    • AI (BrianL): Investigate persistent condor_ce_run failures in 3.6 nightlies

Discussion

  • GlideinWMS 3.7.5 still in progress; release candidate expected today/tomorrow; rc will contain cvmfsexec support

Support Update

  • Georgia Tech (BrianL): Gave them some AP HTCondor config that should prevent pilots from flocking out to pilots
  • Lancium (BrianL, Mats): live backfill container debugging session that uncovered issues in the periodic health check not properly detecting unpriv Singularity.
  • Multiple (Derek): Several sites had failed gratia probes over the last week. All isolated events, but I think there were 4 at the same time.

OSG DevOps

  • Elasticsearch will need to be updated. Working on a schedule.
  • StashCP go client is working and tested, and being tested by Christina now. Need to talk to Mats on packaging and releasing. (will follow up). No news from Christina,
  • Design document is done and is being distributed for xrootd monitoring collector NG (next gen). Shoveler is working and lightly tested. Collector is 50% done. Design document is still not reviewed, but moving foward anyways.
  • XRootD TCP plugin is ready for packaging. Derek will follow up with software team on who to hand that off to.
  • Discussions of xrootd-multiuser support for checksumming on-the-fly. After a discussion, the checksum-on-the-fly funcationality will be ported to xrootd-multiuser. Copied largely from xrootd-hdfs. This does mean that out-of-order writes will not be supported.

  • More partners are asking about scitokens-cpp, and compatibility. Expect some updates.

    • Maybe we have been doing tokens wrong? Use the `typ` rather than `ver`.

  • (Stalled, but need to get back to it) XRootD accounting information (from Frank):

    • May need help with automating the process of generating these reports. A month only takes a few minutes. Longer periods take much longer.
    • Table of working set, read, and re-read for monthly, quarterly, and year.

Discussion

None this week

OSG Release Team

  • Ready for Testing
    • gratia-probe 1.24.0 (OSG 3.5 and 3.6)
    • XRootD 5.3.1 (OSG 3.5-upcoming)
  • Ready for Release
    • OSG 3.5
      • Upcoming: XCache 2.0.1 (Python 3 conversion)
      • VOMS 2.0.16 (2.1.0rc? on EL8)
      • htvault-config 1.4 and htgettoken 1.3
    • OSG 3.6
      • VOMS 2.0.16 (2.1.0rc? on EL8)
      • htvault-config 1.4 and htgettoken 1.3

Discussion

None this week