Campus Cyberinfrastructure (CC*) 2022 solicitation now active! Learn more on our Campus page.

High-throughput computing as an enabler of black hole science


The stunning new image of a supermassive black hole in the center of the Milky Way was created by eight telescopes, 300 international astronomers and more than 5 million computational tasks. This Morgridge Institute article describes how the Wisconsin-based Open Science Pool helped make sense of it all.

Read More

The OSG Consortium

The OSG consortium of research collaborations, campuses, national laboratories, and software providers is dedicated to the advancement of all open science via the practice of distributed High Throughput Computing (dHTC), and to the advancement of its state of the art. Established in 2005, the OSG operates a fabric of dHTC services for the National S&E community.

Open Science Pool (OSPool)

The OSPool provides researchers with fair-share access to computing and data capacity powered by distributed high-throughput computing (dHTC) technologies.

  • Open for any scientist or group, of all disciplines, doing open science in the US.
  • Built to run independent computations on a massive scale.
  • The OSPool is built from resources contributed by university campuses, government-supported supercomputing facilities and research collaborations
  • Resources are assigned on a fair-share basis at no cost to researchers; no allocation process is required.
Open Science Data Federation (OSDF)

The OSDF enables users and institutions to share data files and storage capacity, making them both accessible in dHTC environments such as the OSPool.

  • Provides campuses and researchers with the ability to manage their data files, input and output, in support of running their dHTC workloads.
  • Improves file access performance, resource consumption and reliability.
  • The OSG Connect service provides researchers with a default of 500GB of storage space on the OSDF.
OSG All-Hands Meetings (AHM)

The OSG annual AHM provides the consortium stakeholders and the broader dHTC community with a venue to share ideas and exchange information.

This years AHM hosted 38 talks from researchers, collaborators and OSG executives on their contributions towards bringing OSG into 2022.

  • Researchers presented on their use of OSG services to run their dHTC workloads
  • OSG executives discussed the State of OSG in 2022 and future plans
  • Campus administrators discussed the use of HTC resources on their campuses by researchers and undergraduates alike

What We Do


The OSG facilitates access to distributed high throughput computing for research in the US. The resources accessible through the OSG are contributed by the community, organized by the OSG, and governed by the OSG consortium. In the last 12 months, we have provided more than 1.2 billion CPU hours to researchers across a wide variety of projects.

Submit Locally, Run Globally


Researchers can run jobs on OSG from their home institution or OSG's centrally-operated submission service, OSG Connect (available for US-based research and scholarship).

Sharing Is Key


Sharing is a core principle of the OSG. Over 100 million CPU hours delivered on the OSG in the past year were opportunistic, contributed by university campuses, government-supported supercomputing facilities and research collaborations. Sharing allows individual researchers to access larger computing resources and large organizations to keep their utilization high.

Resource Providers


The OSG consists of computing and storage elements at over 100 individual sites spanning the United States. These sites, primarily at universities and national labs, range in size from a few hundred to tens of thousands of CPU cores.

The OSG Software Stack


The OSG provides an integrated software stack to enable high throughput computing; visit our technical documents website for information.

Coordinating CI Services


NSF’s Blueprint for National Cyberinfrastructure Coordination Services lays out the need for coordination services to bring together the distributed elements of a national CI ecosystem. It highlights OSG as providing distributed high throughput computing services to the U.S. research community.

Find Us!

Are you a resource provider wanting to join our collaboration? Contact us: [email protected].

Are you a user wanting more computing resources? Check with your 'local' computing providers, or consider using OSG Connect (available to US-based academic/govt/non-profit research projects).

For any other inquiries, reach us at: [email protected].

To see the breadth of the OSG impact, explore our accounting portal.

Support

The activities of the OSG Consortium are supported by multiple projects and in-kind contributions from members. Significant funding is provided through:


Path

The Partnership to Advance Throughput Computing (PATh) is an NSF-funded (#2030508) project to address the needs of the rapidly growing community embracing Distributed High Throughput Computing (dHTC) technologies and services to advance their research.

IRIS-HEP

The Institute for Research and Innovation in Software for High Energy Physics (IRIS-HEP) is an NSF-funded (#1836650) software institute established to meet the software and computing challenges of the HL-LHC, through R&D for the software for acquiring, managing, processing and analyzing HL-LHC data.