80,000 jobs, 40 billion base pairs, and 20 bats –– all in 4 weeks
An evolutionary biologist at the AMNH used HTC services provided by the OSG to unlock a genomic basis for convergent evolution in bats.
Transforming research with high throughput computing
During the OSG Virtual School Showcase, three different researchers shared how high throughput computing has made lasting impacts on their work.
Scaling virtual screening to ultra-large virtual chemical libraries
Kicking off last week’s OSG User School Showcase, Spencer Ericksen, a researcher at the University of Wisconsin-Madison’s Carbone Cancer Center, described how high throughput computing (HTC) has made his work in early-stage drug discovery infinitely more scalable.
Using HTC for a simulation study on cross-validation for model evaluation in psychological science
During the OSG School Showcase, Hannah Moshontz, a postdoctoral fellow at UW-Madison’s Department of Psychology, described her experience of using high throughput computing (HTC) for the very first time, when taking on an entirely new project within the field of psychology.
Antimatter: Using HTC to study very rare processes
Anirvan Shukla, a User School participant in 2016, spoke at this year’s Showcase about how high throughput computing has transformed his research of antimatter in the last five years.
OSG fuels a student-developed computing platform to advance RNA nanomachines
How undergraduates at the University of Nebraska-Lincoln developed a science gateway that enables researchers to build RNA nanomachines for therapeutic, engineering, and basic science applications.
OSPool Usage Hits Daily Record
Researchers harnassing the capacity of the OSPool are racking up record-breaking numbers. On June 8, the OSPool, which provides computing resources to researchers across the country, went over 1.1 million core hours –– a daily record number. To put this in perspective, one million core hours is equivalent to using 42 thousand cores in just one day. That is close to half the size of some large supercomputing centers. In short, an increasing number of researchers are utilizing the OSG to carry out an incredible amount of computing.
Researcher Nicholas Cooley Wins 2021 David Swanson Memorial Award
Nicholas Cooley was awarded the 2021 David Swanson Memorial Award at the March OSG All-Hands Meeting. The memorial was established to honor our late colleage David Swanson who contributed to campus research across the country.
Migration to HTTP from GridFTP for Data Transfers
The OSG consortium is nearing the completion of migrating its software stack to the WebDAV data transfer protocol - a widely used, industry-compatible and secure protocol. The WebDAV protocol which is an extension of the well-known HTTP allows Third-Party-Copy transfers which are commonly used to move bulk data between storage systems worldwide. Moreover, WebDav is compatible with the OAuth2 mechanism for authentication.
Global Infrastructure Laboratory - Options for Jupyter Support in OSG
Summary of GIL Discussion of Options for Jupyter Support in OSG. GIL conducted an open dicussion with the entire OSG staff mailing list on March 9, 2021. The team reviewed the proposal document and concluded the following -
Upcoming OSG All-Hands Meeting, March 1–5
Register now for the online All-Hands Meeting 2021, March 1–5, offered by the OSG. Everyone is invited to attend. Registration is free but required, so please take a minute to register now.
How to Transfer 460 Terabytes? A File Transfer Case Study
When Greg Daues at the National Center for Supercomputing Applications (NCSA) needed to transfer 460 Terabytes of NCSA files from the National Institute of Nuclear and Particle Physics (IN2P3) in Lyon, France to Urbana, Illinois, for a project they were working with FNAL, CC-IN2P3 and the Rubin Data Production team, he turned to the HTCondor High Throughput system, not to run computationally intensive jobs, as many do, but to manage the hundreds of thousands of I/O bound transfers.
Register Now for the February 8-9 Campus Workshop
Save the date and register now for another Campus Workshop on distributed high-throughput computing (dHTC), February 8-9, offered by the Partnership to Advance Throughput computing (PATh). All campus cyberinfrastructure (CI) staff are invited to attend!
National Science Foundation establishes a partnership to advance throughput computing
Recognizing the University of Wisconsin-Madison’s leadership role in research computing, the National Science Foundation announced this month that the Madison campus will be home to a five-year, $22.5 million initiative to advance high-throughput computing.
OSG User School 2019
The OSG User School 2019 was held at the University of Wisconsin–Madison on July 15–19. This year’s event hosted 55 participants, drawn from a pool of 86 applicants. These numbers are consistent with the past few years, taking into account annual variation.
SDSC and IceCube Center Conduct GPU Cloudburst Experiment
The San Diego Supercomputer Center (SDSC) and the Wisconsin IceCube Particle Astrophysics Center (WIPAC) at the University of Wisconsin–Madison successfully completed a computational experiment as part of a multi-institution collaboration that marshalled all globally available for sale GPUs (graphics processing units) across Amazon Web Services, Microsoft Azure, and the Google Cloud Platform.
OSG User School 2018
The OSG User School 2018 was held at the University of Wisconsin–Madison on July 9–13. This year’s event set a new record with 65 participants in total, up from 56 participants in 2017. And due to the large and record-setting number of applicants, 140, it was also one of the most selective offerings of the School.
Des Expanding Universe
Since its beginning, our universe has been expanding. The early work of scientists such as Edwin Hubble gave us proof that galaxies across the universe are moving apart from one another. Hubble’s law states, “Objects observed in deep space are found to have a red shift, interpreted as a relative velocity away from Earth.” The Dark Energy Survey (DES) seeks to help unravel the mysteries of what forces are causing this expansion by focusing on dark energy and how it constantly remaps the cosmos.
OSG User School 2017
The OSG User School 2017 was held at the University of Wisconsin–Madison on July 17–21. There were 56 participants, including mostly graduate students, post-doctoral researchers, a few advanced undergraduates, several faculty, and some research staff from research institutions in the United States (and one each from England and Spain). The range of scholarly domains was one of the most diverse yet, including physics, biology, chemistry, medicine, engineering, statistics, earth sciences, plant sciences, and economics. Participants were selected by demonstrating need for large-scale computing and by being in a position to transform their scholarly work through computation. The instructors this year were Bala Desinghu, Brian Lin, and Derek Weitzel from the OSG, plus Christina Koch and Lauren Michael from the UW–Madison’s Center for High Throughput Computing.
OSG integrates global computing to support detection of colliding neutron stars by LIGO, VIRGO, and DECam
On October 16th, scientists at the LIGO and Virgo scientific collaborations announced the detection of gravitational waves from the collision of two neutron stars that occurred 130 million years ago. This collision has also been observed with light emitted across the entire electromagnetic spectrum.
LIGO Collaboration wins 2017 Nobel Prize in Physics
On October 1, 2017, Rainer Weiss, Barry Barish, and Kip Thorne were awarded the Nobel Prize in Physics “for decisive contributions to the LIGO detector and the observation of gravitational waves.” LIGO confirmed the first direct observation of gravitational waves on September 14, 2015. Both LIGO detectors, one in Hanford, Washington, and one in Livingston, Louisiana, observed a gravitational wave from the merger of two black holes, and with that, the final piece of Einstein’s general theory of relativity fell into place.
Astronomy archives are creating new science every day
Accumulated data sets from past and current astronomy research are not dead. Researchers are still doing new science with old data and still making new discoveries.
Machine learning insights into molecular science using the Open Science Pool
Machine learning insights into molecular science using the Open Science Pool Computation has extended what researchers can investigate in chemistry, biology, and material science. Studying complex systems like proteins or nanocomposites can use similar techniques for common challenges. For example, computational power is expanding the horizons of protein research and opening up vast new possibilities for drug discovery and disease treatment.
VERITAS and OSG explore extreme window into the universe
Understanding the universe has always fascinated mankind. The VERITAS Cherenkov telescope array unravels its secrets by detecting very-high-energy gamma rays from astrophysics sources.
For neuroscientist Chris Cox, the OSG helps process mountains of data
Whether exploring how the brain is fooled by fake news or explaining the decline of knowledge in dementia, cognitive neuroscientists like Chris Cox are relying more on high-throughput computing resources like the Open Science Pool to understand how the brain makes sense of information.
Free Supercomputing for Research - Scott Cole introduces you to OSG
Scott Cole, a neuroscience PhD student at University of California San Diego, wrote an article which appeared in PythonWeekly that details how to get up and running on Open Science Pool. “I was starting to run into computational limitations in my neuroscience research, but I didn’t have any experience speeding up my work with something like high throughput computing,” said Cole. When Cole saw that there was an opportunity at the OSG User School to learn how to use OSG and the free access to resources it provides, he jumped on it.
OSG helps LIGO scientists confirm Einstein's unproven theory
Albert Einstein first posed the idea of gravitational waves in his general theory of relativity just over a century ago. But until now, they had never been observed directly. For the first time, scientists with the Laser Interferometer Gravitational-Wave Observatory (LIGO) Scientific Collaboration (LSC) have observed ripples in the fabric of spacetime called gravitational waves.
The OSG Consortium is pleased to see OSG stories reposted on the websites of other organizations. The stories should be reposted with credits to the OSG website and the original authors, as well as a link to the original posting. Any alterations to the text or images for the reposting should be agreed by the OSG Communications team. Please email [email protected].