OSPool Documentation
Ap7 access
Initializing search
Home
Get Started on the OSPool
Support And Training Resources
Submit High Throughput Computing (HTC) Workloads
Tutorials and Software Examples
Additional Resources
OSPool Documentation
Home
Get Started on the OSPool
Get Started on the OSPool
Welcome
Welcome
Computation on the Open Science Pool
Policies for Using OSG Services and the OSPool
Frequently Asked Questions
Account Setup
Account Setup
Start Here: Overview of Requesting OSPool Access
Log In to uw.osg-htc.org Access Points
Log In to OSG Connect Access Points
Generate SSH Keys
Set and View Project Usage
Migrating to ap20/ap21.uc.osg-htc.org
Support And Training Resources
Support And Training Resources
Get Help!
Get Help!
Email, Office Hours, and 1-1 Meetings
Education And Training
Education And Training
Monthly OSG User Training
Past Training Materials
Annual, Week-Long OSG User School
Other Past Training Events
OSPool Resources for Teaching & Education
Submit High Throughput Computing (HTC) Workloads
Submit High Throughput Computing (HTC) Workloads
How to Use the OSPool
How to Use the OSPool
Roadmap to HTC Workload Submission
HTC Workload Planning, Testing, and Scaling Up
HTC Workload Planning, Testing, and Scaling Up
Overview: Submit Jobs to the OSPool using HTCondor
Determining the Amount of Resources to Request in a Submit File
Easily Submit Multiple Jobs
Convert your workflow from Slurm to HTCondor
Launch a JupyterLab Instance
Managing Data For Jobs
Managing Data For Jobs
Overview: Data Staging and Transfer to Jobs
Transfer Smaller Job Files to and from /home
Transfer Larger Job Files and Containers Using OSDF
Transfer HTTP-available Files up to 1GB In Size
Use scp To Transfer Files To and From OSG Managed Access Points
Using Software
Using Software
Overview: Software on the Open Science Pool
Compiling Software
Example Software Compilation
Containers - Apptainer/Singularity
Containers - Docker
Containers - Predefined List
Monitor, Review, and Troubleshoot Jobs
Monitor, Review, and Troubleshoot Jobs
Monitor and Review Jobs With condor_q and condor_history
Troubleshooting Job Errors
Considerations For Specific Resource Needs
Considerations For Specific Resource Needs
Control Where Your Jobs Run/Job Requirements
GPU Jobs
ARM64
Checkpointing Jobs
Large Memory Jobs
Multicore Jobs
OpenMPI Jobs
EL9 Transition
Automated Workflows
Automated Workflows
Overview: Submit Workflows with HTCondor's DAGMan
Simple Example of a DAGMan Workflow
Use Pegasus to Manage Workflows on OSPool Access Points
Tutorials and Software Examples
Tutorials and Software Examples
Workflow Tutorials
Workflow Tutorials
List of Available Tutorials
Quickstart-Submit Example HTCondor Jobs
Organizing and Submitting HTC Workloads
Finding OSG Locations
Artificial Intelligence
Artificial Intelligence
scikit-learn
TensorFlow
PyTorch
Python
Python
Run Python Scripts on the OSPool
Scaling Up With HTCondor’s Queue Command
Wordcount Tutorial for Submitting Multiple Jobs
R
R
Use External Packages in your R Jobs
Run R scripts on the OSPool
Scaling up compute resources
Analyzing .csv Data with R
Conda/Miniconda
Conda/Miniconda
Conda with Tarballs
Conda with Containers
DAGMan
DAGMan
Intermediate DAGMan: Uses and Features
Matlab Runtime
Matlab Runtime
Basics of compiled MATLAB applications - Hello World example
Scaling up MATLAB
Julia and Java
Julia and Java
Using Julia on the OSPool
Using Java in Jobs
Bioinformatics
Bioinformatics
FastQC Quality Control
High-Throughput BLAST
High-Throughput BWA Read Mapping
FreeSurfer
Drug Discovery
Drug Discovery
Running a Molecule Docking Job with AutoDock Vina
Additional Resources
Additional Resources
References
References
Acknowledge the OSG
Contact OSG for non-Support Inquiries
OSG Accounting (GRACC)
Ap7 access
The latest version of this guide is at
this link