You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/data_management/index.md
+11-1Lines changed: 11 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,4 +2,14 @@
2
2
3
3
Proper research data management ensures security, compliance, and operational efficiency, while ensuring that only authorized individuals have access to specific data. Researchers and users of Cheaha are responsible for organizing their data and backing up critical information.
4
4
5
-
This page provides an overview of the storage options and data transfer tools available for research projects. It also highlights best practices for managing, sharing, and preserving research data, as well as the roles and responsibilities of researchers.
5
+
This page provides an overview of the storage options and data transfer tools available for research projects. It also highlights good practices for managing, sharing, and preserving research data, as well as the roles and responsibilities of researchers and research computing teams.
6
+
7
+
We covered the following topics:
8
+
9
+
-[Storage Service](./storage/index.md): This section explains the types of storage available, their use cases, and how to access them. We provide multiple storage options for research projects, including:
-[Data Transfer Tools](./transfer/index.md): Various tools are available for transferring data to, from, and between our storage systems, including: [Globus](./transfer/globus/index.md), [Rclone](./transfer/rclone.md), and [FileZilla](./transfer/filezilla.md). Step-by-step tutorials for [Globus](./transfer/tutorial/index.md) are also provided to help you transfer data between our storage systems.
15
+
-[Research Data Responsibilities](./research_data_responsibilities.md): This section explains the roles and responsibilities in research data management. It covers the responsibilities of researchers and research computing teams, provides guidelines for managing, sharing, and preserving research data, and describes good practices for handling shared allocations.
Copy file name to clipboardExpand all lines: docs/data_management/storage/cheaha_storage_gpfs/individual_directories.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,7 @@ Quota reports are updated nightly, so they may be out of date if you move data a
32
32
This section outlines key storage policies and exceptions, including access control, data management, and conditions for administrative access or quota increases in user data and home directories.
33
33
34
34
- Storage Entitlement: All users receive a 5TB of default quota upon creating a Cheaha account.
35
-
- Quota Increase: At this time, we do not provide a quota increase in user data and home directories. If you require more storage for your work, please consider using [shared project allocation](./project_directories.md) or an [LTS](../../../data_management/storage/lts/index.md).
35
+
- Quota Increase: At this time, we do not provide a quota increase in user data and home directories. If you require more storage for your work, please consider using [shared project allocation](./project_directories.md) or an [LTS](../lts/index.md).
36
36
- Data Management: Users are responsible for organizing, cleaning, and backing up their data in their user data and home directory.
37
-
- Permission and Access Control Management: Access in user data and home directories can be managed using Access Control Lists (ACLs). Where third-party access is required, a security exception may apply. Please refer to the [Security Exception](../../../data_management/research_data_responsibilities.md#security-exceptions-for-accessing-former-uab-personnel-data) page for more details.
38
-
- HIPAA Compliance: Users data and home directories are HIPAA compliant and can accept Protected Health Information (PHI) data. For HIPAA Compliance and UAB policies surrounding PHI data, please refer the [HIPAA Compliance](../../../data_management/storage/index.md#hipaa-compliance)page.
37
+
- Permission and Access Control Management: Access in user data and home directories can be managed using Access Control Lists (ACLs). Where third-party access is required, a security exception may apply. Please refer to the [Security Exception](../../research_data_responsibilities.md#security-exceptions-for-accessing-former-uab-personnel-data) page for more details.
38
+
- HIPAA Compliance: Users data and home directories are HIPAA compliant and can accept Protected Health Information (PHI) data. For HIPAA Compliance and UAB policies surrounding PHI data, please refer the [HIPAA Compliance](../../storage/index.md#hipaa-compliance)page.
Copy file name to clipboardExpand all lines: docs/data_management/transfer/globus/index.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
<!-- markdownlint-disable MD046 -->
4
4
!!! announcement
5
5
6
-
We are aware of reduced transfer speed into and out of [Long-Term Storage (LTS)] when using Globus and are working on a solution. For some use cases, [`s5cmd`](../../../data_management/storage/lts/interfaces.md#s5cmd) may be a faster alternative. Please see [Our News Section](../../../news/posts/2025-04-07-reduced-lts-transfer-speeds-on-globus.md) for more information.
6
+
We are aware of reduced transfer speed into and out of [Long-Term Storage (LTS)] when using Globus and are working on a solution. For some use cases, [`s5cmd`](../../storage/lts/interfaces.md#s5cmd) may be a faster alternative. Please see [Our News Section](../../../news/posts/2025-04-07-reduced-lts-transfer-speeds-on-globus.md) for more information.
7
7
<!-- markdownlint-enable MD046 -->
8
8
9
9
Globus is a powerful tool for robustly and securely managing data transfers to and from collaborators and within UAB Research Computing. Globus is recommended for most single-use, day-to-day data transfer use-cases.
@@ -119,7 +119,7 @@ Below the "Transfer Settings", there are additional options available that you c
119
119
120
120
### Project Space Permissions
121
121
122
-
Globus does not preserve permissions nor ownership when data is transferred, instead using whatever permissions are default at the target location, and making the owner the authenticated user who initiated the transfer. Typically this is not an issue, but may cause problems for [Project Storage directories](../../storage/index.md#what-shared-storage-solutions-are-available). Please see our [Project Directory Permissions Section](../../../data_management/storage/cheaha_storage_gpfs/project_directories.md#project-directory-permissions) for more information.
122
+
Globus does not preserve permissions nor ownership when data is transferred, instead using whatever permissions are default at the target location, and making the owner the authenticated user who initiated the transfer. Typically this is not an issue, but may cause problems for [Project Storage directories](../../storage/index.md#what-shared-storage-solutions-are-available). Please see our [Project Directory Permissions Section](../../storage/cheaha_storage_gpfs/project_directories.md#project-directory-permissions) for more information.
123
123
124
124
### More Information
125
125
@@ -138,16 +138,16 @@ To use the UAB Box Connector, [search for a collection/endpoint](#moving-data-be
138
138
<!-- markdownlint-disable MD046 -->
139
139
!!! important
140
140
141
-
[LTS](../../../data_management/storage/lts/index.md) behaves differently from other file systems and comes with a few possible pitfalls. Keep in mind the following three rules: (1) all data must be in buckets, (2) buckets are only allowed in the root folder, and (3) buckets must have unique names.
141
+
[LTS](../../storage/lts/index.md) behaves differently from other file systems and comes with a few possible pitfalls. Keep in mind the following three rules: (1) all data must be in buckets, (2) buckets are only allowed in the root folder, and (3) buckets must have unique names.
142
142
<!-- markdownlint-enable MD046 -->
143
143
144
-
To use the UAB [LTS](../../../data_management/storage/lts/index.md) Connector, [search for a collection/endpoint](#moving-data-between-collections) like usual and enter "UAB LTS" into the search box. Select the endpoint labeled "UAB Research Computing LTS (Long Term Storage aka S3)". If you have stored data within LTS already you should see a list of folders, otherwise you will see an empty space where folders may be placed. Each folder corresponds to a [bucket](../../../data_management/storage/lts/index.md#terminology) in LTS. To create a bucket, click "New Folder" in the "File Manager" window in Globus. Note that buckets must have globally unique names. Read on for more information about possible pitfalls.
144
+
To use the UAB [LTS](../../storage/lts/index.md) Connector, [search for a collection/endpoint](#moving-data-between-collections) like usual and enter "UAB LTS" into the search box. Select the endpoint labeled "UAB Research Computing LTS (Long Term Storage aka S3)". If you have stored data within LTS already you should see a list of folders, otherwise you will see an empty space where folders may be placed. Each folder corresponds to a [bucket](../../storage/lts/index.md#terminology) in LTS. To create a bucket, click "New Folder" in the "File Manager" window in Globus. Note that buckets must have globally unique names. Read on for more information about possible pitfalls.
145
145
146
146

147
147
148
148
#### Adding LTS Allocation Credentials
149
149
150
-
Before you can manage an LTS allocation using Globus, you'll need to add the [LTS S3 Access and Secret Keys](../../../data_management/storage/lts/index.md#requesting-an-allocation) to the LTS endpoint. To do so, please follow the instructions given below.
150
+
Before you can manage an LTS allocation using Globus, you'll need to add the [LTS S3 Access and Secret Keys](../../storage/lts/index.md#requesting-an-allocation) to the LTS endpoint. To do so, please follow the instructions given below.
151
151
152
152
1. In your browser, navigate to <https://app.globus.org> and login using UAB SSO.
153
153
1. Click "Collections" in the left-hand navigation pane.
- Compatible with [UAB Box](https://www.uab.edu/it/home/tech-solutions/file-storage/box).
32
-
- Compatible with [Long-Term Storage](../../../data_management/storage/lts/index.md).
32
+
- Compatible with [Long-Term Storage](../../storage/lts/index.md).
33
33
- Can be used with your laptop, desktop, or lab workstation via Globus Connect Personal (GCP).
34
34
- Transfers are automatically retried in the event of network or computer system outages.
35
35
- Transfers are encrypted end-to-end. Globus never sees your data.
@@ -135,7 +135,7 @@ If you can't find a particular Collection this way, but know it was shared with
135
135
136
136
UAB offers [multiple storage resources](../../index.md). The following resources may be accessed through Globus Collections.
137
137
138
-
- Cheaha file system (GPFS) including [individual directories](../../storage/index.md#what-individual-storage-solutions-are-available) and [project directories](../../../data_management/storage/cheaha_storage_gpfs/project_directories.md).
138
+
- Cheaha file system (GPFS) including [individual directories](../../storage/index.md#what-individual-storage-solutions-are-available) and [project directories](../../storage/cheaha_storage_gpfs/project_directories.md).
@@ -255,7 +255,7 @@ From here you can proceed to other related tutorials to initiate other transfers
255
255
256
256
## How Do I Transfer Between a Collection and LTS?
257
257
258
-
Please use the following instructions to transfer data from a Collection to a [bucket on LTS](../../../data_management/storage/lts/index.md). These instructions may also be used for other directories on Cheaha, provided you have access and know their file path.
258
+
Please use the following instructions to transfer data from a Collection to a [bucket on LTS](../../storage/lts/index.md). These instructions may also be used for other directories on Cheaha, provided you have access and know their file path.
259
259
260
260
The direction of transfer may also be reversed to transfer data from LTS to the destination Collection. Note that some Collections may not allow you to transfer data back, such as some of those provided by Research Cores.
0 commit comments