High Performance Computing

Data portal

Researchers utilizing monsoon’s compute power now have the ability to share project data with colleagues via a web browser. Any individual files or directories in your /projects/<project_name> can be shared. No file is too large, or too small.

* Note that a long-term storage space is required for this service to work. To obtain a long-term storage space, please request one on the long-term storage request .

To share data, perform the following steps:

Change directory to your project directory. The publish script must be ran there. For example, if your project is called hpc_project, you’d run:
```
cd /projects/hpc_project
```

Run the publish_data script. When provided with no files to publish, it will print some usage information. If one or more files and/or directories are specified, those files and/or directories will be published to the web.
For example, if you wanted to publish the following files and directories:

– /projects/hpc_project/january_results
– /projects/hpc_project/computational_data/dataset1.csv
– /projects/hpc_project/computational_data/dataset2.txt

You would run:

publish_data january_results computational_data/dataset1.csv computational_data/dataset2.txt

Your data can now be accessed at rcdata.nau.edu/<project_name>. Using the previous examples, the URL would be
https://rcdata.nau.edu/hpc_project

If you wish to unpublish files, the unpublish_data script works similarly:

Change directory to your project directory.
For example, if your project is called hpc_project, you’d run:
```
cd /projects/hpc_project
```

Run the unpublish_data script. For example, to unpublish the following files:
```
- dataset1.csv 
- january_results/bad_results.out
```
you would run:

unpublish_data january_results/bad_results.out computational_data/dataset1.csv

if you wanted to unpublish all of the january_results directory, you’d run:

unpublish_data january_results

Once done, the data will still be in your project directory, but will no longer appear on the web.

Create a file named ‘.htaccess’ inside of the public_data directory within your project folder. In that file, add the following content, with the file path made to reflect your project path:
AuthType Basic AuthName "Restricted Area" AuthUserFile "/projects/hpcproject/public_data/.htpasswd" require valid-user

Now, to create valid users:
First user:

htpasswd -c -s .htpasswd bob

Subsequent users:

htpasswd -s .htpasswd alice

Note only the first user needs -c, to create the .htaccess file. From then on, only Bob and Alice will have access to your site.

What happens when I delete files in my project area that have been published?

The files remain published.

What happens when I manually delete files from the public_data area?

The files are unpublished effectively. The files that were published still remain in your project area.

High Performance Computing

Data portal

Publishing data Accordion Closed

Unpublishing data Accordion Closed

Optionally securing your data Accordion Closed

FAQs Accordion Closed