{"id":649,"date":"2018-06-12T23:06:41","date_gmt":"2018-06-12T23:06:41","guid":{"rendered":"https:\/\/in.nau.edu\/hpc\/?page_id=649"},"modified":"2025-01-09T10:58:49","modified_gmt":"2025-01-09T17:58:49","slug":"data-portal","status":"publish","type":"page","link":"https:\/\/in.nau.edu\/arc\/data-portal\/","title":{"rendered":"Data Portal"},"content":{"rendered":"<!-- shortcode-right-column -->\n<div class=\"shortcode-right-column\" >\n    <div class=\"shortcode-right-column__container\"><\/p>\n<p><!-- shortcode-contact -->\n<div class=\"shortcode-contact\">\n    <div class=\"contact-header\">\n        <h3>Advanced Research Computing<\/h3>\n    <\/div>\n    <div class=\"contact-body\">\n                <a href=\"mailto:ask-arc@nau.edu\" aria-label=\"Advanced Research Computing: Email Address\" title=\"Email Address\">\n            <div class=\"contact-icon-container\">\n                <i class=\"fas fa-envelope\" aria-hidden=\"true\"><\/i>\n                <span class=\"sr-only\">Email:<\/span>\n            <\/div>\n            <div class=\"contact-email\">ask-arc&#8203;@nau.edu<\/div>\n        <\/a>\n                    <\/div>\n<\/div>\n\n<\/p>\n<hr \/>\n<h2>Quick Links<\/h2>\n<ul>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/request-storage\/\">Request Long-Term Storage<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/arc\/overview\/connecting-to-monsoon\/\">Connecting to Monsoon<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/obtaining-an-account\/\">Request a Monsoon Account<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/arc\/faqs\/\">Frequently Asked Questions (Monsoon)<\/a><\/li>\n<\/ul>\n<hr \/>\n<p><\/div>\n<\/div>\n\n<h1>Data Portal<\/h1>\n<p>Researchers utilizing Monsoon&#8217;s compute power now have the ability to share project data with colleagues via a web browser. Any individual files or directories in your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects\/&lt;project_name&gt;\/<\/span> folder can be shared. No file is too large, or too small.<\/p>\n<p><em>A long-term storage space is required for this service to work. To obtain a long-term storage space, please request one on the <a href=\"https:\/\/in.nau.edu\/hpc\/request-storage\/\">long-term storage request<\/a>.<\/em><\/p>\n<!-- shortcode-accordion -->\n<div class=\"shortcode-accordion shortcode-accordion--closed\" style=\"position: relative;\" >\n        <a class=\"shortcode-accordion__trigger\" data-header=\"Publishing data_0\" href=\"#\">\n      <div class=\"shortcode-accordion__header\">\n          <h4>Publishing data <span class=\"screen-reader-text\">Accordion Closed<\/span><\/h4>\n          <span class=\"shortcode-accordion__header__arrow\"><\/span>\n      <\/div>\n    <\/a>\n    <div class=\"shortcode-accordion__body\">\n        <!DOCTYPE html PUBLIC \"-\/\/W3C\/\/DTD HTML 4.0 Transitional\/\/EN\" \"http:\/\/www.w3.org\/TR\/REC-html40\/loose.dtd\">\n<html><body>\n<p>To share data using the data portal, perform the following steps while <a href=\"https:\/\/in.nau.edu\/arc\/overview\/connecting-to-monsoon\/\">SSH&rsquo;d into Monsoon<\/a>:<\/p>\n<ol start=\"1\">\n<li>Change directory to your project directory. The publish script must be ran there. For example, if your project is called <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">hpc_project<\/span>, you&rsquo;d run:<\/li>\n<\/ol>\n<p><code>cd \/projects\/hpc_project<\/code><\/p>\n<ol start=\"2\">\n<li>Run the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">publish_data<\/span> script. When provided with no files to publish, it will print some usage information. If one or more files and\/or directories are specified, those files and\/or directories will be published to the web.For example, if you wanted to publish the following files and directories:\n<pre>- <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects\/hpc_project\/january_results<\/span>\r\n- <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects\/hpc_project\/computational_data\/dataset1.csv<\/span>\r\n- <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects\/hpc_project\/computational_data\/dataset2.txt<\/span>\r\n<\/pre>\n<p>You would run:<br>\n<code>publish_data january_results computational_data\/dataset1.csv computational_data\/dataset2.txt<\/code><\/p><\/li>\n<\/ol>\n<ol start=\"3\">\n<li>Your data can now be accessed at <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">https:\/\/rcdata.nau.edu\/&lt;project_name&gt;<\/span>. Using the previous examples, the URL would be <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">https:\/\/rcdata.nau.edu\/hpc_project<\/span>.<\/li>\n<\/ol>\n<\/body><\/html>\n\n    <\/div>\n<\/div>\n\n<!-- shortcode-accordion -->\n<div class=\"shortcode-accordion shortcode-accordion--closed\" style=\"position: relative;\" >\n        <a class=\"shortcode-accordion__trigger\" data-header=\"Unpublishing data_0\" href=\"#\">\n      <div class=\"shortcode-accordion__header\">\n          <h4>Unpublishing data <span class=\"screen-reader-text\">Accordion Closed<\/span><\/h4>\n          <span class=\"shortcode-accordion__header__arrow\"><\/span>\n      <\/div>\n    <\/a>\n    <div class=\"shortcode-accordion__body\">\n        <!DOCTYPE html PUBLIC \"-\/\/W3C\/\/DTD HTML 4.0 Transitional\/\/EN\" \"http:\/\/www.w3.org\/TR\/REC-html40\/loose.dtd\">\n<html><body>\n<p>If you wish to unpublish files, the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">unpublish_data<\/span> script works similarly:<\/p>\n<ol start=\"1\">\n<li>Change directory to your project directory.<br>\nFor example, if your project is called <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">hpc_project<\/span>, you&rsquo;d run:<br>\n<code>cd \/projects\/hpc_project<\/code><\/li>\n<\/ol>\n<ol start=\"2\">\n<li>Run the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">unpublish_data<\/span> script. For example, to unpublish the following files:\n<pre>- <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">dataset1.csv<\/span> \r\n- <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">january_results\/bad_results.out<\/span>\r\n<\/pre>\n<p>you would run:<br>\n<code>unpublish_data january_results\/bad_results.out computational_data\/dataset1.csv<\/code><br>\nif you wanted to unpublish all of the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">january_results<\/span> directory, you&rsquo;d run:<br>\n<code>unpublish_data january_results<\/code><\/p><\/li>\n<\/ol>\n<p>Once done, the data will still be in your project directory, but will no longer appear on the web.<\/p>\n<\/body><\/html>\n\n    <\/div>\n<\/div>\n\n<!-- shortcode-accordion -->\n<div class=\"shortcode-accordion shortcode-accordion--closed\" style=\"position: relative;\" >\n        <a class=\"shortcode-accordion__trigger\" data-header=\"Optionally securing your data_0\" href=\"#\">\n      <div class=\"shortcode-accordion__header\">\n          <h4>Optionally securing your data <span class=\"screen-reader-text\">Accordion Closed<\/span><\/h4>\n          <span class=\"shortcode-accordion__header__arrow\"><\/span>\n      <\/div>\n    <\/a>\n    <div class=\"shortcode-accordion__body\">\n        <!DOCTYPE html PUBLIC \"-\/\/W3C\/\/DTD HTML 4.0 Transitional\/\/EN\" \"http:\/\/www.w3.org\/TR\/REC-html40\/loose.dtd\">\n<html><body>\n<p>To secure your data so only users with authorized credentials can access your published data, use the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">secure_published_data<\/span> script to secure your published site.<\/p>\n<p><code>secure_published_data \/projects\/hpc_project<\/code><\/p>\n<p>The script will create a file under <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects\/hpc_project\/public_data\/<\/span> called <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">.htaccess<\/span> and will&nbsp;automatically fill it with the following contents:<\/p>\n<p><code>AuthType Basic<br>\nAuthName \"Restricted Area\"<br>\nAuthUserFile \"\/projects\/hpc_project\/.htpasswd\"<br>\nrequire valid-user<\/code><\/p>\n<p>The <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">secure_published_data<\/span> script will also ask you if you would like to add your first user. To add your first user, navigate to your projects folder and run the following command:<\/p>\n<p><code>htpasswd -cB .htpasswd &lt;username&gt;<\/code><\/p>\n<p>To add subsequent users, navigate to your projects folder and run the following command:<\/p>\n<p><code>htpasswd -B .htpasswd &lt;username&gt;<\/code><\/p>\n<p>To change the password of a user, you can re-run the command above for the target user.<\/p>\n<\/body><\/html>\n\n    <\/div>\n<\/div>\n\n<!-- shortcode-accordion -->\n<div class=\"shortcode-accordion shortcode-accordion--closed\" style=\"position: relative;\" >\n        <a class=\"shortcode-accordion__trigger\" data-header=\"FAQs_0\" href=\"#\">\n      <div class=\"shortcode-accordion__header\">\n          <h4>FAQs <span class=\"screen-reader-text\">Accordion Closed<\/span><\/h4>\n          <span class=\"shortcode-accordion__header__arrow\"><\/span>\n      <\/div>\n    <\/a>\n    <div class=\"shortcode-accordion__body\">\n        <!DOCTYPE html PUBLIC \"-\/\/W3C\/\/DTD HTML 4.0 Transitional\/\/EN\" \"http:\/\/www.w3.org\/TR\/REC-html40\/loose.dtd\">\n<html><body>\n<p><strong>What happens when I delete files in my project area that have been published?<\/strong><\/p>\n<p>The files remain published.<\/p>\n<p><strong>What happens when I manually delete files from the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">public_data<\/span> area?<\/strong><\/p>\n<p>The files are unpublished effectively. The files that were published still remain in your project area.<br>\n<\/p><\/body><\/html>\n\n    <\/div>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>Data Portal Researchers utilizing Monsoon&#8217;s compute power now have the ability to share project data with colleagues via a web browser. Any individual files or directories in your \/projects\/&lt;project_name&gt;\/ folder can be shared. No file is too large, or too small. A long-term storage space is required for this service to work. To obtain a [&hellip;]<\/p>\n","protected":false},"author":180,"featured_media":656,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","ring_central_script_selection":"","footnotes":""},"class_list":["post-649","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/649","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/users\/180"}],"replies":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/comments?post=649"}],"version-history":[{"count":17,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/649\/revisions"}],"predecessor-version":[{"id":3749,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/649\/revisions\/3749"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media\/656"}],"wp:attachment":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media?parent=649"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}