{"id":1929,"date":"2020-06-26T12:10:33","date_gmt":"2020-06-26T19:10:33","guid":{"rendered":"https:\/\/in.nau.edu\/hpc\/?page_id=1929"},"modified":"2024-08-14T08:08:04","modified_gmt":"2024-08-14T15:08:04","slug":"checking-storage-usage-on-monsoon","status":"publish","type":"page","link":"https:\/\/in.nau.edu\/arc\/checking-storage-usage-on-monsoon\/","title":{"rendered":"Checking Storage Usage on Monsoon"},"content":{"rendered":"<h1>Checking Storage Usage on Monsoon<\/h1>\n<p>Reaching storage capacity is a common issue for users. In your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/home<\/span> directory you&#8217;ll have about 10GB of storage capacity. Any large data files or programs should be put in your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/scratch<\/span> directory.<\/p>\n<h4>Checking storage quota<\/h4>\n<p>The command that will be most useful for you is <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">getquotas<\/span>.<\/p>\n<pre><code>[abc123@wind ~ ]$ getquotas\r\nFilesystem  #Bytes  Quota   %    |  #Files  Quota  %\r\n\/home       5503M   10000M  55%  |  -       -      -\r\n\/scratch    184.3G  13.97T  1%   |  310K    2M     15%\r\n[abc123@wind ~ ]$<\/code><\/pre>\n<p>The <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">#Bytes<\/span> column shows your storage usage and the Quota column shows your storage capacity. Your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/home<\/span> directory will have far less storage than your personal <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/scratch<\/span> directory or that of any <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/projects<\/span> directories you have. Avoid putting large data files or programs in <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/home<\/span>, because it will fill up quickly.<\/p>\n<p>The <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">quota<\/span> command will also tell you how much storage is used and available for your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/home<\/span>.<\/p>\n<h4>Clearing up space<\/h4>\n<p>When you are trying to free up space, you can use the du or find commands to identify large files you want to delete.<\/p>\n<p>Here&#8217;s a du command example that will output in sorted order the largest files in your <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">\/home<\/span> (largest files will be at the bottom of the output stream):<\/p>\n<pre><code>du -h --apparent-size --max-depth=1 ~\/ | sort -h<\/code><\/pre>\n<p>This is another example, this time using the find command, to identify files larger than 1GB:<\/p>\n<pre><code>find ~\/ -type f -size +1G | xargs -d '\\n' du -h<\/code><\/pre>\n<p>Run the above command(s) in the directory where you are at or near capacity.<\/p>\n<p>Once you find the files\/directories you want to remove you can use the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">rm<\/span> command.<\/p>\n<p>Disclaimer: The <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">rm<\/span> command is destructive. It will not keep a copy in a Trash directory like it would on a windows desktop. Once you run <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">rm<\/span> you will not be able to recover your data.<\/p>\n<p>If you have files that you want to move to another directory, run <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">cp<\/span> to copy over to the new location, and then run <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">rm<\/span> to remove your original copy.<\/p>\n<p>The <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">rm<\/span> and <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">cp<\/span> commands need the <span style=\"font-size: 16px; font-family: monospace; border: 1px solid; border-radius: 4px; padding: 0px 4px 0px; border-color: #BBBBBB;\">-r<\/span> flag if you are working with directories. This will tell the program to recursively remove or copy, the contents of the directory.<\/p>\n<h4>Learn More<\/h4>\n<p>If you have any questions feel free to <a href=\"https:\/\/in.nau.edu\/arc\/contact-us\/\">contact us<\/a>. We have more online resources on our <a href=\"https:\/\/in.nau.edu\/arc\/documentation-page\/\">documentation page<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Checking Storage Usage on Monsoon Reaching storage capacity is a common issue for users. In your \/home directory you&#8217;ll have about 10GB of storage capacity. Any large data files or programs should be put in your \/scratch directory. Checking storage quota The command that will be most useful for you is getquotas. [abc123@wind ~ ]$ [&hellip;]<\/p>\n","protected":false},"author":544,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","ring_central_script_selection":"","footnotes":""},"class_list":["post-1929","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/users\/544"}],"replies":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/comments?post=1929"}],"version-history":[{"count":21,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929\/revisions"}],"predecessor-version":[{"id":3592,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929\/revisions\/3592"}],"wp:attachment":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media?parent=1929"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}