{"id":1929,"date":"2020-06-26T12:10:33","date_gmt":"2020-06-26T19:10:33","guid":{"rendered":"https:\/\/in.nau.edu\/hpc\/?page_id=1929"},"modified":"2024-08-14T08:08:04","modified_gmt":"2024-08-14T15:08:04","slug":"checking-storage-usage-on-monsoon","status":"publish","type":"page","link":"https:\/\/in.nau.edu\/arc\/checking-storage-usage-on-monsoon\/","title":{"rendered":"Checking Storage Usage on Monsoon"},"content":{"rendered":"
Reaching storage capacity is a common issue for users. In your \/home<\/span> directory you’ll have about 10GB of storage capacity. Any large data files or programs should be put in your \/scratch<\/span> directory.<\/p>\n The command that will be most useful for you is getquotas<\/span>.<\/p>\n The #Bytes<\/span> column shows your storage usage and the Quota column shows your storage capacity. Your \/home<\/span> directory will have far less storage than your personal \/scratch<\/span> directory or that of any \/projects<\/span> directories you have. Avoid putting large data files or programs in \/home<\/span>, because it will fill up quickly.<\/p>\n The quota<\/span> command will also tell you how much storage is used and available for your \/home<\/span>.<\/p>\n When you are trying to free up space, you can use the du or find commands to identify large files you want to delete.<\/p>\n Here’s a du command example that will output in sorted order the largest files in your \/home<\/span> (largest files will be at the bottom of the output stream):<\/p>\n This is another example, this time using the find command, to identify files larger than 1GB:<\/p>\n Run the above command(s) in the directory where you are at or near capacity.<\/p>\n Once you find the files\/directories you want to remove you can use the rm<\/span> command.<\/p>\n Disclaimer: The rm<\/span> command is destructive. It will not keep a copy in a Trash directory like it would on a windows desktop. Once you run rm<\/span> you will not be able to recover your data.<\/p>\n If you have files that you want to move to another directory, run cp<\/span> to copy over to the new location, and then run rm<\/span> to remove your original copy.<\/p>\n The rm<\/span> and cp<\/span> commands need the -r<\/span> flag if you are working with directories. This will tell the program to recursively remove or copy, the contents of the directory.<\/p>\n If you have any questions feel free to contact us<\/a>. We have more online resources on our documentation page<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":" Checking Storage Usage on Monsoon Reaching storage capacity is a common issue for users. In your \/home directory you’ll have about 10GB of storage capacity. Any large data files or programs should be put in your \/scratch directory. Checking storage quota The command that will be most useful for you is getquotas. [abc123@wind ~ ]$ […]<\/p>\n","protected":false},"author":544,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"ring_central_script_selection":"","footnotes":""},"class_list":["post-1929","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/users\/544"}],"replies":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/comments?post=1929"}],"version-history":[{"count":21,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929\/revisions"}],"predecessor-version":[{"id":3592,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/1929\/revisions\/3592"}],"wp:attachment":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media?parent=1929"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Checking storage quota<\/h4>\n
[abc123@wind ~ ]$ getquotas\r\nFilesystem #Bytes Quota % | #Files Quota %\r\n\/home 5503M 10000M 55% | - - -\r\n\/scratch 184.3G 13.97T 1% | 310K 2M 15%\r\n[abc123@wind ~ ]$<\/code><\/pre>\nClearing up space<\/h4>\n
du -h --apparent-size --max-depth=1 ~\/ | sort -h<\/code><\/pre>\nfind ~\/ -type f -size +1G | xargs -d '\\n' du -h<\/code><\/pre>\nLearn More<\/h4>\n