{"id":71,"date":"2018-01-16T20:10:41","date_gmt":"2018-01-16T20:10:41","guid":{"rendered":"https:\/\/in.nau.edu\/hpc\/?page_id=71"},"modified":"2023-12-27T10:27:26","modified_gmt":"2023-12-27T17:27:26","slug":"using-the-cluster-advanced","status":"publish","type":"page","link":"https:\/\/in.nau.edu\/arc\/overview\/using-the-cluster-advanced\/","title":{"rendered":"Using the Cluster: Advanced"},"content":{"rendered":"<!-- shortcode-right-column -->\n<div class=\"shortcode-right-column\" >\n    <div class=\"shortcode-right-column__container\"><\/p>\n<p><!-- shortcode-contact -->\n<div class=\"shortcode-contact\">\n    <div class=\"contact-header\">\n        <h3>Contact Advanced Research Computing<\/h3>\n    <\/div>\n    <div class=\"contact-body\">\n                <a href=\"mailto:ask-arc@nau.edu\" aria-label=\"Contact Advanced Research Computing: Email Address\" title=\"Email Address\">\n            <div class=\"contact-icon-container\">\n                <i class=\"fas fa-envelope\" aria-hidden=\"true\"><\/i>\n                <span class=\"sr-only\">Email:<\/span>\n            <\/div>\n            <div class=\"contact-email\">ask-arc&#8203;@nau.edu<\/div>\n        <\/a>\n                    <\/div>\n<\/div>\n\n<\/p>\n<hr \/>\n<h2>Quick Links<\/h2>\n<ul>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/overview\/submitting-your-first-job\/\">Submitting your first job<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/request-storage\/\">Request storage<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-introduction\/\">Using the Cluster: Introduction<\/a><\/li>\n<li><a href=\"https:\/\/in.nau.edu\/hpc\/faqs\/\">FAQs<\/a><\/li>\n<\/ul>\n<hr \/>\n<p><\/div>\n<\/div>\n\n<h1>Using the Cluster: Advanced<\/h1>\n<p>Often researchers will find that they&#8217;ll need to take a small problem with one input reference and expand it to reference a large data set. And often when they are referencing this large data set they are doing the same operation on each sub set of the data (or file). Depending on the type of work, this could take a normal desktop computer a long time! \u00a0But with the aid of a computer cluster, a researcher can take a bit of time and create a script to do this expanded research very quickly.<\/p>\n<div class='shortcode-column-container'><!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p><!-- shortcode-image-callout -->\n<span class=\"shortcode-image-callout shortcode-image-callout--left\">\n    <a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-advanced\/parallelism\/\">    <span class=\"shortcode-image-callout__outer-container\">\n        <span class=\"shortcode-image-callout__container\">\n            <img loading=\"lazy\" decoding=\"async\" class=\"wp-image-140 size-square-image alignnone\" src=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-technology_12012014_29342575294_o-1-300x300.jpg\" alt=\"Computer board with circuits \" width=\"300\" height=\"300\" srcset=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-technology_12012014_29342575294_o-1-300x300.jpg 300w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-technology_12012014_29342575294_o-1-150x150.jpg 150w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-technology_12012014_29342575294_o-1-600x600.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n                        <span class=\"shortcode-image-callout__header-container\">\n                <span>Parallelism<\/span>\n            <\/span>\n                    <\/span>\n            <\/span>\n    <\/a><\/span>\n<\/p>\n<p>\n<\/div>\n\n<!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p><!-- shortcode-image-callout -->\n<span class=\"shortcode-image-callout shortcode-image-callout--left\">\n    <a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-advanced\/dependent-jobs\/\">    <span class=\"shortcode-image-callout__outer-container\">\n        <span class=\"shortcode-image-callout__container\">\n            <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-142 size-square-image\" src=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/pins-564775_1920-300x300.jpg\" alt=\"Close up view of Computer Processor\" width=\"300\" height=\"300\" srcset=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/pins-564775_1920-300x300.jpg 300w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/pins-564775_1920-150x150.jpg 150w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/pins-564775_1920-600x600.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n                        <span class=\"shortcode-image-callout__header-container\">\n                <span>Dependent jobs<\/span>\n            <\/span>\n                    <\/span>\n            <\/span>\n    <\/a><\/span>\n<\/p>\n<p>\n<\/div>\n\n<!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p><!-- shortcode-image-callout -->\n<span class=\"shortcode-image-callout shortcode-image-callout--left\">\n    <a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-advanced\/gpu-accelerated-jobs\/\">    <span class=\"shortcode-image-callout__outer-container\">\n        <span class=\"shortcode-image-callout__container\">\n            <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-145 size-square-image\" src=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/code-113611_1920-300x300.jpg\" alt=\"Computer Programming Code\" width=\"300\" height=\"300\" srcset=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/code-113611_1920-300x300.jpg 300w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/code-113611_1920-150x150.jpg 150w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/code-113611_1920-600x600.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n                        <span class=\"shortcode-image-callout__header-container\">\n                <span>GPU-accelerated jobs<\/span>\n            <\/span>\n                    <\/span>\n            <\/span>\n    <\/a><\/span>\n<\/p>\n<p>\n<\/div>\n<\/div>\n<div class='shortcode-column-container'><!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p><!-- shortcode-image-callout -->\n<span class=\"shortcode-image-callout shortcode-image-callout--left\">\n    <a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-advanced\/job-arrays\/\">    <span class=\"shortcode-image-callout__outer-container\">\n        <span class=\"shortcode-image-callout__container\">\n            <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-141 size-square-image\" src=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/programming-1896158_1920-1-300x300.jpg\" alt=\"Programming code displayed on computer screen\" width=\"300\" height=\"300\" srcset=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/programming-1896158_1920-1-300x300.jpg 300w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/programming-1896158_1920-1-150x150.jpg 150w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/programming-1896158_1920-1-600x600.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n                        <span class=\"shortcode-image-callout__header-container\">\n                <span>Job arrays<\/span>\n            <\/span>\n                    <\/span>\n            <\/span>\n    <\/a><\/span>\n<\/p>\n<p>\n<\/div>\n\n<!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p><!-- shortcode-image-callout -->\n<span class=\"shortcode-image-callout shortcode-image-callout--left\">\n    <a href=\"https:\/\/in.nau.edu\/hpc\/overview\/using-the-cluster-advanced\/dependent-arrays\/\">    <span class=\"shortcode-image-callout__outer-container\">\n        <span class=\"shortcode-image-callout__container\">\n            <img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-147 size-square-image\" src=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-tech-detail_02282014_29970040875_o-1-300x300.jpg\" alt=\"Back of computer server\" width=\"300\" height=\"300\" srcset=\"https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-tech-detail_02282014_29970040875_o-1-300x300.jpg 300w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-tech-detail_02282014_29970040875_o-1-150x150.jpg 150w, https:\/\/in.nau.edu\/wp-content\/uploads\/sites\/208\/2018\/01\/01-tech-detail_02282014_29970040875_o-1-600x600.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n                        <span class=\"shortcode-image-callout__header-container\">\n                <span>Dependent arrays<\/span>\n            <\/span>\n                    <\/span>\n            <\/span>\n    <\/a><\/span>\n<\/p>\n<p>\n<\/div>\n\n<!-- shortcode-column -->\n<div class=\"shortcode-column shortcode-column--count-3\">\n    <\/p>\n<p>&nbsp;<\/p>\n<p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Using the Cluster: Advanced Often researchers will find that they&#8217;ll need to take a small problem with one input reference and expand it to reference a large data set. And often when they are referencing this large data set they are doing the same operation on each sub set of the data (or file). Depending [&hellip;]<\/p>\n","protected":false},"author":76,"featured_media":145,"parent":49,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","ring_central_script_selection":"","footnotes":""},"class_list":["post-71","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/71","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/users\/76"}],"replies":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/comments?post=71"}],"version-history":[{"count":5,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/71\/revisions"}],"predecessor-version":[{"id":3125,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/71\/revisions\/3125"}],"up":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/pages\/49"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media\/145"}],"wp:attachment":[{"href":"https:\/\/in.nau.edu\/arc\/wp-json\/wp\/v2\/media?parent=71"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}