{"id":1372,"date":"2017-01-19T10:50:38","date_gmt":"2017-01-19T15:50:38","guid":{"rendered":"http:\/\/localhost:8280\/?p=1372"},"modified":"2025-09-09T11:22:31","modified_gmt":"2025-09-09T15:22:31","slug":"dynamic-storage-aggreation-parallel-scratch-drive","status":"publish","type":"post","link":"https:\/\/knowledgebasev.kinsta.cloud\/?p=1372","title":{"rendered":"Dynamic Storage Aggregation &#8211; Single Namespace Parallel Drive on the fly"},"content":{"rendered":"<p>Sabalcore&#8217;s Dynamic Storage Aggregation (DSA) uses cutting-edge technology to aggregate the performance and capacity of all the local SSDs of the nodes used in a job. This dramatically increases I\/O performance. DSA can be used to provide an independent high-performance\u00a0shared parallel file system for the duration of the job.\u00a0This provides additional performance and a very\u00a0efficient way of burst buffering.<\/p>\n<p>DSA can be used to significantly boost the performance without requiring code changes by the user. DSA uses the performance of RDMA over Infiniband and aggregates the storage capacity of all the local drives and SSDs of the nodes of the job, creating a powerful, parallel file system in a single namespace. When the job completes, DSA wipes the drives before exiting. Best of all, there is no additional cost to use DSA &#8211; it is free!<\/p>\n<ul>\n<li>Aggregates all the local drives into one high-performance file system\u00a0(similar to RAID 0 or RAID10)<\/li>\n<li>Can increase I\/O<\/li>\n<li>Used by the head-node of the job<\/li>\n<li>Independent and secure<\/li>\n<li>Data can be copied to your home directory simultaneously<\/li>\n<li>Is created at the beginning of the job, then is completely torn down after job completes<\/li>\n<\/ul>\n<h5>How to Use DSA<\/h5>\n<p>To use DSA, simply add &#8220;-l other=scratch:shared&#8221; to the pbs directive and use $SCRATCH_SHARED for the directory. For example:<\/p>\n<p>Using a\u00a0.pbs script<\/p>\n<pre>#PBS -l nodes=4:blue:ppn=12 -l other=scratch:shared\r\ncd ~\/work\r\n# copy the input.dat file\r\ncp input.dat $SCRATCH_SHARED\r\n\r\n<\/pre>\n<p>Interactive Job<\/p>\n<pre>[user@sci ~]$ qsub -I -l nodes=4:ppn=12:copper -l other=scratch:shared\r\nqsub: waiting for job 566450.jman to start\r\nqsub: job 566450.jman ready\r\n[user@n724002 ~]$ echo $SCRATCH_SHARED\r\n\/mnt\/scratch\/566450.jman\r\n<\/pre>\n<pre><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>Sabalcore&#8217;s Dynamic Storage Aggregation (DSA) uses cutting-edge technology to aggregate the performance and capacity of all the local SSDs of the nodes used in a job. This dramatically increases I\/O performance. DSA can be used to provide an independent high-performance\u00a0shared parallel file system for the duration of the job.\u00a0This provides additional performance and a very\u00a0efficient [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1372","post","type-post","status-publish","format-standard","hentry","category-account"],"_links":{"self":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/1372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1372"}],"version-history":[{"count":8,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/1372\/revisions"}],"predecessor-version":[{"id":2061,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/1372\/revisions\/2061"}],"wp:attachment":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1372"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1372"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}