<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Cloud Costs | 2i2c</title><link>https://deploy-preview-646--2i2c-org.netlify.app/tag/cloud-costs/</link><atom:link href="https://deploy-preview-646--2i2c-org.netlify.app/tag/cloud-costs/index.xml" rel="self" type="application/rss+xml"/><description>Cloud Costs</description><generator>Hugo Blox Builder (https://hugoblox.com)</generator><language>en-us</language><lastBuildDate>Thu, 08 Oct 2026 00:00:00 +0000</lastBuildDate><image><url>https://deploy-preview-646--2i2c-org.netlify.app/media/sharing.png</url><title>Cloud Costs</title><link>https://deploy-preview-646--2i2c-org.netlify.app/tag/cloud-costs/</link></image><item><title>Giving users a dedicated /tmp disk with Kubernetes ephemeral volumes</title><link>https://deploy-preview-646--2i2c-org.netlify.app/blog/dedicated-tmp-disks/</link><pubDate>Thu, 08 Oct 2026 00:00:00 +0000</pubDate><guid>https://deploy-preview-646--2i2c-org.netlify.app/blog/dedicated-tmp-disks/</guid><description>&lt;p>We recently figured out a simple way to give individual users their own &lt;code>/tmp&lt;/code> folder so that they have more space in a cost-effective way.
&lt;code>/tmp&lt;/code> is often used for storing intermediate data files and processing steps, but a few communities like &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/nasa-veda/" >MAAP&lt;/a> and &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/earthscope/" >EarthScope&lt;/a> were running into size limits.
We could always increase the total size of the disk, but this increases a steady-state cost, which is overkill for something that is inherently ephemeral.
By using dedicated, temporary storage for the &lt;code>/tmp&lt;/code> folder, we can make it more cost-effective to dynamically grow (and shrink) the space available to users.&lt;/p>
&lt;p>
&lt;figure >
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="The server options page, with a &amp;amp;ldquo;Scratch Disk on /tmp&amp;amp;rdquo; dropdown offering a dedicated 500GB disk" srcset="
/blog/dedicated-tmp-disks/featured_huf33a6af57d216f871f66790be8369556_89279_e144ec2d32abe594f6b8a06a079d9dba.webp 400w,
/blog/dedicated-tmp-disks/featured_huf33a6af57d216f871f66790be8369556_89279_2832d274112f717e703ca42969eaaa0d.webp 760w,
/blog/dedicated-tmp-disks/featured_huf33a6af57d216f871f66790be8369556_89279_1200x1200_fit_q75_h2_lanczos_3.webp 1200w"
src="https://deploy-preview-646--2i2c-org.netlify.app/blog/dedicated-tmp-disks/featured_huf33a6af57d216f871f66790be8369556_89279_e144ec2d32abe594f6b8a06a079d9dba.webp"
width="760"
height="488"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;/figure>
&lt;em>Choosing a dedicated &lt;code>/tmp&lt;/code> disk on the MAAP staging hub.&lt;/em>&lt;/p>
&lt;p>This builds on top of the &lt;a href="https://kubernetes.io/docs/concepts/storage/ephemeral-volumes/" target="_blank" rel="noopener" >ephemeral volumes&lt;/a> feature of Kubernetes, which our team recently discovered!
These attach a cloud disk to a single user&amp;rsquo;s server, and Kubernetes deletes the disk when the server stops.&lt;/p>
&lt;p>We built on the &lt;a href="https://2i2c.org/jupyterhub-fancy-profiles/stable/" target="_blank" rel="noopener" >JupyterHub Fancy Profiles&lt;/a> project to add a dropdown for users to pick a dedicated &lt;code>/tmp&lt;/code> disk and how big they want it to be (see ths PR to learn more: &lt;a href="https://github.com/2i2c-org/infrastructure/pull/9112%29" target="_blank" rel="noopener" >&lt;i class='fa-brands fa-github'>&lt;/i> 2i2c-org/infrastructure#9112)&lt;/a>.&lt;/p>
&lt;h2 id="learn-more">
Learn more
&lt;a class="header-anchor" href="#learn-more">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>&lt;a href="https://docs.2i2c.org/user/data/filesystem/#filesystem-tmp-dedicated" target="_blank" rel="noopener" >User docs on dedicated &lt;code>/tmp&lt;/code> disks&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://docs.2i2c.org/admin/monitoring/disk-usage/" target="_blank" rel="noopener" >Admin docs on dedicated &lt;code>/tmp&lt;/code> disks&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://github.com/2i2c-org/initiatives/issues/61" target="_blank" rel="noopener" >The initiative that asked for faster scratch space&lt;/a>&lt;/li>
&lt;/ul></description></item><item><title>Adding User Group Insights to Cloud Cost Dashboards with Grafana</title><link>https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-groups/</link><pubDate>Mon, 24 Nov 2025 00:00:00 +0000</pubDate><guid>https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-groups/</guid><description>&lt;p>We are excited to announce that we have extended our cloud cost dashboards to support display costs filtered by user groups using Grafana! This new feature allows administrators to monitor and manage cloud expenses based on user group memberships in JupyterHub.&lt;/p>
&lt;p>
&lt;figure >
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Group cloud cost dashboard showing cost breakdowns by user groups" srcset="
/blog/cloud-cost-groups/featured_hu34fd6e3a049030056ef3072c1a0427ac_131153_c2b7e8d83fe14bfbc24fc804e952e390.webp 400w,
/blog/cloud-cost-groups/featured_hu34fd6e3a049030056ef3072c1a0427ac_131153_694d12ebbde0c6b897972885357ca71d.webp 760w,
/blog/cloud-cost-groups/featured_hu34fd6e3a049030056ef3072c1a0427ac_131153_1200x1200_fit_q75_h2_lanczos_3.webp 1200w"
src="https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-groups/featured_hu34fd6e3a049030056ef3072c1a0427ac_131153_c2b7e8d83fe14bfbc24fc804e952e390.webp"
width="760"
height="388"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;/figure>
&lt;/p>
&lt;div class="alert alert-">
&lt;div>
Available for dedicated AWS clusters only (and excluding CloudBank managed accounts). Other deployments on GCP will be supported in the future.
&lt;/div>
&lt;/div>
&lt;h2 id="learn-more">
Learn more
&lt;a class="header-anchor" href="#learn-more">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>Take a look at the &lt;a href="https://docs.2i2c.org/admin/monitoring/cost-users-groups/#group-cloud-costs" target="_blank" rel="noopener" >Community Hub Guide&lt;/a> to see what&amp;rsquo;s new&lt;/li>
&lt;li>Check out the documentation of the &lt;a href="https://jupyterhub-cost-monitoring.readthedocs.io/en/latest/" target="_blank" rel="noopener" >2i2c-org/jupyterhub-cost-monitoring&lt;/a> project to see how it all works&lt;/li>
&lt;li>&lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/author/jenny-wong/" >Jenny&lt;/a> recently presented her work on the cost monitoring system at &lt;a href="https://events.linuxfoundation.org/jupytercon/" target="_blank" rel="noopener" >JupyterCon 2025&lt;/a> earlier this month. Watch a &lt;a href="https://youtu.be/M5x3bTgRzVs?si=P2c3Ngb8v7f4ks0I" target="_blank" rel="noopener" >video&lt;/a> or look at the &lt;a href="https://docs.google.com/presentation/d/1N8V7dna1atpRmcbpgZ0-VL5cbOQfwYfXTstudT2ierY/edit?usp=sharing" target="_blank" rel="noopener" >slides&lt;/a>.&lt;/li>
&lt;/ul>
&lt;a href="https://docs.google.com/forms/d/e/1FAIpQLSff-u-sWFuwO1-VTgk2Ir7f1nfUUlLevQk_Vkk_jnmcI1nJnw/viewform?usp=pp_url&amp;amp;entry.648332035=https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-groups/" target="_blank" rel="noopener" class="text-decoration-none">
&lt;div class="alert alert-info d-flex align-items-start p-3" role="button" style="transition: all 0.2s ease; box-shadow: 0 2px 4px rgba(0,0,0,0.1);" onmouseover="this.style.backgroundColor='#b3e5fc'; this.style.boxShadow='0 4px 8px rgba(0,0,0,0.15)'; this.style.transform='translateY(-1px)'" onmouseout="this.style.backgroundColor=''; this.style.boxShadow='0 2px 4px rgba(0,0,0,0.1)'; this.style.transform='translateY(0)'" onfocus="this.style.backgroundColor='#b3e5fc'; this.style.boxShadow='0 4px 8px rgba(0,0,0,0.15)'; this.style.transform='translateY(-1px)'" onblur="this.style.backgroundColor=''; this.style.boxShadow='0 2px 4px rgba(0,0,0,0.1)'; this.style.transform='translateY(0)'">
&lt;div class="fw-bold mb-1">&lt;span style="font-weight:bold">Give us feedback!&lt;/span> Click here to provide feedback that will help us make this more impactful.&lt;/div>
&lt;/div>
&lt;/a>
&lt;h2 id="acknowledgements">
Acknowledgements
&lt;a class="header-anchor" href="#acknowledgements">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>&lt;a href="https://github.com/sunu" target="_blank" rel="noopener" >Tarashish&lt;/a> @ &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/devseed/" >Development Seed&lt;/a> for collaborating on this project with us.&lt;/li>
&lt;li>&lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/nasa-veda/" >NASA VEDA&lt;/a> and the DSE Team at NASA MSFC ODSI for funding much of this work.&lt;/li>
&lt;li>&lt;a href="https://github.com/kyle-lesinger" target="_blank" rel="noopener" >Kyle Lesinger&lt;/a> from the NASA MSFC Office of Data Science and Informatics for providing valuable feedback and bug reports during development.&lt;/li>
&lt;/ul></description></item><item><title>Enabling transparent cloud cost monitoring with user-level dashboards</title><link>https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-monitoring/</link><pubDate>Tue, 30 Sep 2025 00:00:00 +0000</pubDate><guid>https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-monitoring/</guid><description>&lt;p>We are excited to announce that &lt;strong>dashboards to monitor cloud usage and costs at a per-user level&lt;/strong> are now available! See the &lt;a href="https://docs.2i2c.org/admin/monitoring/cost-users" target="_blank" rel="noopener" >cost monitoring documentation&lt;/a> for more information.&lt;/p>
&lt;p>A key goal of 2i2c is to make the cloud safe for science. By providing transparent cost monitoring, we give communities the confidence that they won&amp;rsquo;t face unexpected bills and can better understand how their usage patterns translate to cloud costs. This visibility is especially valuable in our shared platform model, where each community gets their own independent hub while benefiting from shared infrastructure expertise.&lt;/p>
&lt;p>
&lt;figure >
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="Cloud cost monitoring dashboard showing user-level usage and cost breakdowns" srcset="
/blog/cloud-cost-monitoring/featured_huf9d99e2c2d9f92e6fb1ca11e35925122_105209_ad88b7920c8a8ef63cb6031d96b8917d.webp 400w,
/blog/cloud-cost-monitoring/featured_huf9d99e2c2d9f92e6fb1ca11e35925122_105209_cb20ec3b020712afb2b8d73e53f13db8.webp 760w,
/blog/cloud-cost-monitoring/featured_huf9d99e2c2d9f92e6fb1ca11e35925122_105209_1200x1200_fit_q75_h2_lanczos_3.webp 1200w"
src="https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-monitoring/featured_huf9d99e2c2d9f92e6fb1ca11e35925122_105209_ad88b7920c8a8ef63cb6031d96b8917d.webp"
width="760"
height="427"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;/figure>
&lt;/p>
&lt;p>The user-level cost breakdown allows communities to identify individual usage trends and manage their resources more effectively. Communities can now see exactly how their computational work translates to cloud spending, enabling better resource planning and budget management.&lt;/p>
&lt;a href="https://docs.google.com/forms/d/e/1FAIpQLSff-u-sWFuwO1-VTgk2Ir7f1nfUUlLevQk_Vkk_jnmcI1nJnw/viewform?usp=pp_url&amp;amp;entry.648332035=https://deploy-preview-646--2i2c-org.netlify.app/blog/cloud-cost-monitoring/" target="_blank" rel="noopener" class="text-decoration-none">
&lt;div class="alert alert-info d-flex align-items-start p-3" role="button" style="transition: all 0.2s ease; box-shadow: 0 2px 4px rgba(0,0,0,0.1);" onmouseover="this.style.backgroundColor='#b3e5fc'; this.style.boxShadow='0 4px 8px rgba(0,0,0,0.15)'; this.style.transform='translateY(-1px)'" onmouseout="this.style.backgroundColor=''; this.style.boxShadow='0 2px 4px rgba(0,0,0,0.1)'; this.style.transform='translateY(0)'" onfocus="this.style.backgroundColor='#b3e5fc'; this.style.boxShadow='0 4px 8px rgba(0,0,0,0.15)'; this.style.transform='translateY(-1px)'" onblur="this.style.backgroundColor=''; this.style.boxShadow='0 2px 4px rgba(0,0,0,0.1)'; this.style.transform='translateY(0)'">
&lt;div class="fw-bold mb-1">&lt;span style="font-weight:bold">Give us feedback!&lt;/span> Click here to provide feedback that will help us make this more impactful.&lt;/div>
&lt;/div>
&lt;/a>
&lt;h2 id="learn-more">
Learn more
&lt;a class="header-anchor" href="#learn-more">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>&lt;a href="https://docs.2i2c.org/admin/monitoring/cost-users" target="_blank" rel="noopener" >Cost monitoring documentation&lt;/a>&lt;/li>
&lt;/ul>
&lt;h2 id="acknowledgements">
Acknowledgements
&lt;a class="header-anchor" href="#acknowledgements">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>Tarashish @ &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/devseed/" >Development Seed&lt;/a> for working on this with us.&lt;/li>
&lt;li>&lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/nasa-veda/" >NASA VEDA&lt;/a> for funding much of this work.&lt;/li>
&lt;li>Andy @ &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/openscapes/" >Openscapes&lt;/a>, Alex @ Development Seed and Sarah @ &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/earthscope/" >Earthscope&lt;/a> for giving us close feedback.&lt;/li>
&lt;/ul></description></item><item><title>Reducing base infrastructure costs on AWS with smarter instance types</title><link>https://deploy-preview-646--2i2c-org.netlify.app/blog/aws-cost-reduction/</link><pubDate>Wed, 17 Sep 2025 00:00:00 +0000</pubDate><guid>https://deploy-preview-646--2i2c-org.netlify.app/blog/aws-cost-reduction/</guid><description>&lt;p>We&amp;rsquo;ve been working to reduce the base costs of running our cloud infrastructure on AWS by switching to more efficient instance types for our core nodes. This is the core infrastructure we use to ensure hubs are &amp;ldquo;always available&amp;rdquo; for users, even when no one is actively using a hub. By moving from older &lt;code>r5.xlarge&lt;/code> instances to newer, more efficient &lt;code>r8i-flex.large&lt;/code> instances, we&amp;rsquo;ve significantly reduced these baseline costs while maintaining the same level of service. Here&amp;rsquo;s a plot of daily savings for the &lt;a href="https://deploy-preview-646--2i2c-org.netlify.app/collaborators/geojupyter/" >GeoJupyter community&lt;/a>.&lt;/p>
&lt;p>
&lt;figure >
&lt;div class="d-flex justify-content-center">
&lt;div class="w-100" >&lt;img alt="EC2 cost reduction over time for one community" srcset="
/blog/aws-cost-reduction/featured_hu7020069b8cb86380af07e0c76d10ae22_44063_19edd4b646cb3f1a6d166bea2bffbdfb.webp 400w,
/blog/aws-cost-reduction/featured_hu7020069b8cb86380af07e0c76d10ae22_44063_68563ef0e9111d0c57347d0d3d8f5a32.webp 760w,
/blog/aws-cost-reduction/featured_hu7020069b8cb86380af07e0c76d10ae22_44063_1200x1200_fit_q75_h2_lanczos_3.webp 1200w"
src="https://deploy-preview-646--2i2c-org.netlify.app/blog/aws-cost-reduction/featured_hu7020069b8cb86380af07e0c76d10ae22_44063_19edd4b646cb3f1a6d166bea2bffbdfb.webp"
width="760"
height="394"
loading="lazy" data-zoomable />&lt;/div>
&lt;/div>&lt;/figure>
&lt;/p>
&lt;p>The graph above shows the impact on EC2 node costs specifically (this doesn&amp;rsquo;t include the entire cost of always-on infrastructure, but represents a significant portion). We are rolling out this change to all &lt;em>new&lt;/em> clusters, and starting to work through our pre-existing AWS clusters.&lt;/p>
&lt;h2 id="learn-more">
Learn more
&lt;a class="header-anchor" href="#learn-more">#&lt;/a>
&lt;/h2>&lt;ul>
&lt;li>&lt;a href="https://github.com/2i2c-org/infrastructure/pull/6721" target="_blank" rel="noopener" >Pull request implementing the instance type changes&lt;/a>&lt;/li>
&lt;li>&lt;a href="https://github.com/2i2c-org/infrastructure/issues/6756" target="_blank" rel="noopener" >Our rollout plan for existing clusters&lt;/a>&lt;/li>
&lt;/ul></description></item></channel></rss>