New GPU Cloud Integration with Hyperstack!

[williamstein]

If you're GPU's on CoCalc, there's an entirely new cloud option that you should see which is Hyperstack:

Once you select Hyperstack after starting to create a compute server, then click the A100 tag, you'll see this:

Note that for $3.60/hour you get an 80GB A100, and these are all standard instances. You can also see that at least right now many are available. Everything else works very similar to Google cloud, except that:

• startup time is slower -- definitely expect about 5-10 minutes from when you click "Start" until you can use the compute server. However, it's very likely to work, unlike Google cloud GPU's (especially spot instances). Google cloud is extremely good for CPU, but for GPU it's not as good.
• Many of the server configurations have over 500GB of very fast local ephemeral disk, in case you need that for scratch. It's ephemeral, goes away when you stop the server.
• The local disk on the server should be as fast or faster than google cloud, but cheaper.
• All network usage is free, whereas egress from google cloud is quite expensive.
• There's a different range of GPU's. Sometimes there are a lot of H100's but in the middle of the day Wednesday, there aren't. Yesterday there were dozens of them.
• By default only a Python (Anaconda) image and an Ollama image are visible, since they are small. When you select the python image, you'll likely have to type conda install ... in a terminal to install some packages you need. If you click the "Advanced" checkbox when selecting an image, you can select from the full range of images. However, the first startup time for your server maybe be MUCH slower for big images (e.g., think "20-30 minutes" for the huge colab image). Starting the server a second time is fast again.

• Live disk enlarging does work. However, there's a limit on Hyperstack where you can enlarge the disk at most 25 times.

[mforbes]

@williamstein Have you explored Jetstream2? (https://jetstream-cloud.org/). Part of NSF's Accelerate program, and apparently fairly easy for researchers to get access to.

[williamstein]

Have you explored Jetstream2?

I haven't. I don't think there is any way I could get access to it anymore, since I left academia.