Skip booting from flash, boot from the network. That would be faster, wouldn't it?
I want to buy a few of these sorts of things when I have funds again. Have you tried running stuff outside of LLMs like ComfyUI for other tasks on the hardware? I imagine performance would be similar to LLM.
There's some incredibly interesting stuff happening in that space.