H100 GPUs from community

[seanhanca]

Problem

Need 6 H100 GPUs initially (2 staging, 4 production), to get the scope remote inference Infra established.

Proposed Solution

Alternatives Considered

Scope

• Shell / core platform
• Plugin SDK
• Existing plugin:
• New plugin
• Infrastructure / CI
• Documentation

[seanhanca]

Need 6 H100 from community, idealy from fal serverless infra. 2 for staging needed earlier, and 4 for production later.
by 1st week of March, we need 2