Scope Runtime on the network

[seanhanca]

Problem

Scope remote inference is using fal.ai serverless H100 gpu, without the network. There is need to bring scope runtime to be Orchestrator compatible, meaning, SDK -> trickle -> Os archiecture needs to be implemenated, rahter than today scope server -> webrtc -> scope server (on fal).

Proposed Solution

Alternatives Considered

Scope

• Shell / core platform
• Plugin SDK
• Existing plugin:
• New plugin
• Infrastructure / CI
• Documentation

[seanhanca]

Using Fal serverless as the self hosted O, to start this. identify breakdown tasks for week 1.

[j0sh]

High level overview

Copying this rough task breakdown from the notion. This isn't going to be a 1-week thing but hopefully we can make progress on a couple of items. There is some pushback on trickle that needs to get resolved.

• Local Scope
  • Add trickle as an option alongside existing WebRTC
• Orchestrator support for FAL
  • Serverless go-livepeer#3854
• FAL Scope
• Infra: Remote Signer
  • spin up remote signer nodes
• API: Remote Signer
  • Surface remote signer endpoints, protected via normal Livepeer API keys
  • GET /discover-orchestrators
  • POST /sign-orchestrator-info
  • POST /generate-live-payment
• Usage Tracking: Pre-Existing Tracking?
• Usage Tracking: Event Stream
  • As a follow-on