Skip to content

[EPIC] Shuffle file execs improvement #1319

@milenkovicm

Description

@milenkovicm

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

shuffle files execs could be improved in few ways

  • make better metrics, especially at reader side
  • offload I/O operations to dedicated executor
  • offload arrow flight server to dedicated executor

Describe the solution you'd like

there is design document at in #660

Describe alternatives you've considered

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions