Skip to content

Enable parallel netCDF dataset reads #375

@davidhassell

Description

@davidhassell

By introducing two new netCDF backends:

  • For netCDF-4: h5netcdf-pyfive = h5netcdf with the pyfive backend
  • For netCDF-3: netcdf_file = scipy.io.netcdf_file

we can enable parallel reading of netCDF datasets.

h5netcdf with the pyfive backend should become the new default read engine (it's currently the non-threadsafe h5netcdf with the h5py backend).

PR to follow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    dataset readRelating to reading datasetsenhancementNew feature or requestperformanceRelating to speed and memory performance

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions