pnetcdf mit Homebrew, MacPorts, Nix, apt, zypper installieren

Projektlinks

• Homepage
• Paketmanager-Seite

Befehle und Aliase

• cdfdiff
• ncmpidiff
• ncmpidump
• ncmpigen
• ncoffsets
• ncvalidator
• pnetcdf-config
• pnetcdf_version

Projektgeschichte

Northwestern University and Argonne National Laboratory started PnetCDF in 2001 independently of Unidata's netCDF implementation. Its goal was a high-performance parallel library for classic netCDF formats, with APIs modeled on netCDF but prefixed `ncmpi_` because of their close coupling to MPI.

The source repository moved from Argonne's Subversion service to GitHub in 2018. Development subsequently expanded format support to CDF-5 and added nonblocking APIs, utilities, performance tuning facilities, and language interfaces.

Adoptionsgeschichte

PnetCDF was designed with netCDF-like APIs to ease adoption by existing scientific applications. NetCDF-C later gained the ability to dispatch classic-format parallel I/O through PnetCDF, allowing programs using the netCDF parallel API to select PnetCDF for CDF-1, CDF-2, and CDF-5 data.

The project has received continuing US Department of Energy support and is used by scientific and climate-computing projects such as E3SM-related I/O software, PIO, and WRF.

Wie es verwendet wird

Applications link against PnetCDF and use its `ncmpi_` C or Fortran interfaces for collective, independent, and nonblocking access to shared netCDF files. Developers use `pnetcdf-config` for build flags and utilities such as `ncmpidump`, `ncmpigen`, `ncmpidiff`, `ncoffsets`, and `ncvalidator` for inspection and validation.

PnetCDF requires an MPI implementation with MPI-IO support. A parallel filesystem is not mandatory, but appropriate file striping and collective access patterns can substantially improve performance.

Warum Paket-Nerds sich dafür interessieren

PnetCDF is a classic HPC packaging concern: an MPI-dependent library whose ABI, compiler wrappers, MPI implementation, and filesystem behavior matter to downstream scientific applications. It preserves the traditional netCDF formats while exposing collective, independent, and nonblocking MPI-I/O operations.

Zeitleiste

• 2001: Northwestern University and Argonne National Laboratory started the project.
• 2003: The project presented its design and performance work at the Supercomputing conference.
• 2018-06-01: Source development migrated from Argonne Subversion to GitHub.
• 2024: The associated PnetCDF-Python package reached its first public release.

Related projects

• Unidata netCDF defines the compatible classic data formats and can dispatch parallel classic-file operations through PnetCDF.
• MPI and MPI-IO provide PnetCDF's process coordination and parallel I/O substrate.
• Parallel HDF5 serves a neighboring role for HDF5-backed data and is the other backend discussed in netCDF parallel-I/O documentation.

Quellen

• https://github.com/Parallel-NetCDF/PnetCDF
• https://parallel-netcdf.github.io/
• https://parallel-netcdf.github.io/wiki/Documentation.html
• https://parallel-netcdf.github.io/wiki/PnetcdfAndNetcdf4.html