Skip to content

billu94/kvikio

This branch is 30 commits behind rapidsai/kvikio:branch-24.10.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Aug 8, 2024
317c56c · Aug 8, 2024
Jul 31, 2024
Jul 19, 2024
Aug 7, 2024
Aug 8, 2024
Jul 25, 2024
Jul 30, 2024
Oct 23, 2023
Aug 8, 2024
Mar 21, 2023
Mar 21, 2023
Jun 7, 2023
Jun 7, 2023
Feb 27, 2024
Jul 30, 2024
Aug 7, 2024
Jul 30, 2024
Jan 19, 2022
Sep 12, 2023
Jul 19, 2024
Jun 10, 2024
Aug 8, 2024

Repository files navigation

KvikIO: High Performance File IO

Summary

KvikIO is a Python and C++ library for high performance file IO. It provides C++ and Python bindings to cuFile, which enables GPUDirect Storage (GDS). KvikIO also works efficiently when GDS isn't available and can read/write both host and device data seamlessly. The C++ library is header-only making it easy to include in existing projects.

Features

  • Object oriented API of cuFile with C++/Python exception handling.
  • A Python Zarr backend for reading and writing GPU data to file seamlessly.
  • Concurrent reads and writes using an internal thread pool.
  • Non-blocking API.
  • Handle both host and device IO seamlessly.
  • Provides Python bindings to nvCOMP.

Documentation

About

KvikIO - High Performance File IO

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 28.7%
  • C++ 25.8%
  • Jupyter Notebook 19.2%
  • Cython 16.6%
  • CMake 5.1%
  • Shell 4.0%
  • Other 0.6%