o ei@s^UddlZddlZddlmZddlZddlmZgdZee e d<de defdd Z e ej d se ej d r.fnr)rrrr r _dummy_fns r_gds_register_buffer_gds_deregister_bufferz?_gds_deregister_buffer exists but _gds_register_buffer does not_gds_register_handlez=_gds_register_handle exists but _gds_register_buffer does not_gds_deregister_handlez?_gds_deregister_handle exists but _gds_register_buffer does not_gds_load_storagez:_gds_load_storage exists but _gds_register_buffer does not_gds_save_storagez:_gds_save_storage exists but _gds_register_buffer does notscCtj|dS)a:Registers a storage on a CUDA device as a cufile buffer. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src = torch.randn(1024, device="cuda") >>> s = src.untyped_storage() >>> gds_register_buffer(s) Args: s (Storage): Buffer to register. N)torch_Crrrrrr5s rcCr)awDeregisters a previously registered storage on a CUDA device as a cufile buffer. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src = torch.randn(1024, device="cuda") >>> s = src.untyped_storage() >>> gds_register_buffer(s) >>> gds_deregister_buffer(s) Args: s (Storage): Buffer to register. N)rrrrrrrrEsrc@speZdZdZdedefddZddd Zdd d Zdd d Z dde deddfddZ dde deddfddZ dS)raWrapper around cuFile. cuFile is a file-like interface to the GPUDirect Storage (GDS) API. See the `cufile docs `_ for more details. Args: filename (str): Name of the file to open. flags (int): Flags to pass to ``os.open`` when opening the file. ``os.O_DIRECT`` will be added automatically. Example:: >>> # xdoctest: +SKIP("gds filesystem requirements") >>> src1 = torch.randn(1024, device="cuda") >>> src2 = torch.randn(2, 1024, device="cuda") >>> file = torch.cuda.gds.GdsFile(f, os.O_CREAT | os.O_RDWR) >>> file.save_storage(src1.untyped_storage(), offset=0) >>> file.save_storage(src2.untyped_storage(), offset=src1.nbytes) >>> dest1 = torch.empty(1024, device="cuda") >>> dest2 = torch.empty(2, 1024, device="cuda") >>> file.load_storage(dest1.untyped_storage(), offset=0) >>> file.load_storage(dest2.untyped_storage(), offset=src1.nbytes) >>> torch.equal(src1, dest1) True >>> torch.equal(src2, dest2) True filenameflagscCsDtjdkr td||_||_t||tjB|_d|_ | dS)Nwin32z*GdsFile is not supported on this platform.) sysplatformr rrosopenO_DIRECTfdhandleregister_handle)selfrrrrr__init__vs  zGdsFile.__init__r NcCs"|jdur |t|jdS)N)r&deregister_handler"closer%r(rrr__del__s zGdsFile.__del__cCs&|jdur tdtj|j|_dS)zpRegisters file descriptor to cuFile Driver. This is a wrapper around ``cuFileHandleRegister``. Nz4Cannot register a handle that is already registered.)r&AssertionErrorrrrr%r,rrrr's zGdsFile.register_handlecCs*|jdur tdtj|jd|_dS)zvDeregisters file descriptor from cuFile Driver. This is a wrapper around ``cuFileHandleDeregister``. Nz2Cannot deregister a handle that is not registered.)r&r.rrrr,rrrr*s  zGdsFile.deregister_handlerstorageoffsetcC(|jdur tdtj|j||dS)amLoads data from the file into the storage. This is a wrapper around ``cuFileRead``. ``storage.nbytes()`` of data will be loaded from the file at ``offset`` into the storage. Args: storage (Storage): Storage to load data into. offset (int, optional): Offset into the file to start loading from. (Default: 0) Nz4Cannot load data from a file that is not registered.)r&r.rrrr(r/r0rrr load_storage zGdsFile.load_storagecCr1)aUSaves data from the storage into the file. This is a wrapper around ``cuFileWrite``. All bytes of the storage will be written to the file at ``offset``. Args: storage (Storage): Storage to save data from. offset (int, optional): Offset into the file to start saving to. (Default: 0) Nz2Cannot save data to a file that is not registered.)r&r.rrrr2rrr save_storager4zGdsFile.save_storage)r N)r) __name__ __module__ __qualname____doc__strintr)r-r'r*rr3r5rrrrrVs   r)r"r collections.abcrr torch.typesrrlistr:__annotations__rhasattrrr.__dict__rrrrrrrsJ