o eiY@s"UddlZddlZddlmZddlmZmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/ddl0m1Z1ddl2m3Z3ddl4m5Z5ddl6Z6dd l7m8Z8m9Z9m:Z:gd Z;e<a=ee e?fBe@d <d eAe e>e e?fBfd dZBdeAe e>e e?fBfddZCddZDdeAe e>e e?fBfddZEGdddZFddZGddZHejIddddZJd e de>e?e?ffd!d"ZKdez(_get_allowed_globals..rTcSrn)intrprrr;r;r<rurvrUz torch._utils.z#torch._tensor._rebuild_from_type_v2)"rrr_nn Parameter serialization _get_layoutSizeTensordevicer bytearrayr9complexstorage_dtype_to_storage_type_maprR _new_dtypesrange_tensor_classesrOrN_storage_classes TypedStorageUntypedStorage StorageTypeper_tensor_affineper_tensor_symmetricper_channel_affineper_channel_symmetric per_channel_affine_float_qparamsrm_tensor_rebuild_from_type_v2)rZttttsqtr[r;r;r<_get_allowed_globalssN    rreadlinecCsd|ddd}|ddd}||ftvr&t||f\}}||fS|tvr.t|}||fS)Nutf-8)decoder0r/)rr]r\r;r;r<_read_global_instructions rc CsZt}|j}|j}itddtddtddtddtddtddt ddt ddt ddt ddt ddtddtddtddtddtddtddtddtddtddtddtddtddtddtddtddtddtddi } |d}|stt |t!st"dt#|j$|dt%dkrt&|\}}|'|d|nm|d|vr||d}|r||nZ|dt(dkrt)d |dd} | t*krt+d || n<|dt,dt-dhvr|dd} || n$|dt.dkr|ddn|dt/dkr#|St+d |dq) NrrTrSrwTExpected bytes, got rUn|dt?dkr|t@d$|d%dn|dtAdkr||ddn|dtBdkr|t@d&|ddns|dtCdkr|t@d'|d(dn[|dtDdkrt@d)|d%d}|tEkr td*tF||d+d,}||n1|dtGdkr?|dd}||}|jHd-kr8|I|jHd.}||n |dtJdkr|j}t|t&urdt|tKurdtd/t|t|t&urt|dkrtjLM|dd0krtd1t|d||N|n|dtOdtPdfvr|dtOdkr|dnt@d)|d%d}||jQ|n|dtRdtSdfvr|dtRdkr|dnt@d)|d%d}|dkrtTd2|jd|jQ|<nW|dtUdkr |dd}||}|tV|n<|dtWdkr0|dd|_X|jXdkr/tYjZd3|jXd4dd5n|dt[dkr@|j}|Std6|dq)7zRead a pickled object representation from the open file. Return the reconstituted object hierarchy specified in the file. TrTrrrUz"Trying to load unsupported GLOBAL z whose module z is blocked.)z1torch.nested._internal.nested_tensor.NestedTensorz1torch.nested._internal.nested_tensor._rebuild_njtz"torch._dynamo.decorators._DimRangez\``torch.nested`` and ``torch._dynamo`` must be imported to load nested jagged tensors (NJTs))z(torch.distributed.device_mesh.DeviceMeshz2torch.distributed.tensor._dtensor_spec.DTensorSpecz1torch.distributed.tensor._dtensor_spec.TensorMetaz torch.distributed.tensor.DTensorz0torch.distributed.tensor.placement_types.Partialz2torch.distributed.tensor.placement_types.Replicatez.torch.distributed.tensor.placement_types.Shardz>``torch.distributed.tensor`` must be imported to load DTensorsbuiltinsNzUnsupported global: GLOBAL zY was not an allowed global by default. Please use `torch.serialization.add_safe_globals([z.])` or the `torch.serialization.safe_globals([zN])` context manager to allowlist this global if you trust this class/function.sparsezbCan only create new object for nn.Parameter or classes allowlisted via `add_safe_globals` but got rz0Trying to call reduce for unrecognized function __self__z which belongs to __setstate__rSzcCan only build Tensor, Parameter, OrderedDict or types allowlisted via `add_safe_globals`, but got z"Can only append to lists, but got zCan only extend lists, but got r"r#Fr;zdrwrrr surrogatepassrstrictz1persistent_load id must be tuple or int, but got rz4Only persistent_load of storage is allowed, but got znegative argumentzDetected pickle protocol z in the checkpoint, which was not the default pickle protocol used by `torch.load` (2). The weights_only Unpickler might not support all instructions implemented by this protocol, please file an issue for adding support if you encounter this.) stacklevelr)\ metastackstackappendrrrVrrrJrNrrr_blocklisted_modulesr*rr^rWrpopr_ryrzvalues__new__rrOr.r!hasattrrrr~set_rr__dict__updaterQitemssetattrrr?rpop_markextendr"_check_set_item_targetr#rrr&r'r(r)rrrrrrrr9r r+r r rrr,rRr$rrr rxr{_maybe_decode_asciipersistent_loadr rrrrrXrrr rwarningswarnr%)rErrr]r\ full_path builtins_nameargsclsresultfunc error_msgstateinst slotstatekvitemlist_objrirstrvalstrdatapididxndatarZr;r;r<load;s                         $,     ,,     zUnpickler.loadcCs |j}|j|_|jj|_|Sr7)rrrr)rErr;r;r<r<s  zUnpickler.pop_markopcodecCs:t|jdtttfvrtd|dt|jddS)Nrz Can only zA for dict, collections.OrderedDict, collections.Counter, but got )rJrdictrrr*)rErr;r;r<rBs z Unpickler._check_set_item_targetcCstd)Nz%unsupported persistent id encountered)r*)rErr;r;r<rIszUnpickler.persistent_loadN) rNrOrPrRrFrrrrr;r;r;r<r3s rASCIIrrcCst||dS)Nr)rr)rrr;r;r<rMsr)O functools _functoolsr_codecsr collectionsrrcollections.abcrpicklerrrr r r r r rrrrrrrrrrrrrrrrrrr r!r"r#r$r%r&r'r(r)r*structr+r1r,typingr-r_ torch._utilsr.r/r0rr9r5rQrR__annotations__r?r=r@rArCrDr^rm lru_cacherrrrrr;r;r;r<s<    '     8 A