o kih@sddlmZddlmZmZmZddlmZddlZddl m Z m Z gdZ ede dd ed efd d Zd ed efd dZedeeeZe ddejdeeejBded eejdffddZe ddedeeejBded eefddZd ddZ d deedfdeeefdBdeeejBded eeedfeeeefdfff ddZd dedeejBded efddZdS)!)Sequence)AnyoverloadTypeVar) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturncCst|SN)_is_namedtupler rj/var/www/addictedbytheproject.nl/epg/venv/lib/python3.10/site-packages/torch/nn/parallel/scatter_gather.py is_namedtuple srcCst|tot|dot|dS)N_asdict_fields) isinstancetuplehasattrrrrrrsrT.inputs target_gpusdimcCdSrrrrrrrrr !r cCrrrrrrrr )r c*fddz |}Wd|Sdw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. csttjrtdStr#fddttddiDSttr:t dkr:t ttddiStt rTt dkrTddttddiDStt rrt dkrrfddtt ddiDSfddDS) Ncsg|]}t|qSrtype).0argsrrr ; z0scatter..scatter_map..strictFrcSsg|]}t|qSr)listr$irrrr&Ecsg|]}t|qSrr"r*rrrr&Gr'csg|]}qSrrr$_rrrr&Ls) rtorchTensorrapplyrzipmaprlenr)dictitemsrr scatter_maprrrr87s   zscatter..scatter_mapNr)rrrresrr7rr 1s  kwargscCs|rt|||ng}|rt|||ng}t|t|kr/|ddtt|t|Dnt|t|krI|ddtt|t|Dt|t|fS)z+Scatter with support for kwargs dictionary.css|]}dVqdS)rNrr-rrr d z!scatter_kwargs..css|]}iVqdSrrr-rrrr;hr<)r r4extendranger)rr:rrscattered_inputsscattered_kwargsrrrr Zs   r outputs target_devicecr!)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. csdttjrtjgRSdurdSttr.gather_map..z+All dicts must have the same number of keysc3s*|]fddDfVqdS)csg|]}|qSrrrCkrrr&r,z8gather..gather_map...Nr)r$) gather_maprArFrr;s(r(T) rr/r0rr1r5all ValueErrorr#r_maker3r2)rArrHrB)rErArrHs  zgather..gather_mapNr)rArBrr9rrLrr ns  r ).)r)collections.abcrtypingrrrtyping_extensionsrr/torch.nn.parallel._functionsrr__all__ FutureWarningboolrrr5r)rrr0intdevicer strr r rrrrsb       -  " &