o ei@sdZddlmZddlmZddlmZddlmZddl m Z ddl Z dd l m Zd d l mZgd Zedd eee ffddZd efddZd efddZd efddZd efddZd efddZd efddZd efddZd efddZd5d e jjd dfd!d"ZGd#d$d$ZGd%d&d&ZeZ e a!d5d e jjd efd'd(Z"Gd)d*d*eZ#d+ed efd,d+Z$d e%fd-d.Z&d e jjd dfd/d0Z'd efd1d2Z(d efd3d4Z)dS)6zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )Mapping)AbstractContextManager) lru_cache)MappingProxyType)AnyNdevice)amp) is_availableis_initialized synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventget_capabilitiesreturncCsttjjS)a Returns an immutable mapping of CPU capabilities detected at runtime. This function queries the CPU for supported instruction sets and features using cpuinfo. The result is cached after the first call for efficiency. The returned mapping contains architecture-specific capabilities: For x86/x86_64: - SSE family: sse, sse2, sse3, ssse3, sse4_1, sse4_2, sse4a - AVX family: avx, avx2, avx_vnni - AVX-512 family: avx512_f, avx512_cd, avx512_dq, avx512_bw, avx512_vl, avx512_ifma, avx512_vbmi, avx512_vbmi2, avx512_bitalg, avx512_vpopcntdq, avx512_vnni, avx512_bf16, avx512_fp16, avx512_vp2intersect, avx512_4vnniw, avx512_4fmaps - AVX10 family: avx10_1, avx10_2 - AVX-VNNI-INT: avx_vnni_int8, avx_vnni_int16, avx_ne_convert - AMX: amx_bf16, amx_tile, amx_int8, amx_fp16 - FMA: fma3, fma4 - Other: f16c, bmi, bmi2, popcnt, lzcnt, aes, sha, clflush, clflushopt, clwb For ARM64: - SIMD: neon, fp16_arith, bf16, i8mm, dot - SVE: sve, sve2, sve_bf16, sve_max_length (when supported) - SME: sme, sme2, sme_max_length (when supported) - Other: atomics, fhm, rdm, crc32, aes, sha1, sha2, pmull Common to all architectures: - architecture: string identifying the CPU architecture Returns: MappingProxyType: An immutable mapping where keys are capability names (e.g., 'avx2', 'sve') and values are booleans indicating support, or integers for properties like vector lengths. Example: >>> caps = torch.cpu.get_capabilities() >>> if caps.get("avx2", False): ... print("AVX2 is supported") >>> print(f"Architecture: {caps['architecture']}") )rtorch_C_cpu_get_cpu_capabilityrr\/var/www/addictedbytheproject.nl/epg/venv/lib/python3.10/site-packages/torch/cpu/__init__.pyr#s+rcCtddS)z/Returns a bool indicating if CPU supports AVX2.avx2Frgetrrrr_is_avx2_supportedQr#cCr)z1Returns a bool indicating if CPU supports AVX512.avx512_fFr!rrrr_is_avx512_supportedVr$r&cCr)z6Returns a bool indicating if CPU supports AVX512_BF16. avx512_bf16Fr!rrrr_is_avx512_bf16_supported[r$r(cCr)z/Returns a bool indicating if CPU supports VNNI. avx512_vnniFr!rrrr_is_vnni_supported`sr*cCr)z3Returns a bool indicating if CPU supports AMX_TILE.amx_tileFr!rrrr_is_amx_tile_supportedfr$r,cCr)z3Returns a bool indicating if CPU supports AMX FP16.amx_fp16Fr!rrrr_is_amx_fp16_supportedkr$r.cCs tjjS)zInitializes AMX instructions.)rrr _init_amxrrrrr/ps r/cCdS)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrrr usr r cCr0)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrrrrr~rc@sBeZdZdZddeddfddZddd Zdd d Zdd d ZdS)rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcCdSNr)selfr3rrr__init__zStream.__init__cCr4r5rr6rrrr wait_streamr8zStream.wait_streamcCr4r5rr6rrr record_eventr8zStream.record_eventcCr4r5r)r6eventrrr wait_eventr8zStream.wait_event)r2rN) __name__ __module__ __qualname____doc__intr7r:r<r>rrrrrs   rc@s<eZdZdefddZd d ddZd ddZd d d d ZdS) rrcCr0)NTrr;rrrqueryr8z Event.queryNcCr4r5rr9rrrrecordr8z Event.recordcCr4r5rr;rrrrr8zEvent.synchronizecCr4r5rr9rrrwaitr8z Event.waitr5r?)r@rArBboolrErFrrGrrrrrs   rcCstS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrrrrrs rc@sHeZdZUdZedBed<ddZddZded ed ed dfd d Z dS)rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code N cur_streamcCs||_t|_dSr5)r_default_cpu_stream prev_streamr9rrrr7s zStreamContext.__init__cCs |j}|dur dSt|_|adSr5)rrIrL)r6rJrrr __enter__s zStreamContext.__enter__typevalue tracebackrcCs|j}|dur dS|jadSr5)rrLrI)r6rNrOrPrJrrr__exit__s zStreamContext.__exit__) r@rArBrCr__annotations__r7rMrrQrrrrrs   rrcCst|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rrrrrscCr0)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrrcCr0)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrrrrrr1rcCr0)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrrSrcCr0)zReturns True if the CPU is initialized. Always True. N.B. This function only exists to facilitate device-agnostic code Trrrrrr rSr r5)*rCcollections.abcr contextlibr functoolsrtypesrtypingrrr _devicer __all__strrrHr#r&r(r*r,r.r/r DevicerrrrKrIrrrrDrrrr rrrrs@       -