o ei9 @sddlmZddlZddlmZmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZmZdd lmZerbddlm Z m!Z!ede"e#e$edfZ%ede"e#e$edfe&e'eefe(eZ)Gddde*Z+Gdddeee%e)fZ,Gddde,e%e)fZ-Gddde,e%e)fZ.Gddde.e%e)fZ/Gddde/e%e)fZ0dS)) annotationsN)ABCabstractmethod) literal_eval)cached_property)sha256)getenv)Path) gettempdir)Lock)AnyGeneric TYPE_CHECKINGTypeVar) assert_neveroverrideSelf)FileLock)FutureThreadPoolExecutorKey.Valuec@seZdZdZdS) CacheErrorzJ Exception raised for errors encountered during cache operations. N)__name__ __module__ __qualname____doc__rr_/var/www/addictedbytheproject.nl/epg/venv/lib/python3.10/site-packages/torch/_inductor/cache.pyrsrc@s,eZdZdZeddd Zedd dZdS)Cachezi Abstract base class for cache implementations. Provides the interface for cache operations. selfrkeyrreturn Value | NonecCdSz Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present, else None. Nr)r r!rrrget*z Cache.getvaluerboolcCr$)  Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Nrr r!r(rrrinsert4r'z Cache.insertNr rr!rr"r#r rr!rr(rr"r))rrrrrr&r,rrrrr$s   rc@sJeZdZdZdddZdd d ZdddZedddZedddZ dS) InMemoryCachezL In-memory cache implementation using a dictionary and thread lock. r rr"NonecCsi|_t|_dS)z6 Initialize an empty in-memory cache. N)_cacher _lockr rrr__init__Es zInMemoryCache.__init__r!rr#cCsT|j|j|}dur|WdS WddS1s#wYdSr%)r2r1r&r+rrrr&Ls $zInMemoryCache.getr(rr)cCsT|j||jvr WddS||j|< WddS1s#wYdS)r*NFT)r2r1r+rrrr,Ys  $zInMemoryCache.insertenv_varstrc Cs|}t|}dur |S|dD]}|}|sqz |dd\}}Wnty=}z td|d|d|d}~ww||}}zt|}Wnttfyg}z td|d |d |d}~wwzt|} Wnttfy}z td |d |d |d}~wwzt|} Wntj y}z td|d |d |d}~wwzt| } Wntj y}z td |d |d |d}~ww| | | s| | | krtd | d| | d| dq|S)av Create an in-memory cache from an environment variable. Args: env_var (str): Name of the environment variable containing cache data. Returns: InMemoryCache: An instance populated from the environment variable. Raises: CacheError: If the environment variable is malformed or contains invalid data. N;,zMalformed kv_pair z from env_var z!, likely missing comma separator.zMalformed key_bytes_repr z in kv_pair z, encoding is invalid.zMalformed value_bytes_repr z, not un-pickle-able.zMultiple values for key z found, got z and .) rsplitstrip ValueErrorrr SyntaxErrorpickleloadsUnpicklingErrorr,r&) clsr5cacheenv_valkv_pairkey_bytes_reprvalue_bytes_reprerr key_bytes value_bytesr!r(rrr from_env_varis    zInMemoryCache.from_env_varfpathr c Cs|}|s |Szt|d}t||_Wdn1s wYWntjy<}z td|d|d}~wwt|jtsKtd|d|S)a= Create an in-memory cache from a file path. Args: fpath (Path): Path to the file containing pickled cache data. Returns: InMemoryCache: An instance populated from the file. Raises: CacheError: If the file is not a valid pickled dictionary. rbNz&Failed to create cache from file path z#, file contents are un-pickle-able.z-, file contents not pickled dict[Key, Value].) is_fileopenr?loadr1rAr isinstancedict)rBrLrCfprHrrrfrom_file_paths*     zInMemoryCache.from_file_pathNr rr"r0r-r.)r5r6r"r)rLr r"r) rrrrr4r&r, classmethodrKrTrrrrr/@s    Mr/c@s$eZdZdZdd d ZdddZdS) AsyncCachezE Asynchronous cache implementation using ThreadPoolExecutor. r rr!rexecutorrr"Future[Value | None]cCs||j|S)a Retrieve a value from the cache asynchronously. Args: key (Key): The key to look up. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[Value | None]: Future for the cached value or None. )submitr&)r r!rXrrr get_asyncs zAsyncCache.get_asyncr(r Future[bool]cCs||j||S)aO Insert a value into the cache asynchronously. Args: key (Key): The key to insert. value (Value): The value to associate with the key. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[bool]: Future for the result of insertion. )rZr,)r r!r(rXrrr insert_asyncs zAsyncCache.insert_asyncN)r rr!rrXrr"rY) r rr!rr(rrXrr"r\)rrrrr[r]rrrrrWs  rWc@sveZdZUdZdZded<d$d%d d Zed&ddZd'ddZ d(ddZ e d)ddZ e d*ddZe d+d"d#ZdS), OnDiskCachea? On-disk cache implementation using files and file locks. Stores cache data in files on disk, with atomic operations and versioning. Supports custom cache directory names. Attributes: version (int): The version used for cache versioning. name (str): The name of the cache directory. rintversionNr rname str | Noner"r0cCs|pd|_dS)z Initialize an on-disk cache instance. Args: name (str | None, optional): The name of the cache directory. If None, defaults to "on_disk_cache". on_disk_cacheN)ra)r rarrrr4szOnDiskCache.__init__r cCsttd|jS)z Get the base directory for the cache. Returns: Path: The base directory path for storing cache files. rC)r r rar3rrrbase_dirszOnDiskCache.base_dirr!rc CsTz|jtt|ddWSttjfy)}z td|d|d}~ww)a Get the file path for a given key. Args: key (Key): The key to convert to a file path. Returns: Path: The file path for the key. Raises: CacheError: If the key is not pickle-able. N zFailed to get fpath for key z, key is not pickle-able.) rdrr?dumps hexdigestAttributeError PicklingErrorrr)r r!rHrrr_fpath_from_keys " zOnDiskCache._fpath_from_keyrLrcCs$tt|jd|jdddS)z Get a file lock for a given file path. Args: fpath (Path): The file path. Returns: FileLock: The file lock for the path. locksNz.lock)rr6parentra)r rLrrr_flock_from_fpath*s$ zOnDiskCache._flock_from_fpathbytescCstttjddS)z Get the version prefix for the cache. Returns: bytes: The version prefix as bytes, derived from the cache version string. Nrl)rr6r^r`encodedigestr3rrrversion_prefix9szOnDiskCache.version_prefixr#c Cs||}||}|n|s WddSd}t|j}t|d}|||jkr3|}Wdn1s=wY|durS| WddSzt |}Wntj yp}z t d|d|d}~ww|WdS1s}wYdS)a Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present and version matches, else None. Raises: CacheError: If the value is corrupted or cannot be unpickled. Side Effects: Removes stale cache files if the version prefix does not match. NrMzFailed to get key z?, value is potentially corrupted (value is not un-pickle-able).) rjrnrNlenrrrOreadunlinkr?r@rAr) r r!rLflockrJ prefix_lengthrSr(rHrrrr&Bs:    $zOnDiskCache.getr(rr)c Cs||}||}|jjdddzA|4}t|d}||jt||Wdn1s2wYWdWdSWdWdS1sLwYWdStj yl}z t d|d|d|d}~wt yuYdSw) a Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Raises: CacheError: If the value is not pickle-able. Side Effects: Creates the cache directory if it does not exist. T)parentsexist_okxbNzFailed to insert key z with value z, value is not pickle-able.F) rjrnrmmkdirrOwriterrr?dumprirFileExistsError)r r!r(rLrv_rSrHrrrr,ls.   *    zOnDiskCache.insert)N)r rrarbr"r0r rr"r )r rr!rr"r )r rrLr r"r)r rr"ror-r.)rrrrr`__annotations__r4rrdrjrnpropertyrrrr&r,rrrrr^s       )r^cs0eZdZdZd fdd Zed d d ZZS) InductorOnDiskCachezt Inductor-specific on-disk cache implementation. Uses a custom base directory for Inductor cache files. r rr"r0cstddS)z Initialize an inductor on-disk cache instance. Sets the cache directory name to "inductor_on_disk_cache". inductor_on_disk_cacheN)superr4r3 __class__rrr4szInductorOnDiskCache.__init__r cCsddlm}t|d|jS)z Get the base directory for the Inductor cache. Returns: Path: The base directory path for Inductor cache files. r)default_cache_dirrC)%torch._inductor.runtime.runtime_utilsrr ra)r rrrrrds zInductorOnDiskCache.base_dirrUr)rrrrr4rrd __classcell__rrrrrs r)1 __future__rr?abcrrastr functoolsrhashlibrosrpathlibr tempfiler threadingr typingr r rrtyping_extensionsrrrtorch.utils._filelockrconcurrent.futuresrrr6r_tuplerrorRlistrr=rrr/rWr^rrrrrs2         (!