o ei> @sddlZddlmZddlmZmZddlZddlm Z ddl m Z gdZ Gdddej jZ dd ej jd ed ed eej jej jffddZdej jded efddZ  ddeejjej jfdeeej jgefded efddZdS)N)Callable)OptionalUnion)map_arg) split_module)FoldedGraphModuleget_unique_attr_name_in_modulesplit_const_subgraphsc sfeZdZdZ   ddejjdejjde ejjde e de f fd d Z fd d Z d dZ ZS)ra FoldedGraphModule is a GraphModule which also contains another `const_subgraph_module` representing a subgraph which has all const attr inputs and which can be run once before running the main standard `graph`. The `const_output_names` are the ordered list names of attrs which represent what each respective output from the const_subgraph should be set on which attrs. Ncudarootgraphconst_subgraphfx_const_folded_attrs_namedevice_for_folded_attrscs@t|||dur dntj|||_d|_||_||_dS)NF) super__init__torchfx GraphModuleconst_subgraph_modulehas_folding_been_runrr)selfr r r rr __class__j/var/www/addictedbytheproject.nl/epg/venv/lib/python3.10/site-packages/torch/fx/experimental/const_fold.pyrs  zFoldedGraphModule.__init__cs|js|tj|SN)r run_foldingr__call__)rargskwargsrrrr.s zFoldedGraphModule.__call__cs~jdus jdur dSjrtdd_}fddt|tr2tjfdd|Dn|}t j|dS)NzFolding has already been runTcsNtjjt|ts|n t|gjj dt|tjr#|j dSddS)N)deviceF) requires_grad) rnn Parameter isinstanceintdetachcloneTensortorr")i)rrr _create_paramEsz4FoldedGraphModule.run_folding.._create_paramcsg|]}|qSrr).0r+)r,rr Nsz1FoldedGraphModule.run_folding..) rrrAssertionErrorr%tuplerr# ParameterListsetattr)r folded_attrsparamsr)r,rrr3s    zFoldedGraphModule.run_folding)NNr )__name__ __module__ __qualname____doc__rr#ModulerGraphrstrrrr __classcell__rrrrrs$   rTgminline_mod_namerun_dcereturnc st||}t|tjjstdt|d}|jj D]}|j dkr.|j |kr.|}nq|dur:td||j }|j }id}fdd} |jj D]} | j dkrj| j|vr_|| jn||| <|d 7}qN| j d kr| j d} t| | } g} t| ttfrddlfd d |jD} || | D](}|j d }t|tstd t||| ||j|| ||<qqN|j||j| | }Wdn1swY|| <qN|j||r|jS)a Given `gm` and some graph module which is called with target name `inline_mod_name`, this helper will inline all of the nodes from that called graph module into `gm`. Returns a mapping from subgraph nodes to the newly created/mapped nodes in gm. zExpected GraphModule, got N call_modulez$Could not find call_module node for rcs|}|j|_|Sr)metacopy)nodenew_node)replacement_mappingrrreplacement_fnrs z&_inline_module..replacement_fn placeholderoutputcs6g|]}|jdkr|jjurt|jdtr|qS) call_functionrI)optargetgetitemr%rr&)r-user)operatorrrr.s  z"_inline_module..zExpected int index, got )dict named_modulesr%rrrr/typer nodesrLrMrr namerlistr0rPusersreplace_all_uses_withr& erase_nodeinserting_before node_copyeliminate_dead_code)r=r>r? inline_modcall_mod_node_to_replacerD call_mod_argscall_mod_kwargsph_countrG inline_nodeoutputsoutput_replacements getitem_usersrOidxrEr)rPrFr_inline_moduleUsd                  rg mod_tracedrUcCstdd|}|drd|}t||r>td|}|dur&|d}n|dd\}}|dt|d}t||s|S) zP Make sure the name is unique (in a module) and can represents an attr. z[^0-9a-zA-Z_]+_rz (.*)_(\d+)$N_1rI)resubisdigithasattrmatchgroupr&)rhrUrpbasenumrrrrs      rcpumoduleskip_folding_node_fnrc sddl}t|tjjstj|}n|}dtjjdtffdd td}|jj D]S}|j dvr2q*|j d kr@t|j  s@q*|rG||rGq*| rLq*t|jd d|jrXq*|j d krq||j}rqt|tjjrq|rqq*||j d kr}d }q*|st||jSd tjjffdd }t|||} d\} } | jt| | d} } | r| jj ngD]}|j d krt| |jt| |jq| jj D]}|j d krt| |jt| |jqd}| jj D]}|j d kr|j| kr|j}nq|durtdtj| | j}d}|jj D]t}|j dkrt|jdt}q|j dkrq|t|kr3td|dt|d||}|d7}|j d krItd|j |j||j|j}Wdn 1sbwY|j !|_ |"||j#|qdt$vrtdt%|d}t| ||rtj&'ntj&(| jj D]9}|j d kr|j| kr|j||j|}Wdn 1swY|j !|_ |"|nqt)| | rt*| | | j+t| | j|j||S)aJ Looks through `module` for any nodes that have all constant attribute inputs and separates them out into their own constant subgraph, and returns a FoldedGraphModule which runs that constant subgraph on the first run to set attributes on the module prior to running the non-constant portion of the graph. rNrur@cstt|tjjs td|jjD](}|jdkr|rdS|jdkr7| |j }r7t|tjjr7|SqdS)z` Return True if a GraphModule type subgraph contains any impure op, else False. zDcaller should only pass GraphModule to subgraph_has_impure_ops checkrKTrAF) r%rrrr/r rTrL is_impure get_submodulerM)rurD submodule)_subgraph_has_impure_opsrrrzs    z7split_const_subgraphs.._subgraph_has_impure_opsF>rJrHget_attr fill_valuerATrDcs|vrdSdS)NrrIr)rD) const_nodesrr mod_partitionsz,split_const_subgraphs..mod_partition)submod_0submod_1z,Could not find call_module node for const_gmrJrHzPlaceholder index z out of range for args (len=)rIzExpected get_attr, got multiple_outputsz multiple_outputs not set in loop_FX_CONST_FOLDED_ATTRS),sympyr%rrrsymbolic_traceboolsetr rTrLall_input_nodesissubsetrwr getExprrxrMaddrNoderrgetattrr2rr/r0lenrZr{rBrCrXrYlocalsrr#r1r$rorgr\)rurvrrrhfound_const_foldingrD target_modr~splitconst_mod_namenon_const_mod_nameconst_gm non_const_gmcall_const_gm_args root_const_gmph_idxrin_noderErr3r)rzr}rr s                             r )T)Nrt)rlcollections.abcrtypingrrtorch.fxr torch.fx.nodertorch.fx.passes.split_moduler__all__rrrr;rrQrrgrr#r9r rrrrs<   D Z