o eidJ@s UddlmZ ddlZddlZddlmZmZmZddlm Z m Z gdZ dZ ej ddd kZdZej d d d kZd Zd Zd Zd Zdd lmZe d dd dZeed<e dddZeed<dZeed<dZeed<e Zd Zee dZ!deefddZ"e"Z#e Z$dZ%d Z&d Z'd Z(d Z)d Z*dZ+dZ,d Z-dZ.dZ/dZ0ej dd dkZ1ej dZ2dZ3dZ4dZ5dZ6dZ7d Z8dZ9d Z:ed!ed"<dZ;dZej d$d%Z?dZ@dZAeeBed&<d ZCdZDd ZEdZFdZGdZHdZIdZJd'ZKdZLeed(<dZMdZNeed)<erdd*lOTe ejPeQdS)+)CallableN)LiteralOptional TYPE_CHECKING)Configinstall_config_module)joint_custom_pass*activation_memory_budget_runtime_estimatoractivation_memory_budget_solverFFAKE_ALLOW_META10AOT_PARTITIONER_DEBUGT) is_fbcodez0pytorch/remote_cache:enable_local_autograd_cacheTORCHINDUCTOR_AUTOGRAD_CACHE)justknobenv_name_forcedefaultenable_autograd_cache2TORCHINDUCTOR_AUTOGRAD_CACHE_ALLOW_CUSTOM_AUTOGRAD)rr.autograd_cache_allow_custom_autograd_functionsbundled_autograd_cachebypass_autograd_cache_keyCIreturncCs,tjddkr dStjddkrdSdS)N#TORCHINDUCTOR_AUTOGRAD_REMOTE_CACHEr Tr F)osenvirongetrra/var/www/addictedbytheproject.nl/epg/venv/lib/python3.10/site-packages/torch/_functorch/config.pyremote_autograd_cache_defaultfs r!ig?flopsdp PARTITIONER_MEMORY_BUDGET_PARETO$PARTITIONER_MEMORY_BUDGET_PARETO_DIRneeds_exact_strides)r&needs_fixed_stride_orderflexible_layout#custom_op_default_layout_constraintsame_as_forwardTORCH_COMPILE_GRAPH_FORMATsvgfake_tensor_prefer_device_typedonatedrselective_decompose)*)Rcollections.abcrrsystypingrrrtorch.utils._config_modulerr_save_config_ignorefunctionalize_rng_opsrrfake_tensor_allow_meta debug_assertdebug_partitionerdecompose_custom_triton_opsstatic_weight_shapes treat_parameters_as_free_to_savecsetorch._environmentrrbool__annotations__rrrautograd_cache_normalize_inputscheck_custom_op_aliasinggetenverror_on_custom_op_aliasingr!enable_remote_autograd_cacheview_replay_for_aliased_outputsmax_dist_from_bwban_recompute_used_far_apart!ban_recompute_long_fusible_chains#ban_recompute_materialized_backwardban_recompute_not_in_allowlistban_recompute_reductionsrecompute_viewsis_non_builtin_to_include'remat_using_tags_for_fwd_loss_bwd_graphactivation_memory_budgetr r visualize_memory_budget_paretomemory_budget_pareto_diraggressive_recomputationenable_activation_offloading"activation_offload_separate_streamactivation_offload_sink_waitactivation_reload_prefetch(fake_tensor_allow_unsafe_data_ptr_accessunlift_effect_tokensr)fake_tensor_crossref"fake_tensor_propagate_real_tensorsbackward_pass_autocastdonated_buffertorch_compile_graph_format*generate_fake_kernels_from_real_mismatchesr-strgraphsafe_rng_functionalization force_non_lazy_backward_lowering_test_disable_functionalizationstrict_autograd_cache(unsafe_allow_optimization_of_collectives5disable_guess_zero_tangent_for_mutated_input_subclass guess_tangent_strides_as_outputs_sync_decision_cross_ranks"saved_tensors_hooks_filtering_moderforce_autograd_cacher/torch.utils._config_typingmodules__name__rrrr s     "