PhddlZddlmZddlmZddlmZmZmZm Z m Z ddl m Z ddl mZddZeZeZGddZefd e efd Zd e j(d e eeeffd Zy)N) OrderedDictwraps)CallableDictListOptionalType)_StatecF|dttjS)N_)struuiduuid4)strings qC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/distributed/_composable/contract.pygenerate_state_keyr sXQs4::<() **c eZdZy) RegistryItemN)__name__ __module__ __qualname__rrrrsrr state_clsc.tfd}|S)aJ Decorate a function as a composable distributed API, where the first argument of the function must be an :class:`nn.Module` instance. The decorator verifies that the wrapped function does not modify parameter, buffer or sub-module fully-qualified names (FQN). When a function ``func`` is decorated by ``@contract()``, a ``.state(module: nn.Module)`` method will be installed to the decorated function. Then you can retrieve and modify the state on a module by calling ``func.state(module)``. Example:: >>> # xdoctest: +SKIP >>> import torch.nn as nn >>> >>> class MyModel(nn.Module): >>> def __init__(self): >>> super().__init__() >>> self.l1 = nn.Linear(10, 10) >>> self.l2 = nn.Linear(10, 10) >>> >>> def forward(self, x): >>> return self.l2(self.l1(x)) >>> >>> @contract() >>> def my_feature(module: nn.Module) -> nn.Module: >>> my_feature.state(module).some_state = "any value" >>> return module >>> >>> model = MyModel() >>> my_feature(model.l1) >>> assert my_feature.state(model.l1).some_state == "any value" >>> my_feature(model.l2) >>> model(torch.randn(2, 10)).sum().backward() ctdtjdttjffd }dtjdttffd }||_|S)Nmodulereturnc"t}|jjt|}t |t sJdt}|jjt |}t |t sJd|vrj|vsJdjd||j|jjtt|j}t|jd}t|jd} |g|i|} | |} t| j} t| jd} t| jd} t | tjsJdt| dtt d tt d t fd }|t#|j%t#| j%d |t#|j%t#| j%d |t#| j%t#| j%d| S)Nz+Distributed composable API states corruptedz-Distributed composable API registry corruptedzOEach distinct composable distributed API can only be applied to a module once. z3 has already been applied to the following module. F)remove_duplicatezPOutput of composable distributed APIs must be either None or nn.Module, but got orig_fqnsnew_fqns check_keyc||k(ryt|t|}}||z }||z }t|s t|rt|d|d|t|d|d|)NzVComposable distributed API implementations cannot modify FQNs. Only in original FQNs: z, Only in new FQNs: z[Composable distributed API implementations cannot modify the order of FQNs. Original FQNs: z New FQNs: )setlen RuntimeError)r"r#r$ orig_fqn_set new_fqn_set orig_onlynew_onlys r check_fqnz;contract..inner..wrapper..check_fqn}s(,/ NCMk (;6 &5y>S]&$+22;=--5J 8'$+**35%%-J 0rzCheck parameters, zCheck buffer, zCheck modules, )r__dict__ setdefault STATE_KEY isinstancedict REGISTRY_KEYrrnamed_parameters named_buffers named_modulesnnModuletyperrlistkeys)rargskwargsdefault_all_state all_statedefault_registryregistryorig_named_paramsorig_named_buffersorig_named_modulesupdatednew_named_paramsnew_named_buffersnew_named_modulesr-funcrs rwrapperz(contract..inner..wrapperBs9D 060J0J,1I4 =< = 9D 060J0J.1H$ ?> ? y(T]](-J  $ /&&,X/ J  y{ 3    |~ > +F,C,C,E F !,$$e$<" "-$$e$<" 63D3F3G *7+C+C+EF  +%%u%=! !,%%u%=! gryy1 &&*7m_6 1  T#Y $s) PS 0 &++-.%**,-$  ',,./&++-.   ',,./&++-.! Nrcb|jjtijS)N)r.r/r0get)rrIs r get_statez*contract..inner..get_states/??--c r)rr7r8r r state)rIrJrMrs` rinnerzcontract..inner@sc th BIIh 8BII;Nh  h T bii HV,< " rr)rrOs` rcontractrPs'L 9vvp Lrrrc$t|tdS)z Get an ``OrderedDict`` of composable APIs that have been applied to the ``module``, indexed by the API name. If no API has been applied, then this returns ``None``. N)getattrr3)rs r _get_registryrSs 6< ..r)__composable_api_state_key)r collectionsr functoolsrtypingrrrr r torch.nnr7#torch.distributed._composable_stater rr0r3rrPr8rrSrrrrZsy #776+  !#   (._V _D/"))/c<6G1H(I/r