Ph UddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z ddl m Z ddlmZddlmZddlmZmZej,dZej0ed<Gd d eeZGd d eeZd d e j:dedefdZde j@de j:fdZ! d!de j@dedede e j:fdZ"de j@de e j:defdZ#de j@de e j:de j:de e j:fdZ$d de jJdeddfdZ&d"deee jJfdedefdZ'y)#N)Enum)CallablecastDictIterableListSet)TensorMetadata)_pytree) tree_flattentree_unflatten graph_utilsloggerc$eZdZdZdZdZdZdZdZy)OP call_function call_module call_methodget_attroutput placeholderN) __name__ __module__ __qualname__ CALL_FUNCTION CALL_MODULE CALL_METHODGET_ATTROUTPUT PLACEHOLDERnC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/distributed/_spmd/graph_utils.pyrrs #MKKH FKr"rc eZdZdZdZdZdZdZy)CommType allreduce_ allgather_ broadcast_reduce_scatter_scatter_N)rrr ALLREDUCE ALLGATHER BROADCAST REDUCESCATTERSCATTERr!r"r#r%r%sIII%MGr"r%node is_requiredreturnc |jjdd}|rA|?td|jd|jd|jd|j |S)N tensor_metaz2Callsite expects that ``tensor_meta`` exists in ``z ``, but got None instead. Node:  )metaget RuntimeErrornameoptarget)r0r1metadatas r#get_node_tensor_metadatar=!sfyy}}]D1Hx'@ L++/77)1TYYKq  O   Or"graphct|jD]#}|jtjk(s!|cSt d|)zTake a graphmodule and return the graph output node. We traverse in reverse to expedite it, with the idea that last node should be output zCannot find the output node in )reversednodesr:rrr8)r>r0s r# get_outputrB+sA % 77bii K& 8@ AAr" predicate reverse_orderctttj|j}|r3tttjt t |}|Dcgc] }||s |c}Scc}w)zSTake a predicate and return all the nodes in the `graph` where the predicate holds.)rrfxNoderAiterr@)r>rCrDrAr0s r# find_noderI6s\ "''"EKK 0EXbgg&Xe_(=>" 6UTioDU 66 6s % A:3A:subgraphct|}t|}|D];}|jD]*}t|tj s||vs#||k7s)y=y)zEnsure nodes in ``subgraph`` satisfy one of the following rules. 1. The user of the node is in ``subgraph``. 2. The user of the node is output. 3. There are no users -- the node is a side-effect node. FT)setrBusers isinstancerFrG)r>rJ all_nodesrr0users r#is_leaf_subgraphrQ@sV"(mI  FJJDdBGG,9$  r"r;ct|}t}g}|j|5|D]}|j|j|j |j |j}tj|j i|j }t|j |j f\} } g} t|| D]O\} } t| tjr| |vr| |vsJ| j|| ?| j| Qt!| | \|_|_|||<|j| ddd|S#1swY|SxYw)zClone the given subgraph and insert it before ``target``. This API currently does not support inserting after ``target``. N)rLdictinserting_beforerr;argskwargstypepytreearg_tree_leavesr ziprNrFrGappendr )r>rJr;rOmappingcloned_subgraphr0 cloned_nodeoriginal_input cloned_inputspecmapped_cloned_inputoriginal_input_nodecloned_input_nodes r#clone_subgraphreRsUH I&*fGO    'D-- TYY TYYK $33TYYN$++NN!-{/?/?ASAS.T!U L$"$ := ;6#%62BGG<+y8.'999'..w7J/KL'../@A;4B#T4 0K k0(GDM  " "; /3 (8 9 (8 s D"EE gmremove_dead_codec|jj|r|jj|jy)zRun the required steps to ensure production-ready graph. Note - per the fx docs, elimination of dead code is not very precise. Hence, the flag to make this step optional. N)r>linteliminate_dead_code recompile)rfrgs r# rebuild_graphrl{s- HHMMO $$&LLNr"graphsfoldercF|stj}|jD]U\}}ttj j ||dd5}|jt|dddWtjd||S#1swYyxYw)Nz.graphwzDump graphs to %s) tempfilemkdtempitemsopenospathjoinwritestrrwarning)rmrnprefixrffps r#dump_graphs_to_filesr}s !!#lln  "'',,v&'893 ?2 HHSW @ ?% NN&/ M @ ?s BB )T)F))(loggingrurqenumrtypingrrrrrr torch.fxrFtorch.fx.passes.shape_propr torch.utilsr rXtorch.utils._pytreer r getLoggerrLogger__annotations__ryrr%rGboolr=GraphrBrIrQre GraphModulerlr}r!r"r#rs{ <<5)<+**=99 d sD277BbhhB277BAF7 887 (79=7 "'']7BHHRWW $$& 88&#BGG}&68gg& "'']&R bnn    c2>>&9!: C QT r"