PhjdddlZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z mZddlmZmZmZmZej(eZd%deed ed efd Zd Zd ZdZdZdZdZdZ dZ!dZ"dZ#dZ$dZ%dZ&dZ'dZ(dZ)dZ*dZ+dZ, d&dZ-d Z.d!Z/d"Z0d'd#Z1d'd$Z2y)(N)GraphDef)NodeDef)TensorShapeProto) caffe2_pb2)core workspace)SetDictTupleListseenname min_versionct|J|}|rd||fzn|}||vr|dz }d||fz}||vr|j||S)a Make the name unique by appending a unique number to the name. Used for SSA. Args: seen (set): Set of names that have already been used (with respect to some context). name (str): The name to make unique min_version (number): Starting index. Is incremented continually until it can make the resulting name unique relative to 'seen'. Returns: x (str): A version of name that is not in seen. z%s_%d)add)r rrixs pC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/utils/tensorboard/_caffe2_graph.py_make_unique_namers`   A 4)dA t) Q tQi  t) HHQK Hc " tjd tjdtjdtjdtjdtjdtjd tjd tjd  tjd  tjd  f d }t||||y )a8 Convert some of the common names in Caffe2 to tensorflow. NOTE: The common names in both Caffe2 and Tensorflow are currently hardcoded, if either side changes at some point, then this code should change as well. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. blob_name_tracker: Dictionary of all unique blob names (with respect to some context). ops: List of Caffe2 operators Returns: None. The _rename_all() call modifies blob_name_tracker and ops in-place. z(_w)$z(_w_)z(_bn)$z(_bn_)z(_b)$z(_b_)z(_s)$z(_s_)z(_sum)$z(_sum_)z (_branch)c jd jd|}jdjd|}jdjd|} jdjd|} jd jd |}jd |}|S) Nz/weight_z/weightz /batchnorm_z /batchnormz/bias_z/biasz/scale_z/scalez/sum_z/sumz/branch)sub)r inter_namenew_nameBIASBIAS_BNBN_BRANCHSCALESCALE_SUMSUM_WEIGHTWEIGHT_s rfz#_rename_tensorflow_style..fFs[[VZZ 4-HI WW]BFF<,LM YYx':)FG ZZ 599Xz+JK XXgswwvz'BC ::i4rN)recompile _rename_all)shapesblob_name_trackeropsr(rrrr r!r"r#r$r%r&r's @@@@@@@@@@@r_rename_tensorflow_styler/)s"ZZ !Fjj"G I B **Y C ::h D JJx E JJx E ZZ !F **Z C ::j !D ZZ %F)32rc tj|}t i iidtdttt fdt f fd t ||jD]\} | jusJt|j}t|j}|jdd=|jdd=|jj fd|D|jj fd|Djjr"jjyy)a Convert an operator graph to SSA (i.e. out-of-place). i.e. blobs will be renamed so that each blob is produced only once. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. blob_name_tracker: Dictionary of all unique blob names (with respect to some context). ops: List of Caffe2 operators Returns: None. Modifies blob_name_tracker and ops in-place. rversionsreturnc||vsJ||}||f vr ||fSt||}| ||f<|vr||<r |vr||<|S)N)rr) rr1versionrr-new_blob_name_tracker new_shapesr r, versioneds rssa_namez!_convert_to_ssa..ssa_namegsx4. '?i 'dG_- - %T4WE%- 4/" 6>#)$z"_convert_to_ssa..sKFDs7F c3DK|]}|jywr;) out_versionsr=s rr@z"_convert_to_ssa..sNgd$(8(89grA)rIRsetstrr intzipr?oplistinputoutputextendclearupdate) r,r-r.irrIinputsoutputsr6r7r r?r9r8s `` @@@@@@r_convert_to_ssarSRs BUD,.IJsd38n$bff% SSVV||bhhryy/ HHQK IIaL KFKK NgNN& LLN MM*!  !67rct}|D]8}|j|j|j|j:|Dcic]}||c}Scc}w)z Get all the operator input and output blobs and perform dedup on their names. Args: ops: List of Caffe2 operators to extract inputs and outputs from Returns: set containing distinct inputs and outputs from 'ops' )rErOrKrL)r.namesrIrs r_get_blob_namesrVsS EE RXX RYY$) )54D$J5 )) )s Ac|jDcic]\}}|||}}}|j|j|ycc}}w)a Rename keys of 'old_dict' according to 'rename_fn'. Args: old_dict: Dictionary (i.e. containing blob_name -> blob_name relationships.) rename_fn: Function string -> string for renaming. Returns: None. Modifies old_dict in-place. N)itemsrNrO)old_dict rename_fnkeyvaluenew_dicts r _remap_keysr^sK9A8HI8H*#u #%8HHI NN OOHJsA c t i fd|D]}t|j}t|j}|jdd=|jdd=|jj fd|D|jj fd|Dt ||r t | j j |D]}|j|_y)a Rename all the names in the operators. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. blob_name_tracker: Dictionary of all unique blob names (with respect to some context). ops: List of Caffe2 operators rename_fn: Function string -> string that specifies how to rename Returns: None. Modifies shapes, blob_name_tracker and ops in-place using the specified 'rename_fn'. cN|y|vr|St|}||<|S)zCollision-free version of f.Nr4)rrrZrenamedr s rgz_rename_all..gs: < 7?4= $T9T?;  rNc3.K|] }|ywr;r>rrbs rr@z_rename_all..s3FD$Fc3.K|] }|ywr;rdres rr@z_rename_all..s5WT4Wrf)rErJrKrLrMr^rNr) r,r-r.rZrIrQrRrbrar s ` @@@rr+r+sUD*,Gbhhryy/ HHQK IIaL 3F33 5W55 %q) JJL MMOBGG*rc&d}t||||y)a For all operators or blobs with name containing "_grad", add a "GRADIENTS/" scope. Note: breaks graph execution since the blob -> gradient mapping is hardcoded. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. blob_name_tracker: Dictionary of all unique blob names (with respect to some context). ops: List of Caffe2 operators Returns: None. Modifies shapes, blob_name_tracker and ops in-place by renaming. cd|vrd|S|S)N_gradz GRADIENTS/rdrs rr(z_add_gradient_scope..fs d?v& &KrNr+)r,r-r.r(s r_add_gradient_scoperms" )32rc,fd}t||||y)a `:i` has a special meaning in Tensorflow. This function replaces all colons with $ to avoid any possible conflicts. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. blob_name_tracker: Dictionary of all unique blob names (with respect to some context). ops: List of Caffe2 operators repl: String representing the text to replace ':' with. Usually this is '$'. Returns: None. Modifies blob_name_tracker in-place. c(|jdS)N:)replace)rrepls rr(z_replace_colons..fs||C&&rNrl)r,r-r.rrr(s ` r_replace_colonsrss"')32rcjt}|D]8}|j|j|j|j:|D]}|jr |j}n|js |jr|jxs |jDcgc]!}t j j|#}}t j j|}t j j||j}n |j}|sJt|||_ycc}w)a\ Give missing operators a name. We expect C2 operators to be generally unnamed. This gives them a scope (inferred from their outputs) and a name after their type. Duplicates will be postfixed by an index. Args: ops: List of Caffe2 operators to assign names to. Returns: None: Modifies 'ops' in-place. N) rErOrKrLrospathdirname commonprefixjointyper)r.r rIr name_listscopes r_fill_missing_operator_namesr} s 5D BHH BII 7777D YY"((;=99;P;PQ;P4.;PIQGG((3E77<<rww/D77D t#D$/Rs&D0c |jdsy|jtjk(s|jtjk(ry|jtj k(rd|j Std|)a Handle the devices. Args: device_option (caffe2_pb2.DeviceOption): DeviceOption protobuf, associated to an operator, that contains information such as device_type (optional), cuda_gpu_id (optional), node_name (optional, tells which node the operator should execute on). See caffe2.proto in caffe2/proto for the full list. Returns: Formatted string representing device information contained in device_option. device_typez/cpu:*z/gpu:zUnhandled device)HasFieldrrCPUMKLDNNCUDA device_id Exception device_options r _tf_devicer+sr  ! !- 0!!Z^^3  $ $ (9(9 9  JOO3}../00 & 66rct}|D]9}tj}||_|jj |g;|dj j j |gy)a6 Convert a list of ints to a TensorShapeProto representing the dimensions of a blob/object. Args: attr_dict: Dictionary to update (usually attributes of a Node) ints: List of integers representing dimensions of some object. Returns: None. Modifies attr_dict in-place. _output_shapesN)rDimsizedimrMrJshape) attr_dictints shape_protorrs r _add_tf_shaperFsc#$K ""$u%$$**11;-@rc|j}|dk(r#|jrt||jy|jdr|j||_y|jdr|j ||_y|jdrSt |jtr |jn#t|jjd||_y|jr3||jjj|jy|jr3||jj j|jy|jr:||jjjd|jDy||jjjgy)a3 Add attributes to a node. Key is the arg.name, and values can be shape, floats, strings, ints or an empty list. Args: attr_dict: Dictionary to update (usually attributes of a Node) arg: Object with name and data fields. Returns: None. Modifies attr_dict in-place. rNr(rsutf-8c3tK|]0}t|tr|nt|jd2yw)rN) isinstancebytesrFencode)r>rs rr@z_set_tf_attr..}s/# KVaAu%A3q6==+A A;s68)rrrrr(rrrrrFrfloatsrJrMstrings)rargks r _set_tf_attrrYs] AG|i* ||C !  ||C !  ||Cu-CEE3suu:3D3DW3M !   zz! ""3::. xx! ""388, {{! ""# KN;;#    aLr"rc|jsJ|t}|j|_|jj|j|j|_t |j|_|r0|jD]!}||vrnt|j||#|jD]}t|j||S)a Convert an operator to a node in a TF graph. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. op: The Caffe2 operator to convert to a TF graph node. Returns: n: The TF graph node created from op. )rrrKrMrzrIrrdevicerLrattrrr)r,rInrLrs r_operator_to_noders 77B7 A WWAFGGNN288 77AD"**+AH iiFV# !&&&. 1 vvQVVS! Hrc|sJg}|jDcgc] }||vs| }}|j|t|}|dk(rt}|d|_|j j |j |j|_t|j|_ |jD]}t|j||j||S|dkDr|jr |j} nTt!|} t"j$j'| } t"j$j)| |j} | sJt+|| |_t|j} |D]X} t}| |_|j j |jgd|_| |_ |j|Zt}|j|_|j j |j |j|_| |_ |jD]}t|j||j||Scc}w)a" Convert the operators to nodes. Args: op: Caffe2 operator to convert to node inter_blobs: Set of intermediate blobs seen: Names that have already been used and are not unique Returns: nodes: Nodes representing 'op' and the outputs of 'op' rrBlob)rLrOlenrrrKrMrzrIrrrrrrappendrJrurvrxryr)rI inter_blobsr nodesorR len_outputsrrrr{r|rrLs r_operator_to_node_simprs I2 E))<)Qq ';q)G<KKg,Ka I rxx wwb../66C  % Q@ L? q 7777DW IGG((3E77<<rww/D t#D$/B,,-F AAF GGNNBGG9 %ADAH LLO  I rxx ww66C  % Q LY=s I0I0c|sJt}||_|j|g}t|dkDrd|_nd|_|j j d|D|r6|ddjtfd|Drt|_ |r||vrt|j|||S)a Convert a blob (operator input or output) to a node in a TF graph. Args: producing_ops: Dictionary of blob name to list of (producing_op, blob_index within producing_op.output) mapping. shapes: Dictionary mapping blob names to their shapes/dimensions. name: String representing the name of this blob. Returns: n: The TF graph node created from this blob. rr Placeholderc3DK|]\}}d|j|fzyw)z%s:%dNrk)r>p_oprs rr@z _blob_to_node..s"G;a7dii^+;s c3BK|]}|djk(yw)rNr)r>producerrs rr@z _blob_to_node..s!O;xx{((F2;s) rrgetrrIrKrMrallrrrr) producing_opsr,rr produced_byrs @r _blob_to_noders K4 A AF ##D"-K ;!GGNNG;GGQ"00 O;O O!&)AH $&.afffTl+ Hrc^|sy|D]%}|jds|jd'y)a Remove debug information from operators, they are copious. Args: ops: List of Caffe2 operators perform_clear: Boolean passed from _operators_to_graph_def specifying whether to remove the debug information. This boolean is passed into this function to reduce the complexity of _operators_to_graph_def. Returns: None. Modifies the list of Caffe2 operators in-place and removes the 'debug_info' field. N debug_info)r ClearField)r. perform_clearrIs r_clear_debug_infors,  ;;| $ MM, 'rcV|jddkxs|jddkS)a. Blobs with names containing '_m' or 'grad' are part of the backward pass. This function references facebookresearch/Detectron/detectron/utils/net.py. Args: blob: The blob to inspect Returns: Boolean representing whether this blob is part of the forward pass __mrgrad)findblobs r_check_if_forwardrs+ 99U a  8499V#4q#88rc&|jd S)z Check if the blob's name starts with '_gpu'. Args: blob: The blob to inspect Returns: Boolean representing whether this blob is associated with a gpu _gpu) startswithrs r _check_if_cpur(sv& &&rct}t}|D]F}|jD]}|j||jD]}|j|Ht |j |}t |j |}|Dchc]}|j ds|} }|Dcgc] }|| vs| }}|| |fScc}wcc}w)a] Find the input, intermediate and output nodes of a set of operators. Args: ops: List of Caffe2 operators to look through Returns: input_blobs: The input nodes of the set of operators inter_blobs: The intermediate nodes of the set of operators output_blobs: The output nodes of the set of operators _)rErKrrLrJ differencer) r.in_blobs out_blobsrI input_blob output_blob input_blobs output_blobsbrs r_compute_in_outr5suHI((J LL $#99K MM+ &% x**956K ,,X67L*@lall3.?1lK@+D|!q /CA|LD  \ 11ADsC/C9 CCc|s|Sg}|D]}t|j}t|j}|jdd=|jdd=|Dcgc] }||s |}}|D cgc] } || s | } } | s~|jj||jj| |j ||Scc}wcc} w)a Filter unwanted operators based on criteria in 'filter_fn'. Args: ops: List of Caffe2 operators to filter filter_fn: Criteria function for whether inputs/outputs in an operator should be filtered. perform_filter: Boolean passed from _operators_to_graph_def specifying whether to filter operators Returns: new_ops: Subset of ops containing a subset of their inputs and outputs. N)rJrKrLrMr) r. filter_fnperform_filternew_opsrIrQrRr new_inputsr new_outputss r _filter_opsrRs  Gbhhryy/ HHQK IIaL!'8A9QCc||jni}|jt|t||t |t |}t |t |}|rt|||||rt|||||r t||||r t|||t||r t|||i}t} t|\} } } t} t| }|D]}|r t!|| |n t#||g}| j$j'||j(D]}| j+|t-|j.D]9\}}| j+||j1|gj3||f;|r| } t5| D])}| j$j't7|i|g+| S)a: Convert a set of operators to a graph using the main function. Args: shapes: Dictionary mapping blob names to their shapes/dimensions. ops: List of Caffe2 operators, representing some computation graph ### **kwargs (model_to_graph_def, nets_to_graph_def, protos_to_graph_def) ### colon_replacement: Symbol to replace ':' with. ':i' in TF has a special meaning, so we need to replace it with a non-conflicting symbol. with_ssa: Boolean with_gradient_scope: Boolean blob_name_tracker: Dictionary tracking names of blobs (inputs/outputs from operators) show_simplified: Whether to show a simplified version of the model graph Sets all of the following values: clear_debug_info: Boolean representing whether to silence debug info (which can be very verbose) show_forward_only: Boolean representing whether to only show blobs involved in the forward pass show_cpu_only: Boolean representing whether to only show blobs that are not associated with a gpu use_tensorflow_naming: Boolean representing whether to convert some common Caffe2 naming conventions to their Tensorflow counterparts custom_rename: Function string -> string that defines a custom renaming function to use. Returns: current_graph: GraphDef representing the computation graph formed by the set of operators. )rNrOrVrrrrr+rsrSrmr}r/rErrrrnoderMrKr enumeraterL setdefaultrsortedr)r,r.colon_replacementwith_ssawith_gradient_scoper-show_simplified custom_renamerblobsrrr current_graphr rI nodes_from_oprrrrs r_operators_to_graph_defrusR$!_S12c?+ c,o >C c=/ :CF-sMB 138IJ 137F$5s; % ):C@8:M EE"1#"6KaJM { D #2{D 9#FB/0  !!-0((J IIj !#' 2NA{ IIk "  $ $[" 5 < r s  79F#)))g! CH C c 0&3R48n*"",^343.0@76A&)#X 8:z  F(. 9 '2: L Wt=*,-&7.:r