PhJ@ XddlmZddlZddlmZmZddlmZddlm Z ddl m Z ddlda e Z dd d ZGd d ejZGd dej"j$ZGddej"j$ZGddej"j$Z ddeejdeejdeeejffdZdejdejdejdeeejeejffdZdZy))TupleN) DispatchKeyDispatchKeySet)is_expandable_to)has_free_symbols)WeakTensorKeyDictionary)*coeffc|tvr4tjjt|t|<tdz at|S)Nr )_tensor_symint_registrytorch_C_get_singleton_int_tensor_id_counter)tensorr s oC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/nested/_internal/nested_tensor.pyget_tensor_symintrsB ,,*/((*E*E + ' a "6 **c@eZdZUejed<ejed<eejed<eedfed<eedfed<eed<eed<eed <e d d d Z d d fd Z dZ dZ dZdZdZdZe defdZeddZeddZxZS) NestedTensor_values_offsets_lengths._size_stride _ragged_idx _max_seqlen _min_seqlenN)lengthsc Nttj}|jtj}t j j|dddt j|jt j|jd|jddddd|}|S)N)rrF requires_gradsizesT) rrraddAutogradNestedTensorrTensor_make_wrapper_subclasscontiguous_formatdtypejaggeddeviceget)clsvaluesoffsetsr!kwargsksrs r__new__zNestedTensor.__new__2sK44 5 VVK44 5 LL / /     # # LL LL MM  JJ .      rc t ||J|jdk(sJt|trJ||n|}t |d}|j dd|_|jddz }|jd|jdz |j|jdz}|g} | j|d|jdz | j|| j||jdz dt| |_ |j} || |jdz zg| |_|jr t!d||_||_||_d} d|vr|dn(| t(j*||j-n||_d|vr |d|_y| t(j0||j-n||_y) Nr r rrzaNestedTensor values cannot require grad, please detach before passing to NestedTensor constructorc@t||jSN)intitem)funcrs rget_sdpa_extreme_seqlenz6NestedTensor.__init__..get_sdpa_extreme_seqlenqstF|((*+ +rrr )super__init__ndim isinstancerrr-rshapeextendappendtuplerstride_stridesr# ValueErrorrrrrmaxdiffrminr ) selfr/r0r!r1 ragged_source ragged_sizeBDs nested_sizerDr; __class__s rr=zNestedTensor.__init__Os """||q   fl333$+? ' Q? !::mQ7 MM! q  \\0D,,q0 1FLLAQAQAS4T Tc 24 0 01 456;'2d..2456;' $vd.>.>.B'CCMfM   D     ,& = !( W_7<<>' & = ! ) W_7<<>' rc|jSr7)rrJs rr/zNestedTensor.valuess ||rc|jSr7)rrRs rr0zNestedTensor.offsets }}rc|jSr7)rrRs rr!zNestedTensor.lengthsrTrc|jrd|jnd}|jrd|j}d|jd|j|d|jdudS)Nz, requires_grad=z , grad_fn=zNestedTensor(size=z , offsets=z , contiguous=))r#grad_fnrrr)rJ grad_fn_strs r__repr__zNestedTensor.__repr__su8<7I7It112 3r  <<&t||n5K#DJJv.F6:-5H #M 2 /\*\*\*  rc\|in|}ddlm}||g|i|}|||i|St|)Nr ) lookup_jagged)opsruNotImplementedError)r.r:typesrer1rufns r__torch_dispatch__zNestedTensor.__torch_dispatch__sF~6 ' 4 1$ 1& 1 >t&v& &!$''rc|i}ddlm} ||g|i|S#t$rYnwxYwtjj 5||i|cdddS#1swYyxYw)Nr )jagged_torch_function)rvr|rwrrDisableTorchFunctionSubclass)r.r:rxrer1r|s r__torch_function__zNestedTensor.__torch_function__sd >F. (??? ?"    XX 2 2 4((5 4 4s  $$AA )N)__name__ __module__ __qualname__rr'__annotations__Optionalrr8 staticmethodr4r=r/r0r!r[rfrmDictrs classmethodrzr~ __classcell__)rPs@rrrs \\llu||$$ c? 38_  8484 l| V "0 D0 0 d ( ( ) )rrcLeZdZedefdZedejfdZy)ViewBufferFromNestedxc|j|j|j|_|j|_|j |_|jSr7)save_for_backwardr0rrhr rirr/)rkrs rforwardzViewBufferFromNested.forwardsC aiik*--xxzrgOcz|j\}t|||j|j|jS)N)r0rr r) saved_tensorsrrhrir)rkrr0s rbackwardzViewBufferFromNested.backward s7&&     rN) rrrrrrrr'rrrrrrs:  %,,  rrc leZdZedej dej dedefdZedefdZ y) ViewNestedFromBufferr/r0rhric<t|j|||S)N)r0rr rdetach)rkr/r0rhris rrzViewNestedFromBuffer.forwards! MMO""   rrc*|jdddfSr7r/rkrs rrzViewNestedFromBuffer.backward!syy{D$,,rN rrrrrr'r8rrrrrrrrsT U\\ ELL c _b  -,--rrc eZdZedej dej dej dedef dZedefdZ y ) !ViewNonContiguousNestedFromBufferr/r0r!rhric>t|j||||S)N)r0r!rr r)rkr/r0r!rhris rrz)ViewNonContiguousNestedFromBuffer.forward)s$ MMO""   rrc,|jddddfSr7rrs rrz*ViewNonContiguousNestedFromBuffer.backward3syy{D$d22rNrrrrrr(s` U\\ ELL 5<< eh vy  3,33rrtensorsr0returnc  ttd|Ddk(s tdttd|Ddk(s td|Dcgc]}|j}}|Dcgc]}|dd c} t fd D}|s tdt j |d }i} ||| d <||| d <|jdi| }|t j t jdt j|j t j|Dcgc]}|d  c}|jjd g}t|Dcgc]}|jd c}} t|Dcgc]}|jd c}} tj!||| | |fScc}wcc}wcc}wcc}wcc}w)zHConstructs a NestedTensor backed by jagged layout from a list of tensorsc34K|]}|jywr7)r*.0ts r z#jagged_from_list..As,Gq177Gr zOWhen constructing a nested tensor, all tensors in list must have the same dtypec34K|]}|jywr7r,rs rrz#jagged_from_list..Es-W188WrzQWhen constructing a nested tensor, all tensors in list must be on the same deviceNc3.K|] }|dk(yw)rNr)rsnon_first_sizess rrz#jagged_from_list..OsP1qOA$66szCannot represent given tensor list as a nested tensor with the jagged layout. Note that the jagged layout only represents shapes of the form (B, *, D_0, D_1, ..., D_N), with only * allowed to be ragged.r)dimr,r*r*r,rr)rqset RuntimeErrorr@allrcattozerosint64r,rcumsumrGrIrapply) rr0r*r,rr$rat_most_first_raggedr/ to_kwargsrhrirs @rjagged_from_listr9s s,G,, - 2 ]   s-W-- .! 3 _  & &gQWWgE &&+,eque,OPPP  L  YYwA &FI $ ( " ' VYY # #F)) AU[[G E2EqadE26==IPPUVPW  '2'Qaggaj'23J'2'Qaggaj'23J  % %fgz: NPW WWA ',0332sG1 G - G*GGrstartsr!c|jd}t|j|fr:t|j|fr#|j|}|j|}n tdt |jdk\sJd|jd}|t j d|t j|jz}t j||z|d|dz|dzjdg}t |jdkDr!|jdg|jdd} n|jd} d } |jd} t j|ddj| rd } t j|dd jj| rd } |d|dz| k7rd } tt j |j#} tt j$|j#} | r*t&j)| |d|d||dz | | |dfSt*j)| ||| | ||fS) zjConstructs a NestedTensor backed by jagged layout from a tensor, starts of sequences, and sequence lengthsrzWhen constructing a jagged nested tensor using narrow(), your start and length must be Tensors that broadcast to input.shape[0]roz;tensor must at least be 2D for the nested narrow op to workr rNTF)r@rexpandrrqrarangerr,r unsqueezeviewanynerHr8rGr9rIrrr)rrr! batch_size start_list length_list max_seq_lenoffset_lengthsr0r/ is_contiguousorig_dimactual_max_seqlenris rjagged_from_tensor_and_lengthsrpsiaJ zm49I }:]]:. nnZ0  U   FLLQEDE,,q/K 5<< :U[[$Nii  ' ^nR0 0;r? B M Ma P G 6<<1R3&,,qr"23RM||AH yyQr"%%h/0  yy2##%((23 qzKN"h. EIIg.3356UYYw',,./J & &wqzGBK0'!*$!       *// G[*;Z    rc,tj|Sr7)rr)r+s rbuffer_from_jaggedrs  % %f --r)NN)typingrrtorch._Crrtorch._prims_commonr%torch.fx.experimental.symbolic_shapesrtorch.utils.weakrrrrr'rautogradFunctionrrrListrrrrrrrrs) 00B413()+e)5<<e)R 5>>22 , -5>>22 -" 3(?(? 3(   4X %,, 4X ell #4X  < %& 4XnE LLE"',,E9>E <x '= =>EP.r