PhUdZddlmZmZddlZddlmZddlmZgdZee e d<d ed eeeffd Z Gd d ejjZd eded efdZGddejjZy)z0Arbitrary dependency between two autograd lanes.)ListTupleN)Tensor) get_phony)forkForkjoinJoin__all__inputreturnctjr(|jrtj |\}}||fSt |j d}||fS)z7Branches out from an autograd lane of the given tensor.F requires_grad)torchis_grad_enabledrr applyrdevicer phonys uC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/distributed/pipeline/sync/dependency.pyrrsP 5#6#6zz%( u %<%,,e< %<c VeZdZedddedeeeffdZedddededefdZy) r ctxr rcpt|jd}|j|jfS)NFr)rrdetachrr rs rforwardz Fork.forwards)%,,e<||~u||~--r grad_input grad_gradc|SN)rr r!s rbackwardz Fork.backward"srN)__name__ __module__ __qualname__ staticmethodrrrr%r$rrr r sb.V.F.uVV^/D..f&Vrr rctjr.|js |jrtj ||}|S)zMerge two autograd lanes.)rrrr rrs rr r 's3 E$7$75;N;N 5%( Lrc VeZdZedddededefdZedddedeedffdZy) r rr rrc"|jSr#)rrs rrz Join.forward0s||~rr Nc |dfSr#r$)rr s rr%z Join.backward4s 4r)r&r'r(r)rrrr%r$rrr r /sbVF6f f & U64<5H  rr )__doc__typingrrrrrrr str__annotations__rautogradFunctionr r r r$rrr4s7 5c5505>> " "v& 5>> " " r