Phr UdZddlmZmZmZmZddlmZddlm Z gZ ee e d<GddZ d eejd e fd Zy ) z8Static skip connection layout of ``@skippable`` modules.)DictIterableListTuple)nn) Namespace__all__ceZdZUdZeeeefeeeffe d<e e eeeefe d<dedeeeefeeeffddfdZ d ede eeeeffd Z d ed edefd Zy) SkipLayoutz6Represents a skip connection layout across partitions. by_ns_name by_partitionnum_partitions skip_routesreturnNc||_t|Dcgc]}gc}|_|jD],\\}}\}}|j|j |||f.|jD]}|j ycc}wN)r rangeritemsappendsort) selfrr_nsnameprev_jnext_jps vC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/distributed/pipeline/sync/skip/layout.py__init__zSkipLayout.__init__s%*/~)>?)>AR)>?,7,=,=,? (JR(   f % , ,fb$-? @-@""A FFH# @s Brc#VK|j|D]\}}}||k(r |||fyw)zGenerates skip routes for the given destination partition number. The skip routes are sorted by source partition number in ascending order. Yields: Each tuple of (source partition number, namespace, name). N)r)rrrrrs r copy_policyzSkipLayout.copy_policy's>!% 1 1& 9 FB2t$ $ !:s')rrcN|jj||fd\}}||k7S)zbWhether the given namespace and name requires partition-to-partition copy or not. )r$)r get)rrrrrs r requires_copyzSkipLayout.requires_copy8s-,,b$ZB)__name__ __module__ __qualname____doc__rrr strint__annotations__rr rr"boolr&r'rr r s@U9c>*E#s(O;<<tE#y#"56788 s eIsN>SUZ[^`c[cUd>d9e ko %#%(5i9L3M*N%"    r'r partitionsrcddlmiit|D]?\}fd}t|tj r|D] }|| 8||At t|S)z.inspect_layerKsneY/!OO-D)* B:&."NN,D#T 3+11+ RJ'-r') skippabler3 enumerater5r Sequentialr len)r1 partitionr<r9r3r:rr;s @@@@rinspect_skip_layoutrB@si %@BK35J!*- 9 6 i /"e$# ) $!.$ c*o{ 33r'N)r+typingrrrrtorchr namespacer r r,r.r r?rBr0r'rrFsK?.. c, , ^4D$74J4r'