PhddlZddlZddlmZddlZddlZddlZdefdZer"ejjse dejjZ ejjZejj Zejj$ZerddlmZmZmZmZmZmZmZmZmZmZm Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-dde.fdZ/ej`d k7rdd lm1Z1m2Z2d d l3d d l3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:d dl;m;Z;mm?Z?e,yGddZ@e@ejd_y)N)Enumreturnc6ttjdS)a Return ``True`` if the distributed package is available. Otherwise, ``torch.distributed`` does not expose any other APIs. Currently, ``torch.distributed`` is available on Linux, MacOS and Windows. Set ``USE_DISTRIBUTED=1`` to enable it when building PyTorch from source. Currently, the default value is ``USE_DISTRIBUTED=1`` for Linux and Windows, ``USE_DISTRIBUTED=0`` for MacOS. _c10d_init)hasattrtorch_CeC:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/distributed/__init__.py is_availabler s 588\ **r z&Failed to initialize torch.distributed)Store FileStoreTCPStore ProcessGroupBackend PrefixStoreReducerLoggerBuiltinCommHookType GradBucketWork_DEFAULT_FIRST_BUCKET_BYTES_register_comm_hook_register_builtin_comm_hook_broadcast_coalesced"_compute_bucket_assignment_by_size_verify_params_across_processes_test_python_store DebugLevelget_debug_levelset_debug_levelset_debug_level_from_env_make_nccl_premul_sumrankct|k(rd}ttjtj r$tj}t dt_ td|d|4tjj|t_tyty#|*tjj|t_wwxYw)a Set a breakpoint, but only on a single rank. All other ranks will wait for you to be done with the breakpoint before continuing. This calls ``breakpoint()`` under the hood, so you can customize it using the normal facilities, e.g., ``PYTHONBREAKPOINT`` environment variable. Args: rank (int): Which rank to break on. Default: ``0`` NrzS !!! ATTENTION !!! Type 'up' to get to the frame that called dist.breakpoint(rank=z) )header) get_rank isinstancesysstdinio TextIOWrapperopen breakpointclosebarrier)r% old_stdins r r/r/;s : I#))R%5%56II  G  *VVZU[[^` (IIOO% )CI  (IIOO% )CI)s B...Cwin32) HashStore_round_robin_process_groups)*)_all_gather_base_reduce_scatter_base_create_process_group_wrapper_rank_not_in_group_coalescing_manager_CoalescingManager_get_process_group_name) rendezvous_create_store_from_optionsregister_rendezvous_handler)_remote_devicec eZdZy)_ProcessGroupStubN)__name__ __module__ __qualname__r r r rDrDs r rDztorch.distributed)r)Bosr*enumrpdbr,rboolr r r RuntimeError _DistError DistError_DistBackendErrorDistBackendError_DistNetworkErrorDistNetworkError_DistStoreErrorDistStoreErrortorch._C._distributed_c10drrrrr_Backendrrrrrr_Workrrrrrrrr r!r"r#r$intr/platformr4r5distributed_c10dr8r9r:r;r<r=r>r?r@rA remote_devicerBrDmodulesr r r r]s   +d +>%((--/ ? @@ HH   88--88--))>4: ||w $  .  4ECKK#$1r