PhD- ddlmZmZmZddlZddlmZmZddlmZm Z ddl m Z m ZgdZ ddeedeed ee d efd Zee j"d Zdddd d dd efdZej(fdededeeefdeeefd ef dZy))ListOptionalUnionN)SymIntTensor) _add_docstr_nested)_device_dtype)to_padded_tensoras_nested_tensor nested_tensornarrow tensor_listdtypedevicereturncHt|trtd|Dr td|tj }|tj k(rt j ||d|dS|tjk(rddlm }||d||\}}|Std|)ab Constructs a nested tensor preserving autograd history from :attr:`tensor_list` a list of tensors. .. note:: Tensors within the list are always copied by this function due to current nested tensor semantics. Args: tensor_list (List[Tensor]): a list of tensors with the same ndim Keyword arguments: dtype (:class:`torch.dtype`, optional): the desired type of returned nested tensor. Default: if None, same :class:`torch.dtype` as leftmost tensor in the list. device (:class:`torch.device`, optional): the desired device of returned nested tensor. Default: if None, same :class:`torch.device` as leftmost tensor in the list layout (:class:`torch.layout`, optional): the desired layout of returned nested tensor. Only strided and jagged layouts are supported. Default: if None, the strided layout. Example:: >>> a = torch.arange(3, dtype=torch.float, requires_grad=True) >>> b = torch.arange(5, dtype=torch.float, requires_grad=True) >>> nt = torch.nested.as_nested_tensor([a, b]) >>> nt.is_leaf False >>> fake_grad = torch.nested.nested_tensor([torch.ones_like(a), torch.zeros_like(b)]) >>> nt.backward(fake_grad) >>> a.grad tensor([1., 1., 1.]) >>> b.grad tensor([0., 0., 0., 0., 0.]) c3>K|]}t|t yw)N) isinstancer).0ts `C:\Users\daisl\Desktop\realtime-object-detection\venv\Lib\site-packages\torch/nested/__init__.py z#as_nested_tensor..8s0+6aJq& !!;szDas_nested_tensor(): Expected first argument to be a list of tensors Nrjagged_from_listoffsetsrr4Specified layout is unsupported for nested tensors: ) rlistany TypeErrortorchstrided_nested_tensor_from_tensor_listjagged$torch.nested._internal.nested_tensorr RuntimeError)rrrlayoutrnt_s rr r sJ k4 (C0+60- R  ~ 44[%vW[\\ 5<< I d6QVWA QRXQYZ[[a to_padded_tensor(input, padding, output_size=None, out=None) -> Tensor Returns a new (non-nested) Tensor by padding the :attr:`input` nested tensor. The leading entries will be filled with the nested data, while the trailing entries will be padded. .. warning:: :func:`to_padded_tensor` always copies the underlying data, since the nested and the non-nested tensors differ in memory layout. Args: padding (float): The padding value for the trailing entries. Keyword args: output_size (Tuple[int]): The size of the output tensor. If given, it must be large enough to contain all nested data; else, will infer by taking the max size of each nested sub-tensor along each dimension. out (Tensor, optional): the output tensor. Example:: >>> nt = torch.nested.nested_tensor([torch.randn((2, 5)), torch.randn((3, 4))]) nested_tensor([ tensor([[ 1.6862, -1.1282, 1.1031, 0.0464, -1.3276], [-1.9967, -1.0054, 1.8972, 0.9174, -1.4995]]), tensor([[-1.8546, -0.7194, -0.2918, -0.1846], [ 0.2773, 0.8793, -0.5183, -0.6447], [ 1.8009, 1.8468, -0.9832, -1.5272]]) ]) >>> pt_infer = torch.nested.to_padded_tensor(nt, 0.0) tensor([[[ 1.6862, -1.1282, 1.1031, 0.0464, -1.3276], [-1.9967, -1.0054, 1.8972, 0.9174, -1.4995], [ 0.0000, 0.0000, 0.0000, 0.0000, 0.0000]], [[-1.8546, -0.7194, -0.2918, -0.1846, 0.0000], [ 0.2773, 0.8793, -0.5183, -0.6447, 0.0000], [ 1.8009, 1.8468, -0.9832, -1.5272, 0.0000]]]) >>> pt_large = torch.nested.to_padded_tensor(nt, 1.0, (2, 4, 6)) tensor([[[ 1.6862, -1.1282, 1.1031, 0.0464, -1.3276, 1.0000], [-1.9967, -1.0054, 1.8972, 0.9174, -1.4995, 1.0000], [ 1.0000, 1.0000, 1.0000, 1.0000, 1.0000, 1.0000], [ 1.0000, 1.0000, 1.0000, 1.0000, 1.0000, 1.0000]], [[-1.8546, -0.7194, -0.2918, -0.1846, 1.0000, 1.0000], [ 0.2773, 0.8793, -0.5183, -0.6447, 1.0000, 1.0000], [ 1.8009, 1.8468, -0.9832, -1.5272, 1.0000, 1.0000], [ 1.0000, 1.0000, 1.0000, 1.0000, 1.0000, 1.0000]]]) >>> pt_small = torch.nested.to_padded_tensor(nt, 2.0, (2, 2, 2)) RuntimeError: Value in output_size is less than NestedTensor padded size. Truncation is not supported. F)rr)r requires_grad pin_memoryc|tj}|tjk(rtj|||||S|tjk(r|Dcgc]7}t |t r|jntj|9}}ddl m }tj5||d||\} } ddd j||r| j} | Std|cc}w#1swYAxYw)u Constructs a nested tensor with no autograd history (also known as a “leaf tensor”, see :ref:`Autograd mechanics `) from :attr:`tensor_list` a list of tensors. Args: tensor_list (List[array_like]): a list of tensors, or anything that can be passed to torch.tensor, where each element of the list has the same dimensionality. Keyword arguments: dtype (:class:`torch.dtype`, optional): the desired type of returned nested tensor. Default: if None, same :class:`torch.dtype` as leftmost tensor in the list. layout (:class:`torch.layout`, optional): the desired layout of returned nested tensor. Only strided and jagged layouts are supported. Default: if None, the strided layout. device (:class:`torch.device`, optional): the desired device of returned nested tensor. Default: if None, same :class:`torch.device` as leftmost tensor in the list requires_grad (bool, optional): If autograd should record operations on the returned nested tensor. Default: ``False``. pin_memory (bool, optional): If set, returned nested tensor would be allocated in the pinned memory. Works only for CPU tensors. Default: ``False``. Example:: >>> a = torch.arange(3, dtype=torch.float, requires_grad=True) >>> b = torch.arange(5, dtype=torch.float, requires_grad=True) >>> nt = torch.nested.nested_tensor([a, b], requires_grad=True) >>> nt.is_leaf True N)rrr-r.rrrr)r#r$r rr&rrdetach as_tensorr'rno_gradrequires_grad_r.r() rrr)rr-r.rlist_of_tensorsrr*r+s rrrs:~ $$ '! # # 5<<  %01$/q*4Av)>188:EOOTUDVV$/ 1 J ]]_$_d6Y^_EB -( B QRXQYZ[[1 _s>> starts = torch.tensor([0, 1, 2, 3, 4], dtype=torch.int64) >>> lengths = torch.tensor([3, 2, 2, 1, 5], dtype=torch.int64) >>> narrow_base = torch.randn(5, 10, 20) >>> nt_narrowed = torch.nested.narrow(narrow_base, 1, starts, lengths, layout=torch.jagged) >>> nt_narrowed.is_contiguous() False z$start must be an integer or a tensorz%length must be an integer or a tensorz@start and length must be integers for the strided layout NT impl)r)z!jagged layout only supports dim=1r)jagged_from_tensor_and_lengths)rrz3Specified layout is unsupported for nested narrow: )rintrrr(r#r$r unbindrr&r'r;r5rint64)r5r6r7r8r)r*r;r+s rrrsFH ec662 3ABB fsFF3 4BCC  eV $ 66(Bab b ell625== I P PQTV[]c d" I! 5<<  !8BC CW ec6] +LL%ekkRE fsFm ,\\6(6== TF1&%HAq IPQWPXYZZr,)NNN)typingrrrr#rrtorch._Crr torch.typesr Devicer DType__all__r nested_to_padded_tensorr rr$r<rr,rrGs(( ): "#  6\f6\ E?6\ V 6\  6\x ##25n)-T$V[hm8\rx8\vdicpcp?6??E#v+,>?cSYkHZ?u{?r,