>:j>SSKr\R4SjrSrSrSrg)Nc URU5nURupEpg[XU5n[R"XEXhX2S9n [R"XEXX2S9n [ U5Hmn [ U5H[n [R "X U SS2SS24USSS9upnU SS2SU24XU SS2SS24'USS2SU24RXU SS2SS24'M] Mo X4$)a Perform slice-wise PCA (SVD) on 4D tensor. Args: tensor: 4D tensor of shape (B, C, H, W) r: rank for low-rank approximation device: computation device dtype: data type Returns: VVT: Right singular vectors (B, C, r, W) UU: Left singular vectors (B, C, H, r) )dtypedeviceN)qniterMr)toshapemintorchzerosrange svd_lowrankT)tensorrrrBCHW effective_rUUVVTijU_Vs U/home/mande/repo/quber/.venv/lib/python3.13/site-packages/peft/tuners/adamss/utils.py slice_pcar!sYYv FJA!aA,K Q1 FB ++aK% GC 1XqA''!Qz(:kQRVZ[GA!q!K-/0B!QzN1[= 0133C1a O 7NcjSSKJn UR5R 5R 5R S5n[XRS5nU"USSUSS9nURU5n[R"U5R5U4$![a [S5ef=f) a Cluster the rows of VT into K subspaces using K-Means. Args: VT: Matrix to cluster (rows are clustered) num_subspaces: Number of clusters (subspaces) iternum: Maximum iterations for K-Means Returns: cluster_idx: Cluster assignments as a ``torch.LongTensor`` effective_num_subspaces: Actual number of subspaces used (``int``) Note: This function requires scikit-learn to be installed. Install it with: pip install scikit-learn r)KMeanszdscikit-learn is required for AdaMSS initialization. Please install it with: pip install scikit-learnfloat32randomi[) n_clustersinitn_initmax_iter random_state) sklearn.clusterr$ ImportErrordetachcpunumpyastyper r fit_predictr from_numpylong)VT num_subspacesiternumr$vteffective_num_subspaceskmeansidxs r clustering_Zr=2s" *   " ) )) 4B"-!= *!gdmF   R C   C % % ')@ @@)   r   s BB2c[UR5R55S-n0n[U5H n[R "X:H5SX#'M" U$)aX Segment indices into locations based on cluster assignments. Args: index: Cluster assignments as a ``torch.LongTensor`` Returns: location: Dict mapping cluster id to ``torch.LongTensor`` of row indices. Clusters are ordered by their smallest index so that KMeans label permutations do not affect downstream ordering. r'r)intmaxitemrr where)indexKlocationrs r seg_locationsrF\sQ EIIK   !#AH 1Xkk%*-a0  Or"c*[[U55$)z Get all trainable subspace indices. Args: num_subspaces: Number of subspaces Returns: List of trainable subspace indices (``list[int]``) )listr)r7s r get_trainable_subspacesrIos m$ %%r")r r%r!r=rFrIr"r rKs* (-}}@'AT& &r"