>:j#0SSKrSSKJr SSKrSSKJr SSKJs Jr SSK J r SSK J r J r SSKJr SSKJr "SS \ 5r"S S \R&\5rg) N)Optional)Conv1D)BaseTunerLayercheck_adapters_to_merge) transpose) BufferDictc \rSrSrSrSrS\R4Sjr\ S\ 4Sj5r SS\ S \ S \ S \ 4S jjrSS \ 4S jjrSrg) VeraLayer) vera_lambda_b vera_lambda_d)vera_Avera_B base_layerc jXl0Ul[R"05Ul[R "05Ul[R "05UlSUlSUl SUl /Ul UR5n[U[R5(aURUR pCO^[U["5(aI[%UR&S5(aUR&R(OUR&R*up4WUlWUlX lg)NFds_shape)rrnn ModuleDict vera_dropout ParameterDictr rrr_disable_adaptersmerged_adaptersget_base_layer isinstanceLinear in_features out_featuresrhasattrweightrshapekwargs)selfrr#rrs S/home/mande/repo/quber/.venv/lib/python3.13/site-packages/peft/tuners/vera/layer.py__init__VeraLayer.__init__"s$MM"- --b1--b1-1 ,0 "'!((* j")) , ,(2(>(> @W@W  F + +.5j6G6G.T.T !!**ZdZkZkZqZq &K'( returnc,[UR5$N)boolr)r$s r%mergedVeraLayer.merged@sD(())r(rr d_initialinference_modec  RUS::a[SU35eX@RU'US:a[R"US9n O[R"5n UR R [R"X055 [R"[R"UR5SS9URU'[R"[R"U5SS9URU'X lX0lX;Ga[#UR5S:a [S5e[%URR'55Sn [%UR R'55Sn S n U R(SUR*:a3[U R-S U R(SUR*55eU R(SUR:a3[U R-S U R(SUR55eS n U R(SURU:a6[U R-S U R(SURU55eU R(SURU:a6[U R-S U R(SURU55eXRU'XR U'U(aUR/XS 9 UR1U5 UR3UR4US9 g)Nrz?`r` should be a positive integer value but the value passed is )pT) requires_gradz^The `vera_A` and `vera_B` buffers are empty. This should not happen. Please report this issue.z{} has a size of {} but {} or greater is required; this probably happened because an additional VeRA adapter was added after the first one with incompatible shapes.rrz{} has a size of {} but {} or greater is required; this probably happened because an additional VeRA adapter with a lower rank was added after the first one; loading the adapters in reverse order may solve this.r/)r0) ValueErrorrrDropoutIdentityrupdater Parametertorchonesrr randnrrrlenlistvaluesr"rformatreset_vera_parameters%_move_adapter_to_device_of_base_layer set_adapteractive_adapters)r$ adapter_namerrrr init_weightsr/r0r#vera_dropout_layer vera_A_param vera_B_param error_tmpls r% update_layerVeraLayer.update_layerDs 6^_`^abc c | # !#l!; !#     /Q!RS+-<< 4CTCT8Uei+j<(+-<< AVZ+[<(   %4;;!# t  2 2 45a8L 2 2 45a8LR  !!!$t'7'77 !2!28\=O=OPQ=RTXTdTd!eff!!!$t'8'88 !2!28\=O=OPQ=RTXTeTe!fgg3  !!!$tvvl';; !2!28\=O=OPQ=RTXTZTZ[gTh!ijj!!!$tvvl';; !2!28\=O=OPQ=RTXTZTZ[gTh!ijj(4KK %(4KK %   & &| & I 22<@ --nMr(clXRR5;a[R"5 [R R URU5RU5 [R R URU5 SSS5 gg!,(df  g=fr+) rkeysr<no_gradrinitzeros_fill_r )r$rGr/s r%rCVeraLayer.reset_vera_parametersss --224 4t11,?@FFyQt11,?@! 5 s A(B%% B3) rrrr#rrrrrrr rN)皙?F)rV)__name__ __module__ __qualname____firstlineno__adapter_layer_namesother_param_namesrModuler&propertyr,r-r floatrMrC__static_attributes__r(r%r r s<,299<***$BNBN BNBNBNHAUAAr(r c^\rSrSrSS\S\S\S\S\S\S\S \S \S S 4U4S jjjr SS\S\ \ \S S 4Sjjr SSjr S \R4SjrS\RS \R4SjrSS\S \4SjjrS \4U4SjjrSrU=r$)rrrrGrrfan_in_fan_outis_target_conv_1d_layerrHr/r)Nc >[[RU]5 [R"X40U D6 XplX@lURXBX5XiU S9 Xlg)Nr6) superrrr&r rd_active_adapterrMre) r$rrrrGrrrdrerHr/r# __class__s r%r&Linear.__init__sS bii')46v6,+ ,$r( safe_merge adapter_namesc>[X5nU(dgUGHnX0RR5;dM#UR5nU(aURR R 5nXPRU5- n[R"U5R5(d[SUS35eXTRlO.UR=R URU5- slURRU5 GM g)a Merge the active adapter weights into the base weights Args: safe_merge (`bool`, *optional*): If True, the merge operation will be performed in a copy of the original weights and check for NaNs before merging the weights. This is useful if you want to check if the merge operation will produce NaNs. Defaults to `False`. adapter_names (`List[str]`, *optional*): The list of adapter names that should be merged. If None, all active adapters will be merged. Defaults to `None`. Nz1NaNs detected in the merged weights. The adapter z seems to be broken)rrrPrr!datacloneget_delta_weightr<isfiniteallr7rappend)r$rkrlactive_adapterr orig_weightss r%merge Linear.merges0D  +N!3!3!8!8!::!002 $.#4#4#9#9#?#?#AL $9$9.$IIL >>,7;;==(OP^O__rs.:%%*%%**d.C.CN.SS*$$++N;%,r(cUR(d[R"S5 g[UR5S:aURR 5nXR R5;a<UR5R=RURU5-sl [UR5S:aMgg)Nz Already unmerged. Nothing to do.r) r-warningswarnr?rpoprrPrr!rnrp)r$rts r%unmergeLinear.unmerges{{ MM< = $&&'!+!11557N!3!3!8!8!::##%,,11T5J5J>5ZZ1$&&'!+r(c$URUnURUnURnURnURS:H=(a- U[ R :H=(d U[ R:HnURUnURUnU(a@UR5nUR5nUR5nUR5nUSS2SUR24RUR5n USUR2SS24RUR5n URS5nURS5n[X-Xy--UR 5n U(aU RUS9n U $)z Compute the delta weight for the given adapter. Args: adapter (str): The name of the adapter for which the delta weight should be computed. cpuN)dtype)rrdevicertyper<float16bfloat16rr r_rtor unsqueezerrd) r$adapterrrrr cast_to_fp32lambda_dlambda_bsliced_Asliced_B output_tensors r%rpLinear.get_delta_weights`W%W%  {{e+c%--1G1b5TYTbTbKb %%g.%%g. \\^F\\^F~~'H~~'H!/t////033HOOD-D---q0144X__E%%b)%%b)!8#68;N"OQUQdQde ),,5,9Mr(xc URnUR(a9UR(aUR5 UR"U/UQ70UD6nGOoUR(aUR"U/UQ70UD6nGOFUR"U/UQ70UD6nUR GHnX`R R5;aM#UR UnURUnURUn URUn U SS2SUR24RUR5n U SUR2SS24RUR5n URUn URUR5nXX[ R""U[ R""U "U5U 5-U 5--nGM" URU5nU$r+)rdisable_adaptersr-r|rrFrrPr rrrrrrrFlinear)r$rargsr#previous_dtyperesultrtrrrrrrdropouts r%forwardLinear.forwards  {{ __Q888F [[__Q888F__Q888F"&"6"6!););)@)@)BB--n=--n=^4^4 "!%7t'7'7%7"78;;AHHE!"5D$5$5"5q"89<* r(cg)NTra)r$rGs r%supports_lora_conversionLinear.supports_lora_conversion!sr(c*>[TU]5nSU-$)Nzvera.)rg__repr__)r$repris r%rLinear.__repr__$sg }r()rhrdre)rr2FFTrV)FN)r)N)default)rWrXrYrZr strintr_r,r&rr@rvr|r<Tensorrprrrr` __classcell__)ris@r%rrs!$(-!?? ?  ?  ???"&??? ??.$<$rsJ -L&%oAoAdWRYY Wr(