>:j"SSKrSSKJrJrJr SSKrSSKJr SSKJs J r SSK J r SSK JrJr SSKJr "SS\5r"SS \R&\5rg) N)AnyOptionalUnion)Conv1D)BaseTunerLayercheck_adapters_to_merge) transposec\rSrSrSrSrS\RSS4SjrS S\ 4S jjr \ R"5S 5r S\ R4S jrS rg)FourierFTLayer)fourierft_spectrum)fourierft_n_frequencyfourierft_scalingfourierft_random_loc_seed base_layerreturnNc LXl0Ul0Ul[R"05Ul0Ul0UlSUl/Ul X l UR5n[U[R5(a$URURsUlUlg[U[ 5(aU[#UR$S5(aUR$R&OUR$R(uUlUlg[+S[-U535e)NFds_shapezUnsupported layer type )rrrnn ParameterDictr indicesr_disable_adaptersmerged_adapterskwargsget_base_layer isinstanceLinear in_features out_featuresrhasattrweightrshape ValueErrortype)selfrrs X/home/mande/repo/quber/.venv/lib/python3.13/site-packages/peft/tuners/fourierft/layer.py__init__FourierFTLayer.__init__!s$%'"!#"$"2"22"6 )+&!&! ((* j")) , ,2<2H2H*JaJa /D d/  F + +.5j6G6G.T.T !!**ZdZkZkZqZq 0D d/6tJ7G6HIJ Jinference_modec US::a[SU35eX RUR-:a([SUSURUR-35eX RU'XPRU'[ R "URUR-[ R"5RURU5S9SUURU'[ R"URUUR-URUUR-/SS9URU'X0RU'[R"[ R"U5SS9URU'U(aUR!U5 UR#U5 UR%UR&US 9 g) NrzI`n_frequency` should be a positive integer value but the value passed is zu`n_frequency` should be less than or equal to the product of the input and output dimensions but the value passed is z and the product is ) generator)dimT) requires_grad)r*)r#rrrrtorchrandperm Generator manual_seedrstackrr Parameterrandnr reset_fourier_parameters%_move_adapter_to_device_of_base_layer set_adapteractive_adapters)r% adapter_name n_frequencyscaling init_weightsrandom_loc_seedr*rs r& update_layerFourierFTLayer.update_layer7s ! hithuvw w ))D,=,== =++6-7KDL\L\_c_p_pLpKqs 4?""<07F&&|4%*^^    0 0 0oo'33D4R4RS_4`a&  ;& \"&+[[ \\, '4+;+; ;T\\,=WZ^ZjZj=j kqr&  \"07|,02 U[[=Uei0j -   ) ), 7 22<@ --nMr)cXRR5;a-[RR URU5 ggN)r keysrinitzeros_r%r:s r&r6'FourierFTLayer.reset_fourier_parametersTs7 22779 9 GGNN422<@ A :r)cURUnURURUR5n[R "UR URURS9nUR5XCSSS24USSS244'[RRU5RURU-nURUR5$)N)devicer)r rtorIr/zerosrrfloatfftifft2realrdtype)r%adapterspectrumrdense_spectrum delta_weights r&get_delta_weightFourierFTLayer.get_delta_weightYs**73,,w'**8??;T%6%68H8HQYQ`Q`a7?~~7Gq!t}gadm34yy~6;;d>T>TU\>]] x~~..r)) rrrrrr rrrrr)F)__name__ __module__ __qualname____firstlineno__adapter_layer_namesother_param_namesrModuler'boolr?r/no_gradr6TensorrV__static_attributes__r)r&r r sj1cK299K4K.inNaeN: ]]_BB/5<</r)r c^\rSrSrSS\S\S\S\S\\\4S\SS 4U4S jjjr SS \S \ \ \SS 4S jjr SSjr S\RS\S\S\R4SjrSS\S\4SjjrS\4U4SjjrSrU=r$)FourierFTLinearcr:r;r<fan_in_fan_outr=r>rNc >[T U]5 [R"X40UD6 XPlX lUR X#XFU5 grB)superr'r rg_active_adapterr?) r%rr:r;r<rgr=r>r __class__s r&r'FourierFTLinear.__init__esA ;F;,+ ,WO\r) safe_merge adapter_namesc[X5nU(dgUGH,nX0RR5;dM#UR5nU(aURR R 5nU[URU5UR5- n[R"U5R5(d[SUS35eXTRlOBUR=R [URU5UR5- slURRU5 GM/ g)a Merge the active adapter weights into the base weights Args: safe_merge (`bool`, *optional*): If True, the merge operation will be performed in a copy of the original weights and check for NaNs before merging the weights. This is useful if you want to check if the merge operation will produce NaNs. Defaults to `False`. adapter_names (`List[str]`, *optional*): The list of adapter names that should be merged. If None, all active adapters will be merged. Defaults to `None`. Nz1NaNs detected in the merged weights. The adapter z seems to be broken)rr rCrr!datacloner rVrgr/isfiniteallr#rappend)r%rmrnactive_adapterr orig_weightss r&mergeFourierFTLinear.mergevs 0D  +N!8!8!=!=!??!002 $.#4#4#9#9#?#?#AL Id.C.CN.SUYUhUh$iiL >>,7;;==(OP^O__rs.:%%*%%**i8M8Mn8]_c_r_r.ss*$$++N;#,r)cUR(d[R"S5 g[UR5S:aURR 5nXR R5;aPUR5R=R[URU5UR5-sl [UR5S:aMgg)zG This method unmerges all merged adapter layers from the base weights. z Already unmerged. Nothing to do.Nr)mergedwarningswarnlenrpopr rCrr!rpr rVrg)r%rus r&unmergeFourierFTLinear.unmerges{{ MM< = $&&'!+!11557N!8!8!=!=!??##%,,11Y)).94;N;N61$&&'!+r)xargsrc<URnUR(a8UR(aUR5 UR"U/UQ70UD6nOUR(aUR"U/UQ70UD6nOUR"U/UQ70UD6nUR HgnX`R R5;aM"URU5nURUR5nU[R"X5-nMi URU5nU$rB) rQdisable_adaptersrzrrr9r rCrVrKFlinear)r%rrrprevious_dtyperesultrudelta_ws r&forwardFourierFTLinear.forwards  {{ __Q888F [[__Q888F__Q888F"&"6"6!)@)@)E)E)GG//?DD'!((1"66 #7>* r)cL[UR5[5(agg)NFT)rrrrFs r&supports_lora_conversion(FourierFTLinear.supports_lora_conversions d))+V 4 4r)c*>[TU]5nSU-$)Nz fourierft.)ri__repr__)r%reprks r&rFourierFTLinear.__repr__sg c!!r))rjrg)igb@FFi )FN)rN)default)rXrYrZr[strintrMr_rr'rlistrwrr/rarrrrrb __classcell__)rks@r&rerecs  $)."]] ]  ]  ]D#I&]] ]]"#<#rsH'' -L&E/^E/Pe"biie"r)