]j SrSSKrSSKrSSKJr SSKJr SSKJr SSK J r SSK J r SSK rSSKJr SS KJrJrJrJrJrJrJrJrJrJrJrJrJrJrJ r J!r!J"r"J#r#J$r$J%r%J&r&J'r'J(r(J)r)J*r*J+r+J,r,J-r- SS K.J/r/J0r0J1r1J2r2J3r3J4r4J5r5J6r6J7r7 SS K8J9r9 SS K:J;r;JJ?r? SSK@JArAJBrBJCrCJDrDJErEJFrFJGrGJHrH SSKIJJrJ SrKSrL"SS5rM"SS\D5rN"SS\N5rO\="S\P\QS/0SS9S5rR"SS\D5rSSrTSrU\="\Q/\V\W\<"1S k5/S!/S".SS9S#SS$.S%j5rX\X"\5rY\X"\(5rZ\X"\S&S'9r[\X"\$S&S'9r\\X"\%S&S'9r]\X"\ S&S'9r^\X"\!S&S'9r_\X"\&S&S'9r`\X"\+S&S'9ra\X"\,S&S'9rb\X"\#S&S'9rc\X"\"S&S'9rd\X"\5re\X"\S(S)9rf\X"\S(S)9rg\X"\5rh\X"\5ri\X"\5rjS*rkS+rl\X"\k5rm\X"\lS&S'9rn\X"\-SS,S-9ro\X"\*SS,S-9rp\X"\S,S)9rq\X"\*S(S.S/9rr\X"\*S(S.S0S19rs\X"\*S(S2S/9rt\X"\*S(S2S0S19ru\X"\S&S(S-9rv\X"\S&S(S-9rw\X"\S&S(S-9rx\X"\05ry\X"\65rz\X"\35r{\X"\15r|\X"\75r}\X"\45r~\X"\/5r\X"\55r\X"\25r\"Sj0S3\Y_S4\Z_S5\[_S6\j_S7\`_S8\^_S9\__S:\\_S;\]_S<\a_S=\b_S>\c_S?\d_S@\e_SA\g_SB\f_SC\h_SD\o_SE\p_SF\t_SG\r_SH\u_SI\s_SJ\i_SK\q_SL\v_SM\w_SN\m_SO\n_SP\y_SQ\z_SR\{_SS\|_ST\}_SU\~_SV\_SW\_SX\_6rSYrSZ\'4S[\)4S\\4S]\44H7urr\X"\S^S_9\\'S`H!rSaGR\\5r\X"\S\Sb9\\'M# M9 \="\;"Sc5S/\<"\"\"555\Q\V\\W\S/S!/S!/Sd.SS9SkS&SSe.Sfjj5rSgr"ShSi\N5rg)laH The :mod:`sklearn.metrics.scorer` submodule implements a flexible interface for model selection and evaluation using arbitrary score functions. A scorer object is a callable that can be passed to :class:`~sklearn.model_selection.GridSearchCV` or :func:`sklearn.model_selection.cross_val_score` as the ``scoring`` parameter, to specify how a model should be evaluated. The signature of the call is ``(estimator, X, y)`` where ``estimator`` is the model to be evaluated, ``X`` is the test data and ``y`` is the ground truth labeling (or ``None`` in the case of unsupervised models). N)Counter)partial) signature)Integral) format_exc) is_regressor)accuracy_scoreaverage_precision_scorebalanced_accuracy_scorebrier_score_lossclass_likelihood_ratiosd2_absolute_error_scored2_brier_scored2_log_loss_scoreexplained_variance_scoref1_score jaccard_scorelog_lossmatthews_corrcoef max_errormean_absolute_errormean_absolute_percentage_errormean_gamma_deviancemean_poisson_deviancemean_squared_errormean_squared_log_errormedian_absolute_errorprecision_scorer2_score recall_score roc_auc_scoreroot_mean_squared_errorroot_mean_squared_log_errortop_k_accuracy_score) adjusted_mutual_info_scoreadjusted_rand_scorecompleteness_scorefowlkes_mallows_scorehomogeneity_scoremutual_info_scorenormalized_mutual_info_score rand_scorev_measure_score)Bunch) HasMethods StrOptionsvalidate_params_get_response_values)MetadataRequestMetadataRouter MethodMapping_MetadataRequester_raise_for_params_routing_enabledget_routing_for_objectprocess_routing)_check_response_methodcRUb X ;aX$[U/UQ7SU0UD6upVUbXPU'U$)z/Call estimator with method and args and kwargs.response_methodr2)cache estimatorr>argskwargsresult_s T/home/mande/repo/quber/.venv/lib/python3.13/site-packages/sklearn/metrics/_scorer.py _cached_callrF[sR _5%%$*9=CIF !'o McZ[U[5(a [U5$UR$)z6Returns the name of the function or repr of a partial.) isinstancerrepr__name__)funcs rE_get_func_repr_or_namerMjs#$  Dz ==rGcD\rSrSrSrSS.SjrSrSrSrS r S r S r g ) _MultimetricScorerranCallable for multimetric scoring used to avoid repeated calls to `predict_proba`, `predict`, and `decision_function`. `_MultimetricScorer` will return a dictionary of scores corresponding to the scorers in the dictionary. Note that `_MultimetricScorer` can be created with a dictionary with one key (i.e. only one actual scorer). Parameters ---------- scorers : dict Dictionary mapping names to callable scorers. raise_exc : bool, default=True Whether to raise the exception in `__call__` or not. If set to `False` a formatted string of the exception details is passed as result of the failing scorer. T) raise_exccXlX lgN)_scorers _raise_exc)selfscorersrQs rE__init___MultimetricScorer.__init__s  #rGc 0nURU5(a0OSn[[U5n[5(a[ US40UD6nOUR 5VV s0sHupUS:wdM X_M n nn [ S0URV s0sHo[ U R5S9_M sn D6nSU;aNURR 5H0upU R5(dMUSX{RS'M2 URR 5Htup[U [5(a0U R"Xa/UQ70URU 5RD6n O%U "U/UQ70URU 5RD6n XU 'Mv U$s sn nfs sn f![a*nUR (aUe[#5XK'SnAMSnAff=f)z!Evaluate predicted target values.Nscore sample_weightr[) _use_cacherrFr9r;itemsr.rTcopy_accept_sample_weightr[rI _BaseScorer_scoreget ExceptionrUr)rVr@rArBscoresr? cached_call routed_paramsargvalue common_kwargsnamescorerr[es rE__call___MultimetricScorer.__call__sooi00dlE2   +D'DVDM.4\\^-;zsso?U  ^ "GK}}U}t]%7%7%9::}UM&($(MM$7$7$9LD3355EK+F +11/B%: !MM//1LD 0fk22"MM#159F9J9J49P9V9VE#9UtU}7H7H7N7T7TUE$t 2 7V$ 0??G#-#G9A..>s7cV[SURR555$)Nc3@# UHoR5v M g7frS)rb).0rns rE ;_MultimetricScorer._accept_sample_weight..sW@Vf//11@Vs)anyrTvaluesrVs rErb(_MultimetricScorer._accept_sample_weights W @T@T@VWWWrGc ^[UR5S:Xag[URR5Vs/sH9n[ U[ 5(dM[ XR5RPM; sn5n[SUR555(aggs snf)zeReturn True if using a cache is beneficial, thus when a response method will be called several time. Fc3*# UH oS:v M g7f)rNr^)r|vals rEr}0_MultimetricScorer._use_cache..s3"23Qw"2sT) lenrTrrrIrcr<_response_methodrKr)rVr@rncounters rEr__MultimetricScorer._use_caches t}}  "#mm224 4Ffk2T&y2I2IJSS4   3'.."23 3 3 s B*#B*c |[US9R"S0URDS[5RSSS90D6$)aGet metadata routing of this object. Please check :ref:`User Guide ` on how the routing mechanism works. .. versionadded:: 1.3 Returns ------- routing : MetadataRouter A :class:`~utils.metadata_routing.MetadataRouter` encapsulating routing information. ownermethod_mappingr[)callercalleer^)r5addrTr6rs rEget_metadata_routing'_MultimetricScorer.get_metadata_routingsBD)-- mm (?..gg.N  rG)rUrTN) rK __module__ __qualname____firstlineno____doc__rXrprxrbr_r__static_attributes__r^rGrErOrOrs,$.2$(T/X* rGrOcP\rSrSrSrS SjrSrSrSrSr SS jr S r S r S r g)rca Base scorer that is used as `scorer(estimator, X, y_true)`. Parameters ---------- score_func : callable The score function to use. It will be called as `score_func(y_true, y_pred, **kwargs)`. sign : int Either 1 or -1 to returns the score with `sign * score_func(estimator, X, y)`. Thus, `sign` defined if higher scores are better or worse. kwargs : dict Additional parameters to pass to the score function. response_method : str The method to call on the estimator to get the response values. c4XlX lX0lX@lgrS) _score_func_sign_kwargsr)rV score_funcsignrBr>s rErX_BaseScorer.__init__s%  /rGcSUR;aURS$[UR5RnSU;aUSR$g)N pos_label)rrr parametersdefault)rVscore_func_paramss rE_get_pos_label_BaseScorer._get_pos_labelsQ $,, &<< , ,%d&6&67BB + +$[199 9rGcFS[UR5R;$Nr\)rrrrs rErb!_BaseScorer._accept_sample_weights)D,<,<"="H"HHHrGc URS:aSOSnSUR<3nSRURR 5VVs/sH up4SUSU3PM snn5nS[ UR 5UUUS3$s snnf) Nrz, greater_is_better=Falsez, response_method=rs=z make_scorer(ru)rrrvrr`rMr)rV sign_stringresponse_method_stringkv kwargs_strings rErx_BaseScorer.__repr__ s JJNb0K #5d6K6K5N!O$,,:L:L:N O:N$!2aS!:N OP 1$2B2BCD[M%&}oQ 8 !Ps B c[U5$rSrJrs rE _routing_repr_BaseScorer._routing_repr DzrGNc [XPS5 [R"U5nUbXFS'UR"[ [ S5XU40UD6$)a Evaluate predicted target values for X relative to y_true. Parameters ---------- estimator : object Trained estimator to use for scoring. Must have a predict_proba method; the output of that is used to compute the score. X : {array-like, sparse matrix} Test data that will be fed to estimator.predict. y_true : array-like Gold standard target values for X. sample_weight : array-like of shape (n_samples,), default=None Sample weights. **kwargs : dict Other parameters passed to the scorer. Refer to :func:`set_score_request` for more details. Only available if `enable_metadata_routing=True`. See the :ref:`User Guide `. .. versionadded:: 1.3 Returns ------- score : float Score function applied to prediction of estimator on X. Nr\)r8radeepcopyrdrrF)rVr@Xy_truer\rBrs rErp_BaseScorer.__call__sK@ &---'  $'4O ${{7<6 fXPWXXrGcURc [5O"[URR55nURUR55nU(a![R "USU3[ 5 gg)zWarn if there is any overlap between ``self._kwargs`` and ``kwargs``. This method is intended to be used to check for overlap between ``self._kwargs`` and ``kwargs`` passed as metadata. Nz Overlapping parameters are: )rsetkeys intersectionwarningswarn UserWarning)rVmessagerBroverlaps rE _warn_overlap_BaseScorer._warn_overlap?sc  <</#%S9J9J9L5M&&v{{}5  MM)8 BK  rGc [5(d [S5eURSUS9 [US9UlUR 5H(up#URR RX#S9 M* U$)a/Set requested parameters by the scorer. Please see :ref:`User Guide ` on how the routing mechanism works. .. versionadded:: 1.3 Parameters ---------- kwargs : dict Arguments should be of the form ``param_name=alias``, and `alias` can be one of ``{True, False, None, str}``. zThis method is only available when metadata routing is enabled. You can enable it using sklearn.set_config(enable_metadata_routing=True).zYou are setting metadata request for parameters which are already set as kwargs for this metric. These set values will be overridden by passed metadata if provided. Please pass them either as metadata or kwargs to `make_scorer`.rrBr)paramalias)r9 RuntimeErrorrr4_metadata_requestr`r[ add_request)rVrBrrs rEset_score_request_BaseScorer.set_score_requestLs !!E  :   "1t!<"LLNLE  " " ( ( 4 45 4 N+ rG)rrrrr)predictrS)rKrrrrrXrrbrxrrprrrr^rGrErcrcs2&0 I &YP !rGrcc\rSrSrSrSrg)_Scoreripc URSUS9 [U5(aSOUR5n[X R5nU"U[ U5UUS9n0UR EUEn URUR"XH40U D6-$)aEvaluate the response method of `estimator` on `X` and `y_true`. Parameters ---------- method_caller : callable Returns predictions given an estimator, method name, and other arguments, potentially caching results. estimator : object Trained estimator to use for scoring. X : {array-like, sparse matrix} Test data that will be fed to clf.decision_function or clf.predict_proba. y_true : array-like Gold standard target values for X. These must be class labels, not decision function values. **kwargs : dict Other parameters passed to the scorer. Refer to :func:`set_score_request` for more details. Returns ------- score : float Score function applied to prediction of estimator on X. zThere is an overlap between set kwargs of this scorer instance and passed metadata. Please pass them either as kwargs to `make_scorer` or metadata, but not both.rNr) rrrr<r_get_response_method_namerrr) rV method_callerr@rrrBrr>y_predscoring_kwargss rErd_Scorer._scoreqs: .  )33D9L9L9N 0`. :func:`~sklearn.metrics.get_scorer_names` can be used to retrieve the names of all available scorers. Parameters ---------- scoring : str, callable or None Scoring method as string. If callable it is returned as is. If None, returns None. Returns ------- scorer : callable The scorer. Notes ----- When passed a string, this function always returns a copy of the scorer object. Calling `get_scorer` twice for the same scorer results in two separate scorer objects. Examples -------- >>> import numpy as np >>> from sklearn.dummy import DummyClassifier >>> from sklearn.metrics import get_scorer >>> X = np.reshape([0, 1, -1, -0.5, 2], (-1, 1)) >>> y = np.array([0, 1, 1, 0, 1]) >>> classifier = DummyClassifier(strategy="constant", constant=0).fit(X, y) >>> accuracy = get_scorer("accuracy") >>> accuracy(classifier, X, y) 0.4 z]%r is not a valid scoring value. Use sklearn.metrics.get_scorer_names() to get valid options.)rIstrrar_SCORERSKeyError ValueError)rrns rE get_scorerrshT'3 ]]8G#45F M M (*12  s :Ac8\rSrSrSrSrSrSrSrSr Sr g ) _PassthroughScorericXlgrS _estimator)rVr@s rErX_PassthroughScorer.__init__s#rGc&UR"U0UD6$)z!Method that wraps estimator.scorer])rVr@rArBs rErp_PassthroughScorer.__call__s///rGcF[UR5RS3$)Nz.score)typerrKrs rErx_PassthroughScorer.__repr__st'00188rGc[U5$rSrrs rEr _PassthroughScorer._routing_reprrrGcZS[URR5R;$r)rrr[rrs rErb(_PassthroughScorer._accept_sample_weights")DOO,A,A"B"M"MMMrGc,[UR5$)aGet requested data properties. Please check :ref:`User Guide ` on how the routing mechanism works. .. versionadded:: 1.3 Returns ------- routing : MetadataRouter A :class:`~utils.metadata_routing.MetadataRouter` encapsulating routing information. )r:rrs rEr'_PassthroughScorer.get_metadata_routings&doo66rGrN) rKrrrrXrprxrrbrrr^rGrErrs!$09N7rGrc `SU<S3n[U[[[45(aSn[U5n[ U5[ U5:wa[ USU<35e[ U5S:ak[SU55(d9[SU55(a[ US U<35e[ US U<35eUVs0sH of[XS 9_M nnU$[ US U<35e[U[5(a}[U5n[S U55(d[ SU<35e[ U5S:Xa[ SU<35eUR5VVs0sHupU[XS 9_M nnnU$[ U5e![an[ U5UeSnAff=fs snfs snnf)aCheck the scoring parameter in cases when multiple metrics are allowed. In addition, multimetric scoring leverages a caching mechanism to not call the same estimator response method multiple times. Hence, the scorer is modified to only use a single response method given a list of response methods and the estimator. Parameters ---------- estimator : sklearn estimator instance The estimator for which the scoring will be applied. scoring : list, tuple or dict Strategy to evaluate the performance of the cross-validated model on the test set. The possibilities are: - a list or tuple of unique strings; - a callable returning a dictionary where they keys are the metric names and the values are the metric scores; - a dictionary with metric names as keys and callables a values. See :ref:`multimetric_grid_search` for an example. Returns ------- scorers_dict : dict A dict mapping each scorer name to its validated scorer. zscoring is invalid (got zh). Refer to the scoring glossary for details: https://scikit-learn.org/stable/glossary.html#term-scoringzFThe list/tuple elements must be unique strings of predefined scorers. Nz2 Duplicate elements were found in the given list. rc3B# UHn[U[5v M g7frSrIrr|rs rEr}-_check_multimetric_scoring..5s84az!S))4c38# UHn[U5v M g7frS)callablers rEr}r6s1Dqx{{Dszi One or more of the elements were callables. Use a dict of score name mapped to the scorer callable. Got z4 Non-string types were found in the given list. Got rz Empty list was given. c3B# UHn[U[5v M g7frSrrs rEr}rJs4t!:a%%trzCNon-string types were found in the keys of the given dict. scoring=zAn empty dict was passed. ) rIlisttupler TypeErrorrrallr check_scoringdictr`) r@rerr_msg_genericerr_msgrrornrWkeys rE_check_multimetric_scoringr s > #7+.E E 'D%-.. T  -w PWOVV i@@w , N%y(?{KL L GT " "7|4t444++2+7  t9>9'EF F '}} .  y9 9.   N))U -W%1 , -, s# FF%!F* F" FF"cfUR$![a [UR5s$f=frS)rKAttributeErrorrrLr>s rErr[s3?''' ?()=)=>>?s 00>r predict_probadecision_functionboolean)rr>greater_is_betterr)r>rc 0U(aSOSn[XX15$)aMake a scorer from a performance metric or loss function. A scorer is a wrapper around an arbitrary metric or loss function that is called with the signature `scorer(estimator, X, y_true, **kwargs)`. It is accepted in all scikit-learn estimators or functions allowing a `scoring` parameter. The parameter `response_method` allows to specify which method of the estimator should be used to feed the scoring/loss function. Read more in the :ref:`User Guide `. Parameters ---------- score_func : callable Score function (or loss function) with signature ``score_func(y, y_pred, **kwargs)``. response_method : {"predict_proba", "decision_function", "predict"} or list/tuple of such str, default="predict" Specifies the response method to use get prediction from an estimator (i.e. :term:`predict_proba`, :term:`decision_function` or :term:`predict`). Possible choices are: - if `str`, it corresponds to the name to the method to return; - if a list or tuple of `str`, it provides the method names in order of preference. The method returned corresponds to the first method in the list and which is implemented by `estimator`. .. versionadded:: 1.4 greater_is_better : bool, default=True Whether `score_func` is a score function (default), meaning high is good, or a loss function, meaning low is good. In the latter case, the scorer object will sign-flip the outcome of the `score_func`. **kwargs : additional arguments Additional parameters to be passed to `score_func`. Returns ------- scorer : callable Callable object that returns a scalar score; greater is better. Examples -------- >>> from sklearn.metrics import fbeta_score, make_scorer >>> ftwo_scorer = make_scorer(fbeta_score, beta=2) >>> ftwo_scorer make_scorer(fbeta_score, response_method='predict', beta=2) >>> from sklearn.model_selection import GridSearchCV >>> from sklearn.svm import LinearSVC >>> grid = GridSearchCV(LinearSVC(), param_grid={'C': [1, 10]}, ... scoring=ftwo_scorer) r)r)rr>rrBrs rE make_scorerrbsP"1rD :V ==rGF)rrr c[XSS9S$)N?replace_undefined_byrr rrs rEpositive_likelihood_ratior "6 LQ OOrGc[XSS9S$)Nrrrrrs rEnegative_likelihood_ratiorrrG)rr)rr>ovo)r> multi_classweighted)r>r averageovrexplained_variancer2 neg_max_errorrneg_median_absolute_errorneg_mean_absolute_error"neg_mean_absolute_percentage_errorneg_mean_squared_errorneg_mean_squared_log_errorneg_root_mean_squared_errorneg_root_mean_squared_log_errorneg_mean_poisson_devianceneg_mean_gamma_deviancerrraccuracytop_k_accuracyroc_auc roc_auc_ovr roc_auc_ovoroc_auc_ovr_weightedroc_auc_ovo_weightedbalanced_accuracyaverage_precision neg_log_lossneg_brier_scorerneg_negative_likelihood_ratior&r,r)r'r-r*r%r+r(c<[[R55$)aGet the names of all available scorers. These names can be passed to :func:`~sklearn.metrics.get_scorer` to retrieve the scorer object. Returns ------- list of str Names of all available scorers. Examples -------- >>> from sklearn.metrics import get_scorer_names >>> all_scorers = get_scorer_names() >>> type(all_scorers) >>> all_scorers[:3] ['accuracy', 'adjusted_mutual_info_score', 'adjusted_rand_score'] >>> "roc_auc" in all_scorers True )sortedrrr^rGrEget_scorer_namesr>Is, (--/ ""rG precisionrecallf1jaccardbinary)r")macromicrosamplesr!z{0}_{1})rr"fit)r@r allow_nonerQ)rHrQc.[U[5(a [U5$[U5(ay[ USS5n[ US5(aPUR S5(a:UR S5(d$UR S5(d[SU-5e[U5$[U[[[[45(a[XS9n[XSS 9$Uc2[ US 5(a [U5$U(ag[S U-5eg) aq Determine scorer from user options. A TypeError will be thrown if the estimator cannot be scored. Parameters ---------- estimator : estimator object implementing 'fit' or None, default=None The object to use to fit the data. If `None`, then this function may error depending on `allow_none`. scoring : str, callable, list, tuple, set, or dict, default=None Scorer to use. If `scoring` represents a single score, one can use: - a single string (see :ref:`scoring_string_names`); - a callable (see :ref:`scoring_callable`) that returns a single value; - `None`, the `estimator`'s :ref:`default evaluation criterion ` is used. If `scoring` represents multiple scores, one can use: - a list, tuple or set of unique strings; - a callable returning a dictionary where the keys are the metric names and the values are the metric scorers; - a dictionary with metric names as keys and callables a values. The callables need to have the signature `callable(estimator, X, y)`. allow_none : bool, default=False Whether to return None or raise an error if no `scoring` is specified and the estimator has no `score` method. raise_exc : bool, default=True Whether to raise an exception (if a subset of the scorers in multimetric scoring fails) or to return an error code. - If set to `True`, raises the failing scorer's exception. - If set to `False`, a formatted string of the exception details is passed as result of the failing scorer(s). This applies if `scoring` is list, tuple, set, or dict. Ignored if `scoring` is a str or a callable. .. versionadded:: 1.6 Returns ------- scoring : callable A scorer callable object / function with signature ``scorer(estimator, X, y)``. Examples -------- >>> from sklearn.datasets import load_iris >>> from sklearn.metrics import check_scoring >>> from sklearn.tree import DecisionTreeClassifier >>> X, y = load_iris(return_X_y=True) >>> classifier = DecisionTreeClassifier(max_depth=2).fit(X, y) >>> scorer = check_scoring(classifier, scoring='accuracy') >>> scorer(classifier, X, y) 0.96... >>> from sklearn.metrics import make_scorer, accuracy_score, mean_squared_log_error >>> X, y = load_iris(return_X_y=True) >>> y *= -1 >>> clf = DecisionTreeClassifier().fit(X, y) >>> scoring = { ... "accuracy": make_scorer(accuracy_score), ... "mean_squared_log_error": make_scorer(mean_squared_log_error), ... } >>> scoring_call = check_scoring(estimator=clf, scoring=scoring, raise_exc=False) >>> scores = scoring_call(clf, X, y) >>> scores {'accuracy': 1.0, 'mean_squared_log_error': 'Traceback ...'} rN startswithzsklearn.metrics.zsklearn.metrics._scorerzsklearn.metrics.tests.zscoring value %r looks like it is a metric function rather than a scorer. A scorer should require an estimator as its first parameter. Please use `make_scorer` to convert a metric to a scorer.r)rWrQr[ziIf no scoring is specified, the estimator passed should have a 'score' method. The estimator %r does not.)rIrrrgetattrhasattrrJrrrrrr rOrr)r@rrHrQmodulerWs rErrnst'3'"",5 FL ) )!!"455%%&?@@%%&>??") ) '""'D%d344,YH!'GG 9g & &%i0 0 DFOP  rGc Uc[R"SS/5nOM[R"X#:H5Sn[R"X#:g5Sn[R"Xe/5nX$X:R[5$)z;Threshold `y_score` and return the associated class labels.rr)nparray flatnonzeroastypeint)y_score thresholdclassesrmap_thresholded_score_to_label pos_label_idx neg_label_idxs rE!_threshold_scores_to_class_labelsrZsv)+1a&)9&w';[TU]UUUUS9 X@lg)N)rrrBr>)superrX _thresholds)rVrrrB thresholdsr> __class__s rErX_CurveScorer.__init__s) !+  &rGcU"URURUUURS9nUR5UlU$)z0Create a continuous scorer from a normal scorer.)rrr>r`rB)rrr_get_metadata_requestr)clsrnr>r`instances rE from_scorer_CurveScorer.from_scorersC))+!>>  &,%A%A%C"rGc >UR5nU"X RX6S9n0UREUEn[UR[ 5(aK[ R"[ R"U5[ R"U5UR5n O [ R"UR5n U V s/sH9n URUR"U[XzURU540UD6-PM; n n [ R"U 5U 4$s sn f)a,Evaluate predicted target values for X relative to y_true. Parameters ---------- method_caller : callable Returns predictions given an estimator, method name, and other arguments, potentially caching results. estimator : object Trained estimator to use for scoring. X : {array-like, sparse matrix} of shape (n_samples, n_features) Test data that will be fed to estimator.predict. y_true : array-like of shape (n_samples,) Gold standard target values for X. **kwargs : dict Other parameters passed to the scorer. Refer to :func:`set_score_request` for more details. Returns ------- scores : ndarray of shape (thresholds,) The scores associated to each threshold. potential_thresholds : ndarray of shape (thresholds,) The potential thresholds used to compute the scores. r)rrrrIr_rrOlinspaceminmaxasarrayrrrZclasses_rP) rVrr@rrrBrrTrpotential_thresholdsthscore_thresholdss rErd_CurveScorer._score's<'')  ,,a 4DLL3F3 d&& 1 1#%;;w$2B2B$ $&::d.>.>#? +  + JJ1!3!3Y !  +   xx()+???  sAD)r_) rKrrrrrX classmethodrgrdr __classcell__)ras@rEr\r\s-2&  5@5@rGr\r^)NN)rrar collectionsr functoolsrinspectrnumbersr tracebackrnumpyrO sklearn.basersklearn.metricsr r r r r rrrrrrrrrrrrrrrrrrr r!r"r#r$sklearn.metrics.clusterr%r&r'r(r)r*r+r,r- sklearn.utilsr.sklearn.utils._param_validationr/r0r1sklearn.utils._responser3sklearn.utils.metadata_routingr4r5r6r7r8r9r:r;sklearn.utils.validationr<rFrMrOrcrrrrrr rrrrexplained_variance_scorer r2_scorerneg_max_error_scorerneg_mean_squared_error_scorer!neg_mean_squared_log_error_scorerneg_mean_absolute_error_scorer)neg_mean_absolute_percentage_error_scorer neg_median_absolute_error_scorer"neg_root_mean_squared_error_scorer&neg_root_mean_squared_log_error_scorer neg_mean_poisson_deviance_scorerneg_mean_gamma_deviance_scorerd2_absolute_error_scorerd2_brier_score_scorerd2_log_loss_scoreraccuracy_scorerbalanced_accuracy_scorermatthews_corrcoef_scorerrr positive_likelihood_ratio_scorer$neg_negative_likelihood_ratio_scorertop_k_accuracy_scorerroc_auc_scoreraverage_precision_scorerroc_auc_ovo_scorerroc_auc_ovo_weighted_scorerroc_auc_ovr_scorerroc_auc_ovr_weighted_scorerneg_log_loss_scorerneg_brier_score_scorerbrier_score_loss_scoreradjusted_rand_scorer rand_scorerhomogeneity_scorercompleteness_scorerv_measure_scorermutual_info_scoreradjusted_mutual_info_scorernormalized_mutual_info_scorerfowlkes_mallows_scorerrrr>rmmetricr"formatqualified_namerrrZr\r^rGrErsb $  %<     9   < o o dI$IX1Ok1OhC4(#'  /  /d#7+#7LVr?j   H I ([#' $->> >>D((@A  ! "9F +,>RW X$/e%!"-5"-8"e-)$/U$ &1u&"*55*&$/U$ "-5"''>?#NOT !2OTn-&'>?&'89PP$//H#I '2($ $: : ':!?*#   !?*#  " %& ##67*%  !23!"45/ !23)*DE +,H I$%:; ( 0( ( '( / (  ? (  ; ( (Q( 9(  A( !C( %K( ?( ;( 5( )(  )!( "#( $)%( & '( (#)( *#+( ,5-( .5/( 0/1( 2/3( 4%5( 6+7( 8?9( :#G;( >-?( @A( B)C( D+E( F%G( H)I( J ;K( L"?M( N1O( V#4/" | 8  LD& !:HTN<"))$8#.vw#W = '. s+-. /       !k[ #'"heth#"hV Wf@;f@rG