lQjbSrSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSK J r SSK J r SSK Jr SSKJr SSKJr SS KJrJrJrJrJr \(a\R2"S 5rS rS rS r\"SS55r\"SS55r"SS\ 5r "SS\ 5r!"SS\ 5r"\!"5r#\""5r$\\\S.S Sjjr%\\\S.S Sjjr&S!Sjr'"SS\!5r("SS\"5r)g)"zPrompt caching module for LangSmith SDK. This module provides thread-safe LRU caches with background refresh for prompt caching. Includes both sync and async implementations. ) annotationsN)ABC) OrderedDict) Awaitable) dataclass)Path) TYPE_CHECKINGAnyCallableOptionalUnionzlangsmith.cachei,d<cF\rSrSr%SrS\S'S\S'SrS\S 'S S jrS rg) CacheEntry!z4A single cache entry with metadata for TTL tracking.r valuefloat created_atNzOptional[Callable[[], Any]] refresh_funccTUcg[R"5UR- U:$)z/Check if entry is past its TTL (needs refresh).F)timer)self ttl_secondss S/home/mande/repo/quber/.venv/lib/python3.13/site-packages/langsmith/prompt_cache.pyis_staleCacheEntry.is_stale)s%   doo-<<)rOptional[float]returnbool) __name__ __module__ __qualname____firstlineno____doc____annotations__rr__static_attributes__rrrrr!s > J04L-4=rrcz\rSrSr%SrSrS\S'SrS\S'SrS\S'Sr S\S'\ S S j5r \ SS j5r S r g ) CacheMetrics0zCache performance metrics.rinthitsmisses refreshesrefresh_errorsc4URUR-$)z%Total cache requests (hits + misses).)r.r/rs rtotal_requestsCacheMetrics.total_requests9syy4;;&&rcHURnUS:aURU- $S$)zCache hit rate (0.0 to 1.0).rg)r4r.)rtotals rhit_rateCacheMetrics.hit_rate>s)##$)AItyy5 636rrN)r!r-)r!r)r#r$r%r&r'r.r(r/r0r1propertyr4r8r)rrrr+r+0sQ$D#MFCOIsNC ''77rr+c\rSrSrSr/SQr\\\4SSjjr \ SSj5r SSjr SSjr SSjrSS jrSS jrSS jrSS jrSS jrSSjrSrg)_BasePromptCacheEzBase class for prompt caches with shared LRU logic. Provides thread-safe in-memory LRU cache operations. Subclasses implement the background refresh mechanism. )_cache_lock _max_size _ttl_seconds_refresh_interval_metricsc[5Ul[R"5Ul[ 5UlURUUUS9 g)a7Initialize the base cache. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. Set to None for infinite TTL (entries never expire, no background refresh). refresh_interval_seconds: How often to check for stale entries. max_sizerrefresh_interval_secondsN)rr> threadingRLockr?r+rC _configurerrFrrGs r__init___BasePromptCache.__init__Us?5@M __& $  #%=  rcUR$)zGet cache performance metrics.)rCr3s rmetrics_BasePromptCache.metricsls}}rc"[5Ulg)zReset all metrics to zero.N)r+rCr3s r reset_metrics_BasePromptCache.reset_metricsqs $ rcURS:XagUR XR;a)UR=RS- slSSS5 gURUnX#lURR U5 UR=RS- slURsSSS5 $!,(df  g=f)a%Get a value from cache. Args: key: The cache key (prompt identifier like "owner/name:hash"). refresh_func: Function to refresh this cache entry when stale. Returns: The cached value or None if not found. Stale entries are still returned (background refresh handles updates). rN) r@r?r>rCr/r move_to_endr.r)rkeyrentrys rget_BasePromptCache.getus >>Q  ZZ++% $$)$Z KK$E".  KK # #C ( MM  ! # ;;ZZs0B;AB;; C cURS:XagUR [R"5n[X$US9nXR;at[ UR5UR:aQ[ [UR55nURRU5 [RSU35 XPRU'URRU5 SSS5 g!,(df  g=f)Set a value in the cache. Args: key: The cache key (prompt identifier). value: The value to cache. refresh_func: Function to refresh this cache entry when stale. rN)rrrzEvicted oldest cache entry: ) r@r?rrr>lennextiterpoploggerdebugrV)rrWrrnowrX oldest_keys r_set_BasePromptCache._sets >>Q   ZZ))+CUVE++%#dkk*:dnn*L!$t{{"34   + ;J<HI$KK  KK # #C (ZZs C C33 DcUR URRUS5 SSS5 g!,(df  g=f)zQRemove a specific entry from cache. Args: key: The cache key to invalidate. N)r?r>r`)rrWs r invalidate_BasePromptCache.invalidates' ZZ KKOOC &ZZs 3 AcUR URR5 SSS5 g!,(df  g=f)z$Clear all cache entries from memory.N)r?r>clearr3s rrk_BasePromptCache.clears# ZZ KK   ZZs1 ?cUR URR5VVs/sH*upURUR5(dM'X4PM, snnsSSS5 $s snnf!,(df  g=f)z.Get list of stale cache entries (thread-safe).N)r?r>itemsrrA)rrWrXs r_get_stale_entries#_BasePromptCache._get_stale_entriess_ ZZ#'++"3"3"5"5JC>>$"3"34 "5ZZs"A/&A)A)A/)A// A=czSSKJn [U5nURR SSS9 UR  0nUR R5HupE[URUR5(aP[URS5(aURRSS9nO'URR5nO URnXcU'M SU0nS S S 5 URS 5n[US 5n [ R""WU S S 9 S S S 5 UR%U5 [&R)S[+W5SU35 g !,(df  N=f!,(df  NU=f![,a,n UR/5(aUR15 U eS n A ff=f)zcDump cache contents to a JSON file for offline use. Args: path: Path to the output JSON file. rschemasT)parentsexist_ok model_dumpjson)modeentriesNz.tmpw)indentzDumped z cache entries to ) langsmithrsrparentmkdirr?r>rn isinstancer PromptCommithasattrrvdict with_suffixopenrwdumpreplacerarbr] Exceptionexistsunlink) rpath ls_schemasryrWrX value_datadata temp_pathfes rr_BasePromptCache.dumpsf 4Dz $6 ZZG"kk//1 ekk:+B+BCCu{{L99%*[[%;%;%;%H %*[[%5%5%7 "'J) 2w'D!&$$V,  i% $!,&   d # LL73w<.0B4&I J1Z*&% !!  "G  s<B/E" F E3$=F" E03 F=F F:'F55F:c HSSKJn [U5nUR5(d[R SU35 g[ U5n[R"U5nSSS5 WRS05nSn[R"5nUR UR5Hup[!UR"5UR$:a[R SU35 Os['UR(S 5(aUR(R+U 5n OUR(R-U 5n [/XS 9n XR"U 'US - nM SSS5 [R S USU35 U$!,(df  GN/=f![R[4a%n[RSUSU35 SnAgSnAff=f![0a'n[RS U SU35 SnAGMZSnAff=f!,(df  N=f)zLoad cache contents from a JSON file. Args: path: Path to the JSON file to load. Returns: Number of entries loaded. Loaded entries get a fresh TTL starting from load time. If the file doesn't exist or is corrupted, returns 0. rrrzCache file not found: NzFailed to load cache file : ryz)Reached max cache size, stopping load at model_validate)rrrUzFailed to load cache entry zLoaded z cache entries from )r}rsrrrarbrrwloadJSONDecodeErrorOSErrorwarningrYrr?rnr]r>r@rrr parse_objrr) rrrrrrryloadedrcrWrrrXs rr_BasePromptCache.loads 4Dz{{}} LL1$8 9 dqyy| ((9b)iik ZZ#*==?t{{#t~~5LL#LVH!UV z668HII * 7 7 F Fz R * 7 7 A A* M'UCE',KK$aKF$3*  wvh&:4&AB A$$g.  NN7vRsC D 2!NN%@Rs#KL#Zsn F F #F AH4A.G"H FFFG7GG H)H H HH H!c(XlX lX0lg)N)r@rArBrKs rrJ_BasePromptCache._configure&s "'!9r)r>r?r@rCrBrANrFr-rr rGrr!None)r!r+r!r)rWstrrCallable[[], Any]r!z Optional[Any]rWrrr rrr!r)rWrr!r)r!zlist[tuple[str, CacheEntry]])rUnion[str, Path]r!r)rrr!r-)r#r$r%r&r' __slots__DEFAULT_PROMPT_CACHE_MAX_SIZE DEFAULT_PROMPT_CACHE_TTL_SECONDS-DEFAULT_PROMPT_CACHE_REFRESH_INTERVAL_SECONDSrLr:rOrRrYrerhrkrorrrJr)rrrr<r<Es I6'G*W   % #(    .'>)4' (T5n::%:#( :  :rr<c^\rSrSrSrSS/r\\\S.SU4Sjjjr SSjr SSjr SS jr SS jr SS jrSS jr\\\S.SS jjrSrU=r$) PromptCachei1aThread-safe LRU cache with background thread refresh. For use with the synchronous Client. Features: - In-memory LRU cache with configurable max size - Background thread for refreshing stale entries - Stale-while-revalidate: returns stale data while refresh happens - Thread-safe for concurrent access Example: >>> def fetch_prompt(key: str) -> PromptCommit: ... return client._fetch_prompt_from_api(key) >>> cache = PromptCache( ... max_size=100, ... ttl_seconds=3600, ... fetch_func=fetch_prompt, ... ) >>> cache.set("my-prompt:latest", prompt_commit) >>> cached = cache.get("my-prompt:latest") >>> cache.shutdown() _shutdown_event_refresh_threadrEcf>[TU]UUUS9 [R"5UlSUlg)aXInitialize the sync prompt cache. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. Set to None for infinite TTL (offline mode - entries never expire). Default: 300 (5 minutes). refresh_interval_seconds: How often to check for stale entries. rEN)superrLrHEventrrrrFrrG __class__s rrLPromptCache.__init__Ks9 #%=  )0;?rcbURcUR5 URXU5 g)r\N)r_start_refresh_threadrerrWrrs rsetPromptCache.setes*    '  & & ( #l+rc$UR5 g)WStop background refresh thread. Should be called when the client is being cleaned up. N)shutdownr3s rstopPromptCache.stoprs rcURbURR5 URb!URRSS9 SUlgg)rNg@)timeout)rrrjoinr3s rrPromptCache.shutdownysR    +  $ $ &    +  % %c % 2#'D  ,rcURboURR5 [R"UR SSS9UlUR R5 [RS5 gg)z5Start background thread for refreshing stale entries.NTzPromptCache-refresh)targetdaemonnamezStarted cache refresh thread) rArrkrHThread _refresh_looprstartrarbr3s rr!PromptCache._start_refresh_threadsh    (  & & (#,#3#3))*$D  & & ( LL7 8 )rc2URRUR5(d>UR5 URRUR5(dM=gg![a"n[ R SU35 SnANUSnAff=f)z)Background loop to refresh stale entries.z(Unexpected error in cache refresh loop: N)rwaitrB_refresh_stale_entriesrra exceptionrrs rrPromptCache._refresh_loops}&&++D,B,BCC Q++-&&++D,B,BCC Q  #KA3!OPP QsA** B4BBcZUR5nU(dg[RS[U5S35 UHup#URR 5(a gUR cM5UR 5nURX$UR 5 UR=RS- sl [RSU35 M g![aEnUR=RS- sl [RSUSU35 SnAMSnAff=f)z)Check for stale entries and refresh them.Nz Refreshing  stale cache entriesrUzRefreshed cache entry: zFailed to refresh cache entry r) rorarbr]ris_setrrrCr0rr1rr stale_entriesrWrX new_valuers rr"PromptCache._refresh_stale_entriess//1   {3}#5"66JKL'JC##**,,!!-P % 2 2 4IHHSU-?-?@MM++q0+LL#:3%!@A(!PMM00A50NN%CC51##NOOPs3A#C D*%:D%%D*cFUR5 URUUUS9 g)Reconfigure the cache parameters. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. refresh_interval_seconds: How often to check for stale entries. rENrrJrKs r configurePromptCache.configures'  #%=  r)rrrrr)r#r$r%r&r'rrrrrLrrrrrrrr) __classcell__rs@rrr1s.#$56I 6'G*W @@% @ #( @  @@4 , ( 9QP46'G*W   %  #(     rrc^\rSrSrSrS/r\\\S.SU4Sjjjr SSjr SSjr SSjr SS jr SS jrSS jr\\\S.SS jjrS rU=r$)AsyncPromptCacheiaThread-safe LRU cache with asyncio task refresh. For use with the asynchronous AsyncClient. Features: - In-memory LRU cache with configurable max size - Asyncio task for refreshing stale entries - Stale-while-revalidate: returns stale data while refresh happens - Thread-safe for concurrent access Example: >>> async def fetch_prompt(key: str) -> PromptCommit: ... return await client._afetch_prompt_from_api(key) >>> cache = AsyncPromptCache( ... max_size=100, ... ttl_seconds=3600, ... fetch_func=fetch_prompt, ... ) >>> await cache.start() >>> cache.set("my-prompt:latest", prompt_commit) >>> cached = cache.get("my-prompt:latest") >>> await cache.stop() _refresh_taskrEc2>[TU]UUUS9 SUlg)a7Initialize the async prompt cache. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. Set to None for infinite TTL (offline mode - entries never expire). refresh_interval_seconds: How often to check for stale entries. rEN)rrLrrs rrLAsyncPromptCache.__init__s+ #%=  <@rc~# URcUR5IShvN URXU5 gN7f)zSet a value in the cache. Args: key: The cache key (prompt identifier). value: The value to cache. refresh_func: Async function to refresh this cache entry when stale. N)rrrers rasetAsyncPromptCache.asets5    %**,   #l+ s !=;=c# URcgURbg[R"UR 5SS9Ul[ R S5 g7f)zStart async background refresh loop. Must be called from an async context. Creates an asyncio task that periodically checks for stale entries and refreshes them. Does nothing if ttl_seconds is None (infinite TTL mode). NzAsyncPromptCache-refresh)rz Started async cache refresh task)rArasyncio create_taskrrarbr3s rrAsyncPromptCache.startsV    $     ) $00    +   78sAAcbURb"URR5 SUlgg)zStop background refresh task. Synchronous wrapper that cancels the refresh task. For proper cleanup in async context, use stop() instead. N)rcancelr3s rrAsyncPromptCache.shutdowns/    )    % % '!%D  *rc# URcgURR5 URIShvN SUl[R S5 gN!![Ra N5f=f7f)z\Stop async background refresh loop. Cancels the refresh task and waits for it to complete. Nz Stopped async cache refresh task)rrrCancelledErrorrarbr3s rrAsyncPromptCache.stop$so    %  !!# $$ $ $" 78 %%%   s8)A9AAAA9AA63A95A66A9c # [R"UR5IShvN UR5IShvN MCNN![Ra e[ a"n[ RSU35 SnANASnAff=f7f)z/Async background loop to refresh stale entries.Nz.Unexpected error in async cache refresh loop: )rsleeprBrrrrarrs rrAsyncPromptCache._refresh_loop4s WmmD$:$:;;;11333;3))  W  #QRSQT!UVV WsPB#A AA A A BA A B )BBB  BcH# UR5nU(dg[RS[U5S35 UHup#URcMUR 5IShvN nUR X$UR5IShvN UR =RS- sl[RSU35 M gNdNB![aEnUR =RS- sl [RSUSU35 SnAMSnAff=f7f)z8Check for stale entries and refresh them asynchronously.NzAsync refreshing rrUzAsync refreshed cache entry: z$Failed to async refresh cache entry r) rorarbr]rrrCr0rr1rrs rr'AsyncPromptCache._refresh_stale_entries@s//1   (]);(<>> from langsmith import configure_global_prompt_cache >>> configure_global_prompt_cache(max_size=200, ttl_seconds=7200) rEN)prompt_cache_singletonrrEs rconfigure_global_prompt_cacherls &$$!9%rcJ# [RUUUS9IShvN gN7fr)async_prompt_cache_singletonrrEs r#configure_global_async_prompt_cachers-& ' 0 0!9 1 s #!#c8[R"S[SS9 g)NzcThe 'Cache' class is deprecated and will be removed in a future version. Use 'PromptCache' instead.) stacklevel)warningswarnDeprecationWarningrrr_deprecated_cache_class_warningrs MM % rcJ^\rSrSrSr\\\S.SU4SjjjrSr U=r $)Cacheiz:Deprecated alias for PromptCache. Use PromptCache instead.rEc8>[5 [TU] UUUS9 g)zInitialize the deprecated Cache class. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. refresh_interval_seconds: How often to check for stale entries. rENrrrLrs rrLCache.__init__& () #%=  rrr r#r$r%r&r'rrrrLr)rrs@rrrsCD 6'G*W   %  #(     rrcJ^\rSrSrSr\\\S.SU4SjjjrSr U=r $) AsyncCacheizDDeprecated alias for AsyncPromptCache. Use AsyncPromptCache instead.rEc8>[5 [TU] UUUS9 g)zInitialize the deprecated AsyncCache class. Args: max_size: Maximum entries in cache (LRU eviction when exceeded). ttl_seconds: Time before entry is considered stale. refresh_interval_seconds: How often to check for stale entries. rENrrs rrLAsyncCache.__init__r rrrr rs@rr r sCN 6'G*W   %  #(     rr rr)*r' __future__rrrwloggingrHrrabcr collectionsrcollections.abcr dataclassesrpathlibrtypingr r r r r getLoggerrarrrrr+r<rrrrrrrrr rrrrsa #  #%!@@   , -$* #02-  = =  = 77 7(i:si:XR "R j^I'^ID%/1 2#C&S !$   82#C&S !$   : K 2 ! r