}-jdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z dZ ddhZ ejd Zd$d Zd%d&dZd'dZddd(dZddd)dZd*dZd+dZddd,dZd-d!Zd.d#ZdS)/aCrash-safe WebUI turn journal helpers. The journal is deliberately tiny: one JSONL file per session, append-only events, and read helpers that tolerate malformed lines. Recovery and repair can then reason about submitted turns without depending on in-memory stream state. ) annotationsN)Path)Iterable _turn_journal completed interruptedz^[A-Za-z0-9_.-]+$returnrc,ddlm}t|S)Nr SESSION_DIR) api.modelsr rr s &/root/hermes-webui/api/turn_journal.py_default_session_dirrs"&&&&&&    session_idstr session_dir Path | Nonec t|pd}|r"d|vsd|vst|st d|t |n t }|tz |dz S)N/\zinvalid session_idz.jsonl)rstrip_SESSION_ID_RE fullmatch ValueErrorrrTURN_JOURNAL_DIR_NAME)rrsidroots r _journal_pathr s jB   % % ' 'C /#** >3K3KC3P3P -... + 74   =Q=S=SD ' 'S... 88rctjdtjdtjjddS)Nz%Y%m%dT%H%M%SZ- )timestrftimegmtimeuuiduuid4hexrr _make_turn_idr+$s>m,dkmm<< V Vtz||?OPSQSPS?T V VVrreventdictct|tstdt|dpd}|st dt|}|ddt||d<|dt|d tj t|| }|j d d tj|d ddz}tj|tjtjztjzd}tj|dd5}|||tj|dddn #1swxYwY tj|j tj} tj| tj| n#tj| wxYwn#t6$rYnwxYw|S)zAppend one turn journal event and fsync it before returning. The returned event is the exact payload written, with default ``version``, ``session_id``, ``turn_id``, and ``created_at`` fields filled in. zevent must be a dictr-rzevent is requiredversionrturn_id created_atr,T)parentsexist_okF),:) ensure_ascii separators iautf-8encodingN) isinstancer. TypeErrorrgetrr setdefaultr+r$r parentmkdirjsondumpsosopenO_CREATO_APPENDO_WRONLYfdopenwriteflushfsyncfileno O_DIRECTORYcloseOSError) rr-r event_namepayloadpathlinefdfhdir_fds rappend_turn_journal_eventr[(sU eT " "0.///UYYw''-2..4466J .,---5kkG y!$$$ OOGL y-//222 |TY[[111  = = =DKdT222 :gEj I I ID PD rzBK/"+=u E EB 2sW - - -     bn55  HV    HV    BHV           Ns=AG  G$'G$,$IH:%I:II I! I!cPt||}g}g} |d}n##t$rt |ggdcYSwxYwt |dD]\}}|s tj|}n-#tj $r| ||dYYwxYwt|tr| || ||dt |||dS)zDRead a session journal, returning valid events plus malformed lines.r,r<r=)revents malformedr1)start)rWraw) r read_text splitlinesFileNotFoundErrorr enumeraterrEloadsJSONDecodeErrorappendr?r.) rrrVr]r^linesline_nor`r-s rread_turn_journalrjQsd  = = =DFIN00;;== NNN!*oo"MMMMMN!%q111 < < yy{{   JsOOEE#      gc:: ; ; ; H  eT " " < MM%   gc:: ; ; ; ;j//V) T TTs#(AA A B$$'C Cr]Iterable[dict]"tuple[dict[str, dict], list[dict]]c2i}i}|D]}t|tst|dpd}|sQt |r)||g|||}|Jt|dpdt|dpdkr|||<d| D}||fS)aReturn the latest event per ``turn_id`` and any terminal-collision entries. The first element is the latest event per turn_id (same overwrite-by-timestamp behaviour as before). The second element is a list of collision records, one per turn_id that had more than one terminal event. Each collision record contains ``turn_id`` and the ``events`` list (in ascending created_at order). A collision means the same logical turn recorded both ``completed`` and ``interrupted`` terminal events -- the derived state still picks the latest by timestamp, but callers can now detect and audit the double-terminal situation explicitly rather than having it silently collapse. r2rNr3rcdg|]-\}}t|dk|t|dd.S)r1cJt|dpdS)Nr3r)floatrA)es rz7derive_turn_journal_states...s eAEE,DWDWD\[\>]>]r)key)r2r])lensorted).0tidevtss r z.derive_turn_journal_states..sL C t99q==6$4]4]#^#^#^__ ==r) r?r.rrAris_terminal_turn_eventrBrgrpitems)r]statesterminal_eventsr-r2previous collisionss rderive_turn_journal_statesris2!F-/O $ $%&&  eii **0b117799   !% ( ( B  & &w 3 3 : :5 A A A::g&&  uUYY|%<%<%ABBeHLLYeLfLfLkjkFlFlll#F7O(..00J : r stream_id str | NonecTt|pd}|sdSd}|D]{}t|tst|dpd|krAt|dpd}|r|}||S)Nrrr2)rrr?r.rA)r]rstreamlatestr-r2s r_latest_turn_id_for_streamrs b ! ! ' ' ) )F tF%&&   uyy%%+ , , 6 6 eii **0b117799  F Mrc t|}t||d<|ds=t||}t |dpg|}|r||d<t |||S)zDAppend a lifecycle event for the turn associated with ``stream_id``.rr2r,r])r.rrArjrr[)rrr-rrUjournalr2s r$append_turn_journal_event_for_streamrs5kkGy>>GK ;;y ! !)#JKHHH,W[[-B-B-Hb)TT  )!(GI  $Zk R R RRr list[str]ct|tz }|sgStd|dDS)Nc3LK|]}||jV dSN)is_filestem)rvrVs r z0iter_turn_journal_session_ids..s1VVt||~~V$)VVVVVVrz*.jsonl)rrexistsruglob)r journal_dirs riter_turn_journal_session_idsrsY{##&;;K      VV (8(8(C(CVVV V VVrboolc\t|pidpdtvS)Nr-r)rrA_TERMINAL_EVENTS)r-s rrzrzs-    ))/R 0 04D DDr)r rr)rrrrr r)r r)rrr-r.rrr r.)rrrrr r.)r]rkr rl)r]rkrrr r) rrrrr-r.rrr r.)rrr r)r-r.r r)__doc__ __future__rrErGrer$r'pathlibrtypingrrrcompilerrr r+r[rjrrrrrzr*rrrs #""""" '/011 99999WWWW $ &&&&&&RFJUUUUUU0$$$$L    * $ SSSSSS$WWWWEEEEEEr