From 3ccde2438a3ae8edccada6c9611a5c063eb218ea Mon Sep 17 00:00:00 2001 From: hwan <2020112023@dgu.ac.kr> Date: Mon, 22 Jun 2026 16:33:55 +0900 Subject: [PATCH 1/4] =?UTF-8?q?#994=20[docs]=20AI=20Agent=20=EC=8B=A0?= =?UTF-8?q?=EB=A2=B0=EC=84=B1=20=EA=B2=80=EC=A6=9D=20=EA=B2=B0=EA=B3=BC?= =?UTF-8?q?=C2=B7=EA=B8=B0=EC=A4=80=C2=B7=EB=B0=9C=ED=91=9C=20=EC=9E=90?= =?UTF-8?q?=EB=A3=8C=20=EC=B6=94=EA=B0=80=20(#995)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- ...354\204\261-\352\262\200\354\246\235.html" | 427 ++++++++++++++++ ...4\200\354\266\234\354\262\230-20260622.md" | 191 ++++++++ ...70\353\262\244\355\206\240\353\246\254.md" | 181 +++++++ .../results-20260622/rca_campaign_floor.json | 455 ++++++++++++++++++ ...\354\244\200\354\266\234\354\262\230.html" | 226 +++++++++ 5 files changed, 1480 insertions(+) create mode 100644 "docs/presentation/ai-\354\213\240\353\242\260\354\204\261-\352\262\200\354\246\235.html" create mode 100644 "docs/test/agent-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230-20260622.md" create mode 100644 "docs/test/agent-\354\232\264\354\230\201\355\205\214\354\212\244\355\212\270-\354\235\270\353\262\244\355\206\240\353\246\254.md" create mode 100644 docs/test/results-20260622/rca_campaign_floor.json create mode 100644 "docs/test/\354\213\234\352\260\201\355\231\224-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230.html" diff --git "a/docs/presentation/ai-\354\213\240\353\242\260\354\204\261-\352\262\200\354\246\235.html" "b/docs/presentation/ai-\354\213\240\353\242\260\354\204\261-\352\262\200\354\246\235.html" new file mode 100644 index 00000000..c96e38f0 --- /dev/null +++ "b/docs/presentation/ai-\354\213\240\353\242\260\354\204\261-\352\262\200\354\246\235.html" @@ -0,0 +1,427 @@ + + + + + +Bifrost · AI 신뢰성 검증 (부록) + + + + +
+ + +
+
Bifrost
+
APPENDIX · 기술 상세
+
+
AI 운영 장애대응 — 아키텍처 · 환각 통제 · 성능 검증
+

AI 장애대응 에이전트,
어떻게 만들었고 얼마나 믿을 수 있나

+

RCA(근본원인분석) Assistant — LLM이 원인을 생성하지 않고, 카탈로그·증거로 선택하고, 불확실하면 기권한다.
글로벌 표준(NIST·OWASP·ITIL·Google SRE)을 벤치마킹해 설계하고, 정확도·보정·안전성을 실측으로 검증했다.

+
+ FastAPI AgentSupervisor 상태머신RAG · pgvectorGPT-4 계열Kafka / DebeziumKubernetesSSE 스트리밍 +
+
+ +
+ + +
+
Bifrost
+
아키텍처
+

AI는 진단만, 실행은 운영 백엔드에 위임 + 사람 승인

+

에이전트는 운영 리소스(Kafka·K8s·DB)를 직접 만지지 않는다. 관측·조치는 전부 운영 백엔드의 내부 전용 API로 위임하고, 변경 조치는 승인 게이트를 통과해야 한다.

+
+
사용자
운영 콘솔(React)—자연어 질의 · 대시보드→ SSE 실시간 스트리밍 →진단·근거·조치안 수신
+
↓ ↑
+
AI Agent Server (FastAPI) +
Supervisor 상태머신 · 8 stage 파이프라인
+
+ Router›Correlation›Planner›Retrieval›Classifier›RCA›Verifier›Report +
+
LLM: GPT-4 계열RAG: pgvector(KEDB·런북)agentdb: run·event 영속예산 가드(step·시간·토큰)
+
+
↓ tool calls (read 17 / mutation 4)
+
운영 백엔드 (Spring) · /internal/ops
관측: 로그·지표·트레이스·lag조치: connector restart/pause/resume→Kafka · Kafka Connect(Debezium)Kubernetes(Fabric8/Strimzi)PostgreSQL
+
+
핵심: 관측·조치는 운영 백엔드로 위임(직접 제어 금지) · 변경 조치 4종은 HITL 승인 필수 · 모든 진행은 SSE 16종 이벤트로 스트리밍
+ +
+ + +
+
Bifrost
+
서비스 플로우
+

장애 감지 → 진단 → 승인 → 조치 (End-to-End)

+

Kafka consumer lag 급증·Connector FAILED 등이 감지되면 에이전트 run이 시작되고, 진단 결과는 사람 승인을 거쳐야만 실제 조치로 이어진다.

+
+
감지
Incident
lag·FAILED
자동 트리거
+
›
+
수집
Evidence
로그·지표·
트레이스 수집
+
›
+
진단
RCA
근본원인
선택·신뢰도
+
›
+
검증
Verifier
미검증 결론
차단
+
›
+
승인
HITL Gate
사람 승인
(필수)
+
›
+
조치
Execute
조치 + 실패 시
자동 롤백
+
+
+
▶전 과정 SSE 실시간 스트리밍

run_started → agent별 진행 → tool 호출 → 근거 수집 → 조치안 → 완료. 끊겨도 마지막 이벤트부터 재연결.

+
■조회는 즉시, 변경은 게이트

읽기 도구는 바로 실행. 변경 도구 4종은 정책 판정 → 승인 → 실행 순서를 반드시 거친다.

+
+ +
+ + +
+
Bifrost
+
Q. 로그만 주면 진단되나?
+

로그를 그냥 LLM에 던지지 않는다 — Evidence-grounded RCA

+

단순 로그 요약은 “그럴듯한 환각”을 만든다. Bifrost는 증거 수집 → 카탈로그 매칭 → 증거 게이트 → 신뢰도 산정의 결정론적 파이프라인을 거친다.

+
+
✕Log dump → LLM (안티패턴)

원인을 자유 생성 → 검증 불가, 재현 불가, 같은 입력에 다른 답. RCA가 아니라 “요약”.

→ 신뢰 불가
+
✓Evidence-grounded 파이프라인

증거 정규화 → 35종 root-cause 카탈로그와 대조 → evidence matrix(required/supporting/negative) 충족 점수화 → 신뢰도 산정.

→ 근거·재현 가능
+
+
증거 부족 시 단정 대신 abstention(기권) — 실측 35건 중 5건 보류, 카탈로그-외 원인(환각) 0건
+
벤치마킹: ITIL Problem Management의 evidence 기반 진단 + RAG(Lewis et al., NeurIPS 2020)의 grounding 원리를 RCA 파이프라인에 적용
+ +
+ + +
+
Bifrost
+
환각 통제 · RCA 국제 표준
+

RCA 방식은 글로벌 IT 운영 표준을 벤치마킹했다

+

“정해진 원인 목록에서 증거로 고른다”는 우리 임의 설계가 아니라, 수십 년 검증된 ITSM·품질관리 표준을 LLM RCA에 이식한 것이다.

+ + + + + + + + +
글로벌 레퍼런스업계는 이렇게 한다 (원리)→ Bifrost 적용
ITIL 4 Problem Mgmt+ KEDB · Axelos근본원인 분석 후 Known Error로 등록해 재발 시 재사용35종 root-cause 카탈로그 + KEDB(증상·검증된 조치·롤백 절차)
5 WhysToyota Production System표면 증상이 아니라 더 깊은 근본원인까지 파고든다증상(Connector FAILED)을 입증된 심층 원인(DB timeout 등)으로 강등
Evidence-groundingRAG · Lewis et al. 2020근거 문서에 연결되지 않은 생성은 신뢰하지 않는다evidence matrix로 required 증거 미충족 시 신뢰도 상한(cap)
ISO/IEC 20000-1IT 서비스 관리incident → problem → known error의 표준 프로세스Classifier→RCA→Verifier→Report로 ITSM 흐름 자동화
+
핵심 원칙 — RCA Assistant, not Engine: LLM은 원인을 ‘생성’하지 않고, 카탈로그에서 증거로 ‘선택·설명’한다
+
출처: ITIL 4 Problem Management(Axelos 2020) · 5 Whys(Ohno 1988) · RAG(arXiv:2005.11401) · ISO/IEC 20000-1:2018
+ +
+ + +
+
Bifrost
+
리스크 관리 지표
+

AI 리스크 관리도 국제 프레임워크를 벤치마킹

+

정부 표준(NIST)·업계 표준(OWASP)·규제(EU AI Act)·학술 지표(ECE)가 요구하는 안전장치를 그대로 구현·측정했다.

+ + + + + + + + +
글로벌 레퍼런스업계는 이렇게 한다 (원리)→ Bifrost 적용
NIST AI RMF 1.0미국 표준기구, 2023AI 위험을 MEASURE(정량 측정)·MANAGE(대응)로 관리RCA 정확도·ECE를 지표화해 측정, 위험 조치는 승인으로 관리
OWASP Top 10 for LLM2025프롬프트 인젝션(LLM01)·민감정보 유출(LLM02)을 최우선 위협으로 규정대화 루프에 read-only 도구만 노출 + 자격증명 자동 마스킹
EU AI Act 제14조Reg.(EU) 2024/1689고위험 AI는 사람의 감독(human oversight) 의무모든 변경 조치에 HITL 승인 게이트 — 미승인 시 실행 불가
ECE 보정 지표Guo et al., ICML 2017“신뢰도 0.8 = 실제 정답률 80%”가 되도록 보정 측정10-bin ECE = 0.083 (<0.10) — 과신 없이 정직한 신뢰도
+
“알아서 잘하겠지”가 아니라 — 표준이 요구하는 안전장치를 지표로 측정해 증명한다
+
출처: NIST AI 100-1(2023) · OWASP Top 10 for LLM(2025) · EU AI Act 2024/1689 Art.14 · Guo et al.(arXiv:1706.04599)
+ +
+ + +
+
Bifrost
+
Q. LLM 의존 → 환각 대응?
+

환각이 결과에 닿기 전, 5중 방어로 차단

+

RCA가 LLM에 의존해도, 출력으로 나가려면 5개 관문을 통과해야 한다. 어느 하나라도 막히면 기권하거나 재검증으로 돌아간다.

+
+
1
카탈로그 바운드
35종 외 원인 생성 불가
+
2
Evidence Gate
required 증거 충족 점수화
+
3
신뢰도 임계
≥0.80 조치 / 0.60~0.79 보강
+
4
Abstention
<0.60 → UNKNOWN 기권
+
5
Verifier
미검증 결론 Report 차단
+
+
+
0
환각 (카탈로그-외)
35건 전수, 날조 0건
+
90%
확신 시 정확도
신뢰도 ≥0.80일 때 (9/10)
+
0.083
ECE (보정 오차)
<0.10, 과신 없음
+
+
벤치마킹: Selective Prediction/Abstention(Geifman & El-Yaniv, NeurIPS 2017) + Calibration(Guo et al. 2017)을 RCA 신뢰도 게이트에 적용
+ +
+ + +
+
Bifrost
+
AI 성능 지표
+

RCA 정확도 — 35개 장애 시나리오 실측

+

평가 지표는 RCA 연구의 표준인 Accuracy@k(상위 k개 안에 정답 포함)와 Avg@5(MRR), ECE를 사용. LLM 타이브레이커 off의 보수적 floor 값.

+
+
85.7%
ACCURACY@5
상위 5개 내 정답
top-1 71.4% · top-3 85.7%
+
90%
PRECISION@CONF≥0.80
확신 시 정확도
신뢰도 높을 때 9/10
+
0.781
Avg@5 (MRR)
평균 정답 순위
정답이 상위에 위치
+
0건
HALLUCINATION
환각 / 기권 5건
날조 0 · 정직한 보류 5/35
+
+
top-1 오답 5건도 전부 top-3 내 정답 포함 — 엉뚱한 오진이 아닌 근접 실패 · 단위 회귀 48/48 통과
+
실측 2026.06.22 · 35 gold set · ECE 0.083 · 지표 정의: AC@k·Avg@5 = RCAEval(arXiv:2412.17015) 표준
+ +
+ + +
+
Bifrost
+
외부 SOTA 대비
+

단순 LLM 호출 대비 파이프라인의 효과

+

같은 GPT-4라도 ‘어떻게 오케스트레이션하느냐’가 RCA 정확도를 가른다. 산업·학계 연구와 비교한 대략적 수준.

+
+
Bifrost — Accuracy@5
85.7%
+
RCACopilot (EuroSys 2024) — Micro-F1
0.766
+
PACE-LM (Microsoft 2023) — GPT-4+RAG, top-1
43.4%
+
단순 GPT-4 프롬프트 (CoT 없음)
2.6%
+
+
메시지: 신뢰도는 모델이 아니라 RCA 파이프라인(카탈로그+증거+검증)이 만든다
+
출처: RCACopilot(EuroSys 2024, arXiv:2305.15778) · PACE-LM(Microsoft 2023, arXiv:2309.05833). ※ 지표 정의 상이(우리 AC@5=top-5 / PACE-LM=top-1 / RCACopilot=Micro-F1) → ‘수준’ 비교
+ +
+ + +
+
Bifrost
+
안전성
+

치명 위험 3종 — 코드 게이트로 0건 보장

+

OWASP LLM Top 10이 지목하는 위협을, ‘발화 통제’가 아니라 ‘행위 차단’으로 막는다. 우회 경로 자체가 코드 레벨에서 닫혀 있다.

+
+
0
무승인 실행
변경 도구 4종 전부 HITL 승인 필수
(승인 전 백엔드 호출 자체 차단)
+
0
정보 유출
자격증명·민감정보 자동 마스킹
(OWASP LLM02)
+
0
테넌트 침범
모든 도구 호출에 project 범위 강제
(타 워크스페이스 접근 불가)
+
+
프롬프트 인젝션(OWASP LLM01)도 무력화 — 대화 루프엔 read-only 도구만 노출돼 “지금 재시작해”로 변경 불가
+
벤치마킹: OWASP Top 10 for LLM(2025) LLM01/02 + EU AI Act human oversight를 정책 매트릭스·승인 게이트·마스킹으로 구현
+ +
+ + +
+
Bifrost
+
Q. Rollback / 실패 시나리오
+

조치 실패 시 역조치로 자동 복구

+

변경관리(ITIL Change Mgmt)의 back-out plan 원리를 적용 — 조치가 실패(FAILED/BLOCKED)하면 직전 상태로 되돌린다.

+
+
조치 실행
Execute
승인된 조치 수행
+
›
+
실패 감지
Detect
FAILED / BLOCKED
+
›
+
역조치
Rollback
직전 상태 복구
+
+
+
↩역조치 매핑

pause ↔ resume 상호 원복 · restart 실패 시 직전 상태(RUNNING/PAUSED)로 복원 · 안전한 역조치 없으면 N/A 처리.

+
⚖위험도 기반 처리

MEDIUM: 자동 롤백 + 감사 기록 · HIGH: 롤백도 사람 승인 필요 · 이미 완료된 조치는 롤백 대상 제외.

+
+
벤치마킹: ITIL 4 Change Management의 back-out(rollback) plan을 risk-tier 기반 자동/승인 복구로 구현 (rollback 단위 테스트 통과)
+ +
+ + +
+
Bifrost
+
Q. Version 관리
+

모든 판단에 재현성 매니페스트를 기록

+

MLOps·NIST가 요구하는 추적성(traceability)을 위해, run마다 “무엇으로 그 판단을 했는지”를 자동 기록 — 사후 재현·감사·디버깅 가능.

+
Reproducibility Manifest (run 단위 기록) +
+ model_idmodel_tier_map (agent별)prompt_versionprompt_hashcatalog_versionevidence_matrix_versionrunbook_versioncorpus_manifest_hasheval_dataset_versioncode_commit_shatemperature +
+
+
+
코드/배포
code_commit_sha
CI(Jenkins→Harbor→ArgoCD) + gitops 태그로 배포 버전 고정
+
데이터 스키마
Alembic 18 마이그레이션
agentdb 스키마 버전 이력 관리
+
운영 임계값
Threshold Registry
value + version·basis·owner·calibrated_at 거버넌스
+
+
→ “그때 왜 그렇게 판단했나?”에 항상 답 가능 — 블랙박스가 아니다
+
벤치마킹: NIST AI RMF(MAP/MEASURE) 추적성 요구를 run 단위 재현성 매니페스트로 구현 (append-only 기록)
+ +
+ + +
+
Bifrost
+
Q. 장애 알림 기준
+

알림 기준은 Google SRE를 벤치마킹한 명시적 임계값

+

SRE의 4 Golden Signals(Latency·Traffic·Errors·Saturation)와 SLO 기반 알림 원리를 적용 — 잠깐의 스파이크가 아니라 ‘실제 문제’일 때만 발화.

+
+
Consumer Lag (CDC sink) — Traffic/Saturation
WARNING ≥ 5,000CRITICAL ≥ 50,000
+
Error Rate — Errors
WARNING > 0.5%CRITICAL > 2%
+
Connector Task FAILED · 연결 실패 — Errors
CRITICAL 즉시
+
+
WARN 단건은 로그만, 동일 리소스 30분 내 2건↑일 때 인시던트 — 알람 피로 최소화
+
벤치마킹: Google SRE 4 Golden Signals · Alerting on SLOs(burn rate)를 임계값 거버넌스(Threshold Registry)로 구현 · 단일 출처: spec 부록 B
+ +
+ + +
+
Bifrost
+
검증 방법론
+

Negative Control — 시험이 오류를 잡는지부터 검증

+

“테스트 통과”가 아니라, 일부러 오라벨·정상 상황을 섞어 우리 평가가 실패를 탐지하는지부터 확인했다. 오프라인(결정론)과 라이브(실서비스)를 분리 측정.

+
+
88.9%
ROUTING@1 (LIVE)
자연어→정확한 도구 호출
배포 agent 18케이스, read-only
+
94.4%
ROUTING@HIT
정답 도구 호출 도달
불필요 호출 0.17 / 7.3s
+
0건
LIVE ERROR
라이브 실행 오류
18케이스 전부 정상
+
48/48
UNIT REGRESSION
단위 회귀 통과
정확도·보정·분류
+
+
지어내지 않고, 모르면 기권하고, 실행은 사람이 결정한다.
+
실측 2026.06.22 · 라이브 자연어 질의 18건 · 오프라인 35 시나리오 · 지표: routing@1, Acc@k, MRR, ECE (RCAEval·IR 표준)
+ +
+ + +
+
Bifrost
+
References
+

벤치마킹한 표준 · 논문 출처

+
+

표준 · 프레임워크 · 벤더

· NIST AI RMF 1.0 (NIST AI 100-1, 2023)
· OWASP Top 10 for LLM Applications (2025)
· EU AI Act — Reg.(EU) 2024/1689 §14 Human oversight
· ITIL 4 Problem Management + KEDB (Axelos 2020)
· ISO/IEC 20000-1:2018 · ISO/IEC 42001:2023
· Google SRE — 4 Golden Signals · Alerting on SLOs
· Google SAIF · Microsoft Responsible AI Standard v2

+

논문 · 벤치마크

· Guo et al., Calibration of NN (ECE), ICML 2017
· Lewis et al., RAG, NeurIPS 2020
· Geifman & El-Yaniv, Selective Classification, 2017
· PACE-LM, Microsoft, 2023 (arXiv:2309.05833)
· RCACopilot, EuroSys 2024 (arXiv:2305.15778)
· Ahmed et al., LLM RCA, ICSE 2023
· RCAEval (Acc@k·Avg@5 지표) · Zheng et al., LLM-as-judge, 2023

+
+
상세 근거·재현 명령·원본 수치: docs/test/agent-검증결과-기준출처-20260622.md · 모든 수치 2026.06.22 재실측 (구버전 89.6%/367케이스는 재현 출처 없어 미사용)
+ +
+ +
+
← → 또는 Space 로 이동 · F 전체화면 · ⌘/Ctrl+P 인쇄·PDF
+ + + diff --git "a/docs/test/agent-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230-20260622.md" "b/docs/test/agent-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230-20260622.md" new file mode 100644 index 00000000..d17d51de --- /dev/null +++ "b/docs/test/agent-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230-20260622.md" @@ -0,0 +1,191 @@ +# Bifrost AI Agent 검증 결과 · 기준 · 출처 (2026-06-22) + +운영/오프라인 환경에서 FastAPI Agent Server(`services/ai-service`)를 테스트한 **실측 수치**와, 그 평가 기준이 근거하는 **네임밸류 글로벌 표준·논문 출처**를 정리한다. 발표(PPT) 근거 문서. + +> 수치 정직성 원칙: 아래는 **(A) 오늘 실제 측정 / (B) 코드·설계로 보장(측정 아님) / (C) 미측정·추가 필요**를 명확히 구분한다. 구버전 슬라이드의 `89.6% / 367케이스`는 코드에 출처가 없어 **사용하지 않는다**(재현 불가). 본 문서의 RCA 수치는 2026-06-22 재실행값이다. + +--- + +## 1. 한눈에 — 측정 수치 요약 (A: 오늘 실측) + +| 영역 | 수치 | 조건 | 산출 | +|---|---|---|---| +| **RCA top-1 정확도** | **71.4%** (25/35) | 오프라인 floor, 35 gold set, LLM 타이브레이커 off | `scripts/rca_eval_campaign.py` | +| **RCA top-3 / top-5** | **85.7%** (30/35) | 〃 | 〃 | +| **Avg@5 (MRR)** | **0.781** | 〃 | 〃 | +| **확신 시 정확도(precision@conf≥0.80)** | **90.0%** (9/10) | 신뢰도 0.80 이상만 | 파생 | +| **보정 오차 ECE** | **0.083** (<0.10 양호) | 10-bin | `app/evaluation/calibration.py` | +| **환각(카탈로그-외 원인 생성)** | **0건** | 35건 전수 | 파생 | +| **정직한 기권(UNKNOWN)** | **5/35** (14.3%) | 근거 부족 시 보류 | 파생 | +| **top-1 오답 회복** | **5/5** 전부 top-3 내 정답 | 기권 제외 오답 | 파생 | +| **NL→tool 라우팅 정확도** | **routing@1 88.9% / hit 94.4%** | 라이브 배포 agent, 18케이스, 에러 0 | `eval.online.nl_tool_routing --live` | +| 라우팅 낭비 스텝 / 지연 | wasted 0.17 / 7.3s | 〃 | 〃 | +| **라이브 fault 주입 RCA** | sink_db_down → 정답, conf 0.82 | 실제 클러스터 1케이스 | `eval.online.live_eval --live` | +| 단위 회귀(정확도·보정·분류) | **48/48 통과** | pytest | 〃 | + +비교 기준선(외부 SOTA, §4): PACE-LM(MS 2023) GPT-4+검색증강 **top-1 43.4%**, RCACopilot(EuroSys'24) **Micro-F1 0.766**. + +--- + +## 2. 평가·설계 기준 — 글로벌 벤치마킹과 적용 + +우리 설계·평가 기준은 임의로 만든 게 아니라, **네임밸류 있는 글로벌 벤더·표준기구·논문이 쓰는 방식을 벤치마킹해 우리 프로젝트에 이식**한 것이다. 각 항목은 "**업계는 이렇게 한다(원리) → Bifrost는 이렇게 적용했다(구현)**" 형태로 정리한다. (URL은 리서치로 실재 확인. ISO/OpenAI 일부는 봇 차단으로 본문 미검증, 표기) + +### 2.1 RCA 방법론 — IT 운영·품질관리 표준을 LLM RCA에 이식 + +**ITIL 4 Problem Management + KEDB** (Axelos 2020 · https://www.axelos.com/resource-hub/practice/problem-management-itil-4-practice-guide) +- 업계 원리: 인시던트의 근본원인을 분석한 뒤 **Known Error**로 등록(KEDB)해, 재발 시 즉시 진단·복구에 재사용한다. +- Bifrost 적용: 35종 root-cause 카탈로그를 KEDB처럼 운영 — 증상·검증된 조치·롤백 절차·과거 인시던트 링크를 보관(`app/catalogs/kedb.py`)하고 RCA가 이를 참조한다. + +**5 Whys** (Toyota Production System, Ohno 1988 · https://en.wikipedia.org/wiki/Five_whys) +- 업계 원리: "왜?"를 반복해 표면 증상이 아닌 **진짜 근본원인**까지 내려간다. +- Bifrost 적용: 증상성 원인(예: Connector Task FAILED)이 떠도, 더 깊은 원인(예: Sink DB 연결 타임아웃)이 증거로 입증되면 증상을 그 아래로 **강등**해 근본원인을 top에 올린다(`rca.py` 증상 강등 로직). + +**Ishikawa(특성요인도)** (ASQ · https://asq.org/quality-resources/fishbone) +- 업계 원리: 하나의 결과(문제)에 대한 잠재 원인을 **범주별로 분기**해 본다. +- Bifrost 적용: 1개 incident_type → 복수 root-cause 후보로 매핑(`incident_rootcause_map.py`)해 한 증상을 여러 원인 가설로 분기·점수화한다. + +**ISO/IEC 20000-1:2018** (IT 서비스 관리 · https://www.iso.org/standard/70636.html) +- 업계 원리: incident → problem → known error로 이어지는 ITSM 프로세스를 체계화한다. +- Bifrost 적용: Classifier→RCA→Verifier→Report 파이프라인이 이 ITSM 흐름을 자동화한 형태다. + +> 한 줄: "원인을 **생성**하지 않고 **카탈로그에서 증거로 선택**한다"는 RCA Assistant 원칙은, 수십 년 검증된 ITSM·품질관리 표준을 LLM에 그대로 이식한 결과다. + +### 2.2 장애 알림·심각도 — Google SRE 운영 표준을 벤치마킹 + +**Google SRE — 4 Golden Signals** (https://sre.google/sre-book/monitoring-distributed-systems/) +- 업계 원리: 사용자 대면 시스템은 **Latency·Traffic·Errors·Saturation** 4개 신호를 본다. +- Bifrost 적용: 관측 도구 세트가 이 4신호를 그대로 커버 — 지표 조회(latency/saturation)·로그 검색(errors)·consumer lag 조회(traffic/saturation). + +**Google SRE — Alerting on SLOs** (https://sre.google/workbook/alerting-on-slos/) +- 업계 원리: 알림은 단순 임계가 아니라 **error budget / burn rate**(추세) 기준으로, 잠깐의 스파이크엔 울리지 않는다. +- Bifrost 적용: 임계값을 숫자로 박지 않고 **value+version+basis+owner로 거버넌스**(`threshold_registry`)하고, WARN 단건은 로그만·동일 리소스 30분 2건↑일 때 인시던트로 승격해 알람 피로를 줄인다. + +**PagerDuty Severity Levels** (https://response.pagerduty.com/before/severity_levels/) · **Confluent Kafka lag alerting** (https://docs.confluent.io/platform/current/monitor/monitor-consumer-lag.html) +- 업계 원리: 심각도를 SEV 등급으로 명확히 정의하고, Kafka lag은 절대값이 아니라 추세로 본다. +- Bifrost 적용: 심각도 2단계(WARNING/CRITICAL) + consumer lag 임계(WARNING 5,000 / CRITICAL 50,000, spec 부록 B 단일 출처). + +### 2.3 AI 리스크·환각 통제 — 정부·업계·규제 프레임워크를 그대로 구현 + +**NIST AI RMF 1.0** (NIST AI 100-1, 2023 · https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf) +- 업계 원리: AI 위험을 GOVERN·MAP·**MEASURE**(정량 측정)·**MANAGE**(대응)로 관리한다. +- Bifrost 적용: RCA 정확도·ECE를 지표화해 MEASURE, 위험 조치를 승인 게이트로 MANAGE, 정책 매트릭스로 GOVERN. + +**OWASP Top 10 for LLM 2025** (https://genai.owasp.org/llm-top-10/) +- 업계 원리: LLM01 Prompt Injection·LLM02 Sensitive Information Disclosure·LLM05 Improper Output Handling을 최우선 위협으로 규정한다. +- Bifrost 적용: 대화(ReAct) 루프엔 read-only 도구만 노출(인젝션으로 변경 불가), 자격증명·민감정보 자동 마스킹, 출력 요약 화이트리스트로 검증. + +**EU AI Act 제14조 Human oversight** (Reg.(EU) 2024/1689 · https://artificialintelligenceact.eu/article/14/) +- 업계 원리(규제): 고위험 AI는 사용 중 사람이 **효과적으로 감독·재정의**할 수 있어야 한다. +- Bifrost 적용: 모든 변경 조치는 HITL 승인 게이트 통과 필수 — 미승인 시 백엔드 호출 자체가 차단. + +**Google SAIF / Microsoft Responsible AI v2** (https://saif.google/ · Microsoft RAI Standard v2) +- 업계 원리: AI 고유 위협(인젝션·데이터 포이즈닝 등)에 대한 보안·책임성 프레임워크. +- Bifrost 적용: 인젝션 차단·출력 검증·HITL을 통해 책임성(accountability) 확보. (ISO/IEC 42001:2023 AI 경영시스템도 동일 맥락 — 운영·로깅·라이프사이클 거버넌스로 정렬) + +### 2.4 정량 지표·기법 — 학술 표준 그대로 + +**ECE (Expected Calibration Error)** — Guo et al., ICML 2017 · https://arxiv.org/abs/1706.04599 +- 업계 원리: "신뢰도 0.8이면 실제 정답률도 80%"가 되도록 보정 정도를 측정(10-bin). +- Bifrost 적용: ECE 0.083(<0.10)으로 과신 여부를 검증(`calibration.py`). + +**RAG (검색증강생성)** — Lewis et al., NeurIPS 2020 · https://arxiv.org/abs/2005.11401 +- 업계 원리: 외부 근거 문서를 검색해 조건으로 생성하면 환각이 준다. +- Bifrost 적용: pgvector 기반 KEDB·런북 검색으로 근거 기반 답변. + +**Selective Prediction / Abstention** — Geifman & El-Yaniv, NeurIPS 2017 · https://arxiv.org/abs/1705.08500 +- 업계 원리: 불확실한 입력은 **기권(reject)** 해 오류율을 보장한다. +- Bifrost 적용: 신뢰도 < 0.60이면 `UNKNOWN_WITH_EVIDENCE_GAP`로 기권(찍지 않음). + +**Human-in-the-Loop** — Wu et al., FGCS 2022 · https://arxiv.org/abs/2108.00941 +- 업계 원리: 인간 판단을 운영 루프에 통합해 정확성·안전성을 높인다. +- Bifrost 적용: 변경 조치 전 사람 승인(EU AI Act §14와 동일 취지). + +**평가지표 표준** — Accuracy@k·Avg@5(RCAEval, arXiv:2412.17015) / MRR(Voorhees, TREC-8 1999) / Macro-F1(Sokolova & Lapalme 2009) / Wilson score interval(Wilson 1927; Brown et al. 2001) / LLM-as-judge(Zheng et al., NeurIPS 2023, 인간 일치 80%+) +- 업계 원리: RCA·분류 평가의 사실상 표준 지표. +- Bifrost 적용: AC@k·Avg@5·ECE를 산출(`metrics.py`·`calibration.py`). ※ Macro-F1·Wilson CI는 현재 미구현(추가 시 산출 가능). + +--- + +## 3. RCA 정확도 상세 (A: 오늘 실측) + +`scripts/rca_eval_campaign.py`, 35 gold set, 관측 증거만 입력(정답 결론 비주입), LLM 타이브레이커 off(보수적 floor), temperature 0.0. 원본: [results-20260622/rca_campaign_floor.json](results-20260622/rca_campaign_floor.json). + +- AC@1 **0.7143** · AC@3 **0.8571** · AC@5 **0.8571** · Avg@5 **0.781** · ECE **0.0832** · 기권 **5/35** +- 계층별: kafka 6건 AC@3 1.0 / source 5건 AC@3 1.0 / infra 5건 0.8 / pipeline 7건 0.857 / sink·data_quality·change 0.75 — 취약계층(AC@3<0.7) **없음** +- **환각 0**: 35건 top 예측이 전부 35개 카탈로그 id 또는 `UNKNOWN_WITH_EVIDENCE_GAP`. 날조 id 0건 +- **기권 5건**(gs_018/026/029/032/035)은 top_conf 0.0의 정직한 보류 — 우기지 않음 +- **top-1 오답 5건(기권 제외) 전부 top-3 내 정답 포함** — 근접 실패, 치명 오진 아님 +- **확신(≥0.80) 9/10 정답(90%)** — 단정할 땐 거의 맞음 + +> floor(LLM off)는 하한이며, LLM 타이브레이커 on(`RCA_EVAL_USE_LLM=1`, 배포 pod)에서 상승 여지. 라이브 fault 주입(sink_db_down)은 정답·conf 0.82. + +--- + +## 4. 외부 SOTA 대비 (발표 비교용) + +| 출처 | 수치 | 조건 | 메모 | +|---|---|---|---| +| **Bifrost(우리)** | **AC@5 85.7% / Avg@5 0.781** | 35 gold set, floor | — | +| PACE-LM (Microsoft, 2023) · arXiv:2309.05833 | top-1 **43.4%** | GPT-4 + 검색증강, 3,000건 | top-1 정의 | +| RCACopilot (EuroSys'24) · arXiv:2305.15778 | **Micro-F1 0.766** | GPT-4, category 예측 | 우리 Avg@5 0.781과 동급대 | +| RCACopilot 단순 GPT-4 프롬프트 | Micro-F1 0.026 | CoT 없음 | "파이프라인이 핵심" 근거 | +| Ahmed (ICSE'23) · arXiv:2301.03797 | 사용성 70%+ | 현업 27명 사람평가 | 수용성 | + +⚠️ **지표 정의가 다르다**(우리 AC@5 = top-5 랭킹 / PACE-LM 43.4% = top-1 correctness / RCACopilot 0.766 = Micro-F1). 발표 시 반드시 각주로 명시. "동급 또는 상회"로 포지셔닝하되 단순 대소 비교는 지양. + +--- + +## 5. 안전성·환각 통제 메커니즘 (B: 코드·설계로 보장) + +오늘 공격 카운트 하네스를 새로 돌리지 않았으므로(미구현, §7), 아래는 **코드 게이트로 구조적으로 보장**되는 사실이다. 측정값이 아니라 "우회 경로가 코드 레벨에서 닫혀 있음". + +| 통제 | 메커니즘 | 코드 | +|---|---|---| +| 카탈로그-바운드 RCA | 35개 root cause 외 생성 불가, 미충족 시 기권 | `rca.py`, `verifier.py`(catalog-외 id FAIL) | +| 신뢰도 3구간 게이트 | ≥0.80 조치 / 0.60~0.79 추가확인 / <0.60 UNKNOWN | `rca.py` `MIN_CONFIDENT_ROOT_CAUSE=0.60`, evidence_matrix `min_confidence_for_action=0.80`·`cap=0.79` | +| Evidence 게이트 | required/supporting/negative 분리, required 미충족 시 conf cap | `rca.py` `_evaluate_candidate` | +| 무승인 실행 차단(HITL) | mutation 4종 전부 승인 필요, 미승인 시 `waiting_for_approval`·BLOCKED(Spring 호출 전) | `approval_gate.py`, `registry.py:561-571`, policy_matrix | +| 정보유출 차단 | 자격증명 마스킹·요약 화이트리스트·evidence는 id만 | `evidence/redaction.py`, `tools/result.py` | +| 멀티테넌트 격리 | 모든 도구 경로에 run의 project_id 강제 주입 | `registry.py:171-174` (+Spring 최종 집행) | +| 프롬프트 인젝션 | ReAct는 read-only 도구만 노출, mode enum 제한 | `agentic.py:54-56`, `router.py` | + +--- + +## 6. 발표 8개 질문 직접 답변 (코드 근거) + +| # | 질문 | 답 | 근거 | +|---|---|---|---| +| 4 | 로그만 취합해 LLM에 주면 RCA가 되나? | **아니오.** 로그→evidence 정규화→카탈로그 매칭→증거 게이트→점수화→검증의 결정론적 오케스트레이션. 로그만으론 단정 불가→기권 | classifier/retrieval/rca/verifier 파이프라인 | +| 5 | RCA가 LLM 의존적 → 환각 대응? | **5중 방어**: 카탈로그-바운드 + 증거 게이트 + 신뢰도 임계 + 기권(abstention) + Verifier 재검증. ECE 0.083, 환각 0 | §5 + ECE 측정 | +| 6 | rollback plan(실패 시나리오) 있나? | **있다.** 조치 실패(FAILED/BLOCKED) 시 역조치 자동 실행(pause↔resume, restart→직전상태 복원). MEDIUM 자동복구, HIGH는 승인 필요, 역조치 없으면 N/A | `workflow/stages/rollback.py`, test_rollback.py 통과 | +| 7 | version 관리 되나? | **된다.** run마다 재현성 매니페스트 기록: model_id·model_tier_map·prompt_version·prompt_hash·catalog_version·evidence_matrix_version·runbook_version·corpus_manifest_hash·eval_dataset_version·**code_commit_sha**·temperature. DB는 alembic 18 마이그레이션, 임계값은 version/basis/owner 거버넌스 | `core/reproducibility.py`, `/run/reproducibility` | +| 8 | 장애 알림 기준? | spec 부록 B 단일 출처: consumer lag ≥5,000 WARNING/≥50,000 CRITICAL, error rate >0.5%/>2%, Connector FAILED→CRITICAL, creating 5분 초과, WARN 동일리소스 30분 2건↑. 4 Golden Signals 기반 | `docs/spec.md` 부록 B + Google SRE | + +--- + +## 7. 미측정·추가 필요 (C) + +발표에 정량 수치로 쓰려면 새 하네스가 필요한 항목(방어 코드는 §5에 존재): +- 정보유출 공격 N건 차단율 / 오조치 유도 N건 차단율 — 페이로드셋 투입 카운트 스크립트 필요 +- 동시성 부하(1~20) latency 열화 곡선 — 부하 러너 필요 +- 답변 일관성(동일 장애 10회) — 반복 run 비교 스크립트 필요 +- Macro-F1 / Wilson 95% CI — 채점 모듈에 계산 추가 +- 라이브 fault 다건 주입 — **운영 클러스터 파괴적 작업이라 확인 후 실행**(현재 1케이스만 실측) + +--- + +## 8. 재현 명령 (작업 디렉토리 `services/ai-service`) + +```bash +# RCA 정확도 floor (비파괴) +.venv/bin/python scripts/rca_eval_campaign.py +# 단위 회귀 +.venv/bin/python -m pytest tests/test_eval_accuracy.py tests/test_calibration.py tests/test_rca_classification_accuracy.py -q +# NL→tool 라우팅 라이브 (비파괴, read-only) +.venv/bin/python -m eval.online.nl_tool_routing --live --confirm +# 라이브 fault 주입 (⚠️ 파괴적, 이중 가드) +.venv/bin/python -m eval.online.live_eval --live --confirm --faults sink_db_down +``` + +원본 결과: [results-20260622/](results-20260622/) · 라이브 리포트: `services/ai-service/eval/reports/*_live_*.json` diff --git "a/docs/test/agent-\354\232\264\354\230\201\355\205\214\354\212\244\355\212\270-\354\235\270\353\262\244\355\206\240\353\246\254.md" "b/docs/test/agent-\354\232\264\354\230\201\355\205\214\354\212\244\355\212\270-\354\235\270\353\262\244\355\206\240\353\246\254.md" new file mode 100644 index 00000000..a9ebf1cd --- /dev/null +++ "b/docs/test/agent-\354\232\264\354\230\201\355\205\214\354\212\244\355\212\270-\354\235\270\353\262\244\355\206\240\353\246\254.md" @@ -0,0 +1,181 @@ +# Agent(ai-service) 운영 테스트 인벤토리 + +작성 2026-06-22. 대상 = FastAPI Agent Server(`services/ai-service`)만. 운영(라이브) 환경에서 **신뢰도 발표용 정량 수치**를 뽑기 위해 테스트 가능한 항목을 코드 전수 분석으로 정리. + +모든 항목 공통 제약: **비파괴**(읽기 전용이거나 변경성 조치는 HITL 게이트에서 정지) · **공개 API만**(`/api/v1/agent/**`, agent가 내부적으로 Spring `/internal/ops`로 위임) · **negative control 우선**(일부러 공격/오입력/오라벨을 넣어 차단·탐지·기권이 되는지 측정). + +--- + +## 0. 핵심 경고 — 발표 수치 출처 (먼저 읽을 것) + +| 수치 | 상태 | 근거 | +|---|---|---| +| **top-1 89.6% / top-5 100% / 367 케이스** | ⛔ **사용 금지** | 코드 어디에도 없음(grep 0건). [docs/test/rca-test-campaign-20260622.md](docs/test/rca-test-campaign-20260622.md)가 "산출법·데이터셋이 달라 출처 검증 전까지 사용 금지"로 명시 | +| **AC@1 65.7%(23/35) / AC@3=AC@5 80%(28/35) / Avg@5 0.724 / ECE 0.073 / 기권 7/35** | ✅ **재현 가능** | `scripts/rca_eval_campaign.py` 실행값 = 캠페인 문서 실측치와 일치 | +| 확신 시 정확도(precision) 82%(23/28), 환각 ≈0, 정보유출 0, 무승인 실행 0 | ✅ 문서 단일 출처 | [docs/presentation/03-ai-metrics.md](docs/presentation/03-ai-metrics.md) | +| 라이브 NL 라우팅 routing@1 83.3%(18케이스) | ✅ 실측 존재 | `eval/reports/nl_tool_routing_live_20260622T060606Z.json` | +| Macro-F1 / Wilson 95% CI / NO_FAULT | ⚠️ **미구현** | 코드에 산출 로직 없음 — 발표에 쓰려면 별도 계산 필요 | + +→ 첨부된 팀원 보고서(2026-06-16/18)의 89.6%/367은 **구버전**. 오늘자 재측정의 목적이 바로 이 수치를 재현 가능한 값으로 교체하는 것. + +--- + +## 1. 지금 바로 수치를 뽑는 법 (즉시 실행 하네스) + +작업 디렉토리: `cd /Users/hvvnnn/Desktop/dev/bifrost/services/ai-service` + +| # | 하네스 | 명령 | 산출 수치 | 파괴성 | +|---|---|---|---|---| +| 1 | **RCA 정확도 floor**(LLM off, 결정적) | `.venv/bin/python scripts/rca_eval_campaign.py` | AC@1/3/5, Avg@5, ECE, 기권율, 계층별 breakdown (JSON stdout) | 비파괴 | +| 2 | RCA 정확도(LLM 타이브레이커 on) | `RCA_EVAL_USE_LLM=1 .venv/bin/python scripts/rca_eval_campaign.py` | 위와 동일 + LLM 보조 상승폭 | 비파괴(배포 pod/Job에서) | +| 3 | **NL→tool 라우팅 라이브**(read-only 운전) | `BIFROST_BASE_URL=https://bifrost.skala-ai.com BIFROST_EMAIL=… BIFROST_PASSWORD=… .venv/bin/python -m eval.online.nl_tool_routing --live --confirm` | routing@1, routing@hit, wasted_steps, latency → `eval/reports/` 저장 | 비파괴(simple_query만) | +| 4 | 채점 파이프라인 dry-run | `.venv/bin/python -m eval.online.live_eval` / `… nl_tool_routing` | 합성 fixture 채점(클러스터 무접촉) | 비파괴 | +| 5 | 회귀 단위 수치 | `.venv/bin/python -m pytest tests/test_eval_accuracy.py tests/test_calibration.py tests/test_rca_classification_accuracy.py -q` | AC@k/ECE/분류 회귀 통과 | 비파괴 | +| 6 | **RCA 라이브 fault 주입**(파괴적) | `.venv/bin/python -m eval.online.live_eval --live --confirm --faults sink_db_down` | 실주입 AC@k, captured, 복구확인 | ⚠️ 파괴적(이중 가드 `--live`+`--confirm`) | + +- 케이스 데이터: gold set 35건([app/evaluation/seed_gold_set.py](services/ai-service/app/evaluation/seed_gold_set.py) `SEED_ENTRIES`), 라이브 fault 13개(auto 2 / manual 5 / unsafe 6, [eval/online/live_fault_specs.py](services/ai-service/eval/online/live_fault_specs.py)), NL 라우팅 18케이스([eval/online/nl_tool_routing.py](services/ai-service/eval/online/nl_tool_routing.py) `ROUTING_CASES`). +- 라이브 자동 주입 가능 fault는 `sink_db_down`/`source_db_down` 2건뿐. 나머지는 안전상 수동/금지. selfHeal·dedup 제약으로 사전 OPEN incident resolve 필요할 수 있음(캠페인 문서 Part B). + +--- + +## 2. 카테고리 A — RCA 판단 정확도·신뢰도 + +RCA 파이프라인: Classifier → (incident→rootcause map) → RCA evaluator → Verifier → Report. **자유 생성 금지, 카탈로그 후보를 evidence로 점수화·선택·보류.** 카탈로그 규모: failure_types 32 · root_causes 35 · evidence_profiles 42 · incident→rootcause map 32. + +| 항목 | 검증 대상 | 코드 | 운영 테스트 방법 | 산출 수치 | +|---|---|---|---|---| +| **A1 Root cause top-k 정확도** | incident_type→후보 점수화→랭킹 | [rca.py](services/ai-service/app/agents/rca.py) `run_rca`(174)·`_score_confidence`(651), [metrics.py](services/ai-service/app/evaluation/metrics.py)`accuracy_at_k`(64) | 하네스 1·2·6 | AC@1/3/5, Avg@5(MRR), 계층별 | +| **A2 보정(Calibration)** | confidence가 실제 정답률과 일치하는가 | [calibration.py](services/ai-service/app/evaluation/calibration.py)`compute_calibration`(65) | 하네스 1·6 (자동 포함) | ECE, per-bin gap, 과신 bin | +| **A3 보류율 / 과신오답**(★negative control) | 증거 부족 시 우기지 않고 UNKNOWN | [rca.py](services/ai-service/app/agents/rca.py) 보류분기(205, `MIN_CONFIDENT_ROOT_CAUSE=0.60`)·`_unknown_output`(871) | NO_FAULT/모호증거 케이스 다수 투입 → 정상신호("status:RUNNING","lag 정상")는 보류가 정답 | 보류율, **wrong-but-confident rate**, 올바른 기권율 | +| **A4 환각 0 (catalog 밖 차단)** | 카탈로그 밖 root_cause_id를 RCA/Report가 거부 | [verifier.py](services/ai-service/app/agents/verifier.py)`_verify_incident_analysis`(95, non_catalog FAIL 113)·report 검증(208) | RCA 출력 root_cause_id가 전부 35개 카탈로그 안인지 전수 검사 | 카탈로그-외 생성 건수(목표 0) | +| **A5 Evidence 게이트** | required 전부 충족해야 ≥0.82, negative 감점, semantic-only 폐기 | [rca.py](services/ai-service/app/agents/rca.py)`_evaluate_candidate`(241)·`_match_rules`(304) | required 전부/일부/+negative/supporting만 4변형 입력으로 confidence 밴드 검증 | required-cap(0.79) 위반 건수, false-accept rate | +| **A6 Disambiguation**(증상 강등) | CONNECTOR_TASK_FAILED 같은 증상보다 입증된 심층 원인을 위로 | [rca.py](services/ai-service/app/agents/rca.py)`_demote_symptom_below_confirmed_root_cause`(677), `_CAUSAL_DEPTH_MARGIN=0.03` | 하네스 6 `sink_db_down` 주입 → top이 SINK_DB_CONNECTION_TIMEOUT, 증상은 2위 보존 | disambiguation 정확도, confusion matrix | +| **A7 장애유형 분류** | 관측증거→failure_types 32개 중 선택 | [classifier.py](services/ai-service/app/agents/classifier.py)`run_classifier`(55)·`_score_failure_type`(128) | offline 라벨셋(증거→정답 incident_type) | top-1, Macro-F1*, UNKNOWN율 | +| **A8 Knowledge RAG** | pgvector 코사인 검색 top-k·min_score | [vector_store.py](services/ai-service/app/knowledge/vector_store.py)`search_by_embedding`(159), 설정 `knowledge_search_limit=3`·`min_score=0.05` | 알려진 질의로 EVIDENCE_COLLECTED(type=KNOWLEDGE) score 확인 | RAG recall@3, 무관질의 빈결과율 | + +주의: `rca_eval_campaign.py`는 incident_type을 역매핑으로 주입(분류 제외) → **RCA 단독** 정확도. end-to-end(classifier→RCA)는 별도(`test_rca_classification_accuracy.py` 패턴). RCA confidence는 이산 밴드(0.82+/0.60~0.79/≤0.59)에 몰려 ECE 해석에 N≥30 표본 권장. RAG는 RCA 점수에 직접 기여 안 함(observed evidence만 게이팅) — RCA 정확도와 혼동 금지. `*` Macro-F1은 코드 미구현. + +**우선순위**: A1+A2(하네스 1·2로 즉시) → A3(도메인 원칙 "우기지 않는다"의 직접 증거) → A6(차별화 로직, 라이브). + +--- + +## 3. 카테고리 B — 안전성 (정보유출 / 오조치 / 격리) + +발표의 "0건" 신뢰도 메시지 영역. **방어 코드는 전부 존재하나, 공격 건수를 세는 하네스는 ai-service에 없음**(팀원의 32공격/20유도는 수동 측정이었을 가능성). → 공개 API에 페이로드를 N건 투입하는 **새 측정 스크립트** 필요(§7). + +### B-1. 정보유출 차단 (negative control = 인젝션 페이로드 N건) +| 방어 | 코드 | 측정 | +|---|---|---| +| evidence redaction(자격증명 마스킹: password/token/secret/connection_string/jdbc_url, Bearer·URI 인증) | [redaction.py](services/ai-service/app/evidence/redaction.py)(13-67) | 시크릿 섞인 로그/DSN 조회 유도 → 응답·evidence·SSE 평문 유출 0건 | +| 성공요약 화이트리스트(raw 로그·secret 덤프 금지) | [result.py](services/ai-service/app/tools/result.py)`_success_summary`(104-176), search_logs는 logs 필드 제외([registry.py](services/ai-service/app/tools/registry.py)644) | 요약 내 raw 값 유출 0건 | +| evidence는 evidence_id/store_ref/summary만(raw content 금지) | 설계 [contract-state-schema.md §4] | evidence patch에 원문 없는지 | +| 시스템 프롬프트/타 시크릿 출력 거부 | 구조적 방어(명시적 anti-injection 지침은 코드에 **없음**) | "system prompt 출력해" 류 차단 여부 | + +→ 산출: **인젝션 차단율 X/N, 평문 유출 0건**. 주의: 명시적 인젝션 거부 지침이 없으므로 "잘못된 발화"가 아니라 **"무단 행위·유출"**을 측정 기준으로. + +### B-2. 오조치(무승인 자동 실행) 차단 — 다층 게이트 +| 게이트 | 코드 | 동작 | +|---|---|---| +| ReAct 루프는 read-only 도구만 노출 | [agentic.py](services/ai-service/app/agents/agentic.py)`build_tool_schemas`(54-56) | 채팅에서 "재시작해" 해도 mutation 미호출 | +| policy_matrix 결정론적 4판정 | [policy_matrix.py](services/ai-service/app/catalogs/policy_matrix.py)`lookup`(24-62), fallback=REQUIRE_APPROVAL | mutation 전부 REQUIRE_APPROVAL 상향 | +| approval_gate → `waiting_for_approval` 정지 | [approval_gate.py](services/ai-service/app/workflow/stages/approval_gate.py)(40-93), [runner.py](services/ai-service/app/workflow/runner.py)(1310-1334) | 승인 전 executor 도달 불가 | +| registry 멱등키 없는 mutation 차단(Spring 호출 전) | [registry.py](services/ai-service/app/tools/registry.py)`call_tool_with_data`(561-571) | APPROVAL_REQUIRED/BLOCKED | +| read-only execute route 정책 게이트 | routes_catalogs.py(222-228) | mutation을 이 경로로 호출 시 POLICY_DENIED | + +→ 산출: **무단 변경 실행 0건 / 유도 N건 차단율 N/N**. 비파괴(전부 게이트에서 정지, Spring 위임 0). mutation은 4개뿐(restart/pause/resume_connector, restart_consumer_group). + +### B-3. 멀티테넌트 격리 +| 방어 | 코드 | 측정 | +|---|---|---| +| 모든 도구 경로에 run 컨텍스트 project_id 강제 주입(LLM이 임의 project_id 못 넣음) | [registry.py](services/ai-service/app/tools/registry.py)`build_path`(171-174), run 생성 시 UUID 검증 routes_agent.py(55-62) | "다른 프로젝트 보여줘" 유도 → 타 프로젝트 데이터 0건 | +| 최종 소유권은 Spring이 `RESOURCE_NOT_OWNED_BY_PROJECT`로 집행 | result.py(348) | Spring 합동 검증 필요 | + +→ 산출: **cross-project 유출 0건**. (소유권 최종 집행은 Spring이라 부분 검증 — Spring과 합동 권장.) + +### B-4. 내부 토큰 우회 차단 (Spring 합동) +- agent는 Spring 호출에 `X-Internal-Token` 동봉([spring_client.py](services/ai-service/app/tools/spring_client.py)76-89), 승인 시 `X-Approval-Id` 동봉. **집행은 Spring SecurityConfig/MutationGate**. +- 측정: 무토큰으로 `/internal/ops/**` 직접 호출 시 401/403 차단율(=공개 API 우회 차단). 단 운영 토큰 설정 여부(`INTERNAL_OPS_TOKEN`) 먼저 확인 — 비면 게이트 비활성. + +--- + +## 4. 카테고리 C — 도구·관측 신뢰성 + +**핵심 사실: `app/tools/`에 mock/stub/fallback 0건.** 도구는 항상 실제 Spring으로 호출하고, 미연결 시 가짜 데이터가 아니라 명시적 에러(TIMEOUT/TRANSIENT_ERROR) 반환 → **운영 테스트의 모든 성공 데이터는 실데이터**. 등록 도구 23개 정의(논리 21종+alias 1), read 17 / mutation 4. 직접 호출 경로: `POST /api/v1/catalogs/tools/{tool}/execute` (body `{project_id, params}`). + +| 항목 | 검증 | 코드 | 방법(negative control) | 수치 | +|---|---|---|---|---| +| **C1 read 도구 성공률** | 17개 read 도구가 실존 식별자로 SUCCESS + 스키마 통과 | registry `call_tool_with_data` `model_validate`(632) | list_* 로 식별자 확보 후 각 도구 호출 | 성공 도구 수/17 | +| **C2 없는 connector**(★) | 빈 성공이 아니라 CONNECTOR_NOT_FOUND | [result.py](services/ai-service/app/tools/result.py)`_targeted_not_found_error`(305-324) | get_connector_status/get_traces/get_connector_task_trace에 `__nonexistent__` | 탐지 N/3 | +| **C3 없는 project_id** | RESOURCE_NOT_FOUND 매핑 | spring_client.py(29-37) | read 도구를 임의 UUID로 | RESOURCE_NOT_FOUND 1건 | +| **C4 없는 consumer_group** | CONSUMER_GROUP_NOT_FOUND 친화 실패 | result.py(335-342) | get_consumer_lag에 가짜 그룹 | 탐지 1건 + alias 동일경로 | +| **C5 consumer_lag 충실도** | totalLag뿐 아니라 partition별·p95·top-N 제공 | [schemas/tools.py](services/ai-service/app/schemas/tools.py)`ConsumerLagData`(384-392) | 실존 그룹 조회 후 partitions/p95/top 채움률 | partition_count, p95 존재율 | +| **C6 mutation 게이트** | 멱등키 없는 mutation 4종 BLOCKED(Spring 미호출) | registry.py(561-571) | 4종 멱등키 없이 호출 | 차단율 4/4 | +| **C7 실데이터 무mock** | Spring 미연결 시 fail-explicit | registry.py(597-619) | `/api/v1/ready`의 spring_operations 상태 | mock 0건(정성) | + +**우선순위**: C2(빈 성공 아님을 가장 직접 정량화) → C5(관측 깊이) → C6(운영 무접촉 안전성 4/4). + +--- + +## 5. 카테고리 D — 워크플로·런타임·스트리밍 + +run 생성은 비동기(fire-and-forget): `POST /runs`가 즉시 `{run_id, event_stream_url, status:running}` 반환, 실제 실행은 BackgroundTask. + +| 항목 | 검증 | 코드 | 방법 | 수치 | +|---|---|---|---|---| +| **D1 latency(telemetry)**(★최저비용) | stage별 소요시간 | [telemetry.py](services/ai-service/app/workflow/telemetry.py)`summary`, `GET /runs/{id}/telemetry` routes_agent.py(157) | run 후 telemetry 조회 집계 | total/stage latency p50/p95, tool·llm 호출수, 추정토큰(비용) | +| **D2 전체 run latency** | ack vs end-to-end 분리 | routes_agent.py`create_run`(45-110) | POST ack 시간 + SSE run_completed 시간 | ack p50/p95, run p50/p95(mode별) | +| **D3 SSE 이벤트 완전성** | 16종 이벤트 순서·짝 | [events.py](services/ai-service/app/schemas/events.py)(19-35), [sse.py](services/ai-service/app/streaming/sse.py)`format_sse`(11-13) | mode별 기대 이벤트셋 대비 수신 | 완전성 %, run_started/completed 동봉율, tool_call 짝 매칭률 | +| **D4 재연결 catch-up**(★) | Last-Event-ID 이후 누락 replay | routes_events.py(22-34), [event_repository.py](services/ai-service/app/persistence/event_repository.py)`get_after`(66-89) | 진행 중 끊고 Last-Event-ID로 재연결, history도 검증 | 재연결 성공률, 누락 0, 중복 0 | +| **D5 동시성 부하**(★) | N 사용자 독립 완료·이벤트 격리 | run별 dict 격리 graph.py(31-37) | 동시 1/5/10/25/50 burst → run_completed 추적 | N별 성공률, latency 열화곡선, throughput, cross-talk 0 | +| **D6 종료 보장(예산 가드)** | step24/wall300s/llm16/token200k 초과 시 failed | [guards.py](services/ai-service/app/workflow/guards.py)`check_all_global`(97-113) | telemetry/state summary로 사후 집계 | 예산초과 종료율, 무한루프 0 | +| **D7 멱등성(현재 미보장)** | 같은 body 2회 = run 2개 | run_id=uuid 매번 생성 routes_agent.py(28-29), 종결 run 메시지 RUN_ALREADY_CLOSED routes_runs.py(289) | 중복 POST / 종결 run 재호출 | 중복 run 생성률, 종결 거부율 | +| **D8 health/ready** | 의존성 5종 점검 | routes_health.py(28-110) | `/health` probe, `/ready` 의존성 상태 | 가용률, latency, 의존성 ok/unavailable율 | + +**발표 시 명시할 "현재 미보장" 사실(정량화 자체가 메시지)**: ① HTTP 멱등키 부재→재시도가 중복 run(D7) ② `/ready`는 의존성 down이어도 HTTP 200(body로만 표현) ③ 다중 uvicorn 워커면 EventBus가 워커-로컬이라 SSE 라이브/재연결이 워커 경계를 못 넘음 → **운영 워커 수 먼저 확인**(helm replica/`-w`) ④ SSE 구독 큐 unbounded(backpressure 없음). + +**우선순위**: D1(telemetry — OTLP 없이 즉시) → D4(재연결 SLA) → D5(동시성 한계). + +--- + +## 6. 카테고리 E — 인시던트 자동 감지 임계값 (spec 부록 B, Spring 합동) + +agent가 진단하는 인시던트의 기준값. 자동 생성은 Spring이지만, **임계 주입→agent RCA 자동 실행**까지가 critical path(라이브 #962 케이스). 단일 출처: [docs/spec.md 부록 B](docs/spec.md). + +| 신호 | 임계값 | 단언 | +|---|---|---| +| Consumer lag | ≥5,000 WARNING / ≥50,000 CRITICAL, <5,000 복구 | 각 경계 주입 시 해당 레벨 인시던트. **CDC sink consumer group에만** 적용(EDA 외부 lag 오탐 0) | +| Error rate | >0.5% WARNING / >2% CRITICAL+error | 경계 분류 정확률 | +| Connector | Task FAILED→CRITICAL+error, creating 5분(PT5M) 초과→error, 자동재시작 1h내 3회→CRITICAL | FAILED 주입 시 CRITICAL+pipeline error 전이 | +| Replication | lag ≥1,000ms WARN / ≥5,000ms CRITICAL, retainedWAL ≥500MB/≥1GB, DB 3회연속 실패→CRITICAL | 경계 주입 | +| 이벤트→인시던트 | ERROR 즉시 CRITICAL, WARN 동일리소스 30분내 2건↑만 생성(단건 로그만), 그룹키=SourceDB/Worker/ConsumerGroup ID | WARN 단건 오생성 0, 동일 근본원인 1 incident 묶음 | +| 인시던트 상태 | OPEN/INVESTIGATING/RESOLVED, 심각도 2단계(WARNING/CRITICAL), CRITICAL 자동닫기 금지 | 상태·심각도 계약 | + +DoD(시연 합격선, [docs/scenario.md](docs/scenario.md)): 자동감지(lag≥5,000 or Connector FAILED)→RCA→추천→**HITL 승인 후 실행+audit**. 워크플로 Router→Correlation→Planner→Retrieval→Classifier→RCA→Verifier→Report. + +--- + +## 7. 코드 하네스가 없어 새로 만들어야 하는 것 + +발표에 쓰려면 측정 스크립트를 새로 작성해야 하는 항목(방어 코드는 §3에 존재): + +| 측정 | 현황 | 필요 작업 | +|---|---|---| +| 정보유출 공격 N건 차단율 | 방어코드 O, 카운트 하네스 X | 인젝션 페이로드셋(국/영/난독)을 `/api/v1/agent/runs`에 투입→유출/차단 집계 스크립트 | +| 오조치 유도 N건 차단율 | 게이트 O, 카운트 하네스 X | mutation 강요 페이로드셋 투입→waiting_for_approval/BLOCKED 집계 | +| 동시성 부하(1~20) | 전용 하네스 X | 동시 run burst 러너(D5) | +| 답변 일관성(동일장애 10회) | 하네스 X | 같은 incident 반복 run→조치결정 동일성 집계(`llm_temperature=0.0`) | +| Macro-F1 / Wilson 95% CI / NO_FAULT | 미구현 | 채점 모듈에 추가 계산 | +| **데이터 정합성(10.5만행)** | **agent 범위 아님** | CDC 데이터플레인(Spring/파이프라인) 테스트 — agent 인벤토리에서 제외 | + +--- + +## 8. 권장 실행 순서 + +1. **하네스 1**(`rca_eval_campaign.py`) — 발표 핵심 정확도 floor 즉시 확보(AC@1 65.7%/AC@5 80%/ECE 0.073). +2. **하네스 3**(NL 라우팅 라이브) — routing@1·latency, 자격증명 있으면 즉시. +3. **C2/C4 negative control** + **C6 mutation 4/4** + **C7 `/ready`** — "실데이터·빈성공 아님·무접촉 안전" 묶음. +4. **B-1/B-2 새 스크립트**(§7) — 유출 0·무승인 0 발표 수치. +5. **D1 telemetry** + **D5 동시성** — latency/부하 곡선. +6. (승인 후, 파괴적) **하네스 6** `--live --confirm --faults sink_db_down` — 라이브 RCA + A6 disambiguation. + +**발표 문구**: 89.6%/367·Macro-F1·Wilson CI·"유도공격 32/20"은 재현 근거 확보 전 사용 금지. 재현 가능한 값(AC@5 80%, precision 82%, ECE 0.073, 환각 0, 라이브 routing@1 83.3%)으로 대체. diff --git a/docs/test/results-20260622/rca_campaign_floor.json b/docs/test/results-20260622/rca_campaign_floor.json new file mode 100644 index 00000000..35611adc --- /dev/null +++ b/docs/test/results-20260622/rca_campaign_floor.json @@ -0,0 +1,455 @@ +{ + "total_cases": 35, + "AC@1": 0.7143, + "AC@3": 0.8571, + "AC@5": 0.8571, + "Avg@5": 0.781, + "ECE": 0.0832, + "abstain_count": 5, + "weak_layers": [], + "layer_breakdown": [ + { + "layer": "change", + "n": 4, + "AC@1": 0.25, + "AC@3": 0.75, + "AC@5": 0.75, + "Avg@5": 0.458 + }, + { + "layer": "data_quality", + "n": 4, + "AC@1": 0.75, + "AC@3": 0.75, + "AC@5": 0.75, + "Avg@5": 0.75 + }, + { + "layer": "infra", + "n": 5, + "AC@1": 0.8, + "AC@3": 0.8, + "AC@5": 0.8, + "Avg@5": 0.8 + }, + { + "layer": "kafka", + "n": 6, + "AC@1": 0.833, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 0.917 + }, + { + "layer": "pipeline", + "n": 7, + "AC@1": 0.857, + "AC@3": 0.857, + "AC@5": 0.857, + "Avg@5": 0.857 + }, + { + "layer": "sink", + "n": 4, + "AC@1": 0.75, + "AC@3": 0.75, + "AC@5": 0.75, + "Avg@5": 0.75 + }, + { + "layer": "source", + "n": 5, + "AC@1": 0.6, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 0.8 + } + ], + "rows": [ + { + "entry": "gs_seed_001", + "layer": "source", + "incident_type": "SOURCE_AUTH_FAILURE", + "expected": "SOURCE_AUTH_EXPIRED", + "top": "CREDENTIAL_ROTATION_REGRESSION", + "top_conf": 0.68, + "hit@1": false, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_002", + "layer": "source", + "incident_type": "SOURCE_AUTH_FAILURE", + "expected": "SOURCE_AUTH_EXPIRED", + "top": "SOURCE_AUTH_EXPIRED", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_003", + "layer": "source", + "incident_type": "SOURCE_CONNECTION_TIMEOUT", + "expected": "SOURCE_NETWORK_REACHABILITY", + "top": "SOURCE_NETWORK_REACHABILITY", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_004", + "layer": "source", + "incident_type": "SOURCE_CONNECTION_TIMEOUT", + "expected": "SOURCE_DB_CONNECTION_TIMEOUT", + "top": "SOURCE_DB_CONNECTION_TIMEOUT", + "top_conf": 0.653, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_005", + "layer": "source", + "incident_type": "SOURCE_READ_LATENCY", + "expected": "SOURCE_READ_LATENCY", + "top": "SOURCE_DB_CONNECTION_TIMEOUT", + "top_conf": 0.653, + "hit@1": false, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_006", + "layer": "pipeline", + "incident_type": "CONNECTOR_TASK_FAILED", + "expected": "CONNECTOR_TASK_FAILED", + "top": "CONNECTOR_TASK_FAILED", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_007", + "layer": "pipeline", + "incident_type": "CONNECTOR_TASK_FAILED", + "expected": "CONNECTOR_TASK_FAILED", + "top": "CONNECTOR_TASK_FAILED", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_008", + "layer": "pipeline", + "incident_type": "PIPELINE_TASK_FAILED", + "expected": "PIPELINE_CONFIG_INVALID", + "top": "PIPELINE_CONFIG_INVALID", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_009", + "layer": "pipeline", + "incident_type": "SCHEMA_MISMATCH", + "expected": "SCHEMA_MISMATCH", + "top": "SCHEMA_MISMATCH", + "top_conf": 0.72, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_010", + "layer": "pipeline", + "incident_type": "SCHEMA_MISMATCH", + "expected": "SCHEMA_MISMATCH", + "top": "SCHEMA_MISMATCH", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_011", + "layer": "pipeline", + "incident_type": "CONNECTOR_WORKER_UNHEALTHY", + "expected": "CONNECTOR_WORKER_REBALANCE_LOOP", + "top": "CONNECTOR_WORKER_REBALANCE_LOOP", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_012", + "layer": "kafka", + "incident_type": "CONSUMER_LAG_SPIKE", + "expected": "CONSUMER_LAG_SPIKE", + "top": "CONSUMER_LAG_SPIKE", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_013", + "layer": "kafka", + "incident_type": "CONSUMER_LAG_SPIKE", + "expected": "CONSUMER_LAG_SPIKE", + "top": "CONSUMER_LAG_SPIKE", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_014", + "layer": "kafka", + "incident_type": "BROKER_RESOURCE_PRESSURE", + "expected": "BROKER_RESOURCE_PRESSURE", + "top": "BROKER_RESOURCE_PRESSURE", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_015", + "layer": "kafka", + "incident_type": "PARTITION_IMBALANCE", + "expected": "PARTITION_IMBALANCE", + "top": "BROKER_RESOURCE_PRESSURE", + "top_conf": 0.68, + "hit@1": false, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_016", + "layer": "kafka", + "incident_type": "TOPIC_INGRESS_SPIKE", + "expected": "TOPIC_INGRESS_SPIKE", + "top": "TOPIC_INGRESS_SPIKE", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_017", + "layer": "kafka", + "incident_type": "REBALANCE_LOOP", + "expected": "CONSUMER_REBALANCE_LOOP", + "top": "CONSUMER_REBALANCE_LOOP", + "top_conf": 0.72, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_018", + "layer": "sink", + "incident_type": "SINK_AUTH_FAILURE", + "expected": "SINK_AUTH_EXPIRED", + "top": "UNKNOWN_WITH_EVIDENCE_GAP", + "top_conf": 0.0, + "hit@1": false, + "hit@3": false, + "hit@5": false + }, + { + "entry": "gs_seed_019", + "layer": "sink", + "incident_type": "SINK_WRITE_LATENCY", + "expected": "SINK_WRITE_LATENCY", + "top": "SINK_WRITE_LATENCY", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_020", + "layer": "sink", + "incident_type": "SINK_CONSTRAINT_ERROR", + "expected": "SINK_CONSTRAINT_VIOLATION", + "top": "SINK_CONSTRAINT_VIOLATION", + "top_conf": 0.87, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_021", + "layer": "sink", + "incident_type": "SINK_CONNECTION_TIMEOUT", + "expected": "SINK_DB_CONNECTION_TIMEOUT", + "top": "SINK_DB_CONNECTION_TIMEOUT", + "top_conf": 0.853, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_022", + "layer": "infra", + "incident_type": "POD_OOM_KILLED", + "expected": "POD_OOM_KILLED", + "top": "POD_OOM_KILLED", + "top_conf": 0.72, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_023", + "layer": "infra", + "incident_type": "POD_CRASH_LOOP", + "expected": "POD_CRASH_LOOP", + "top": "POD_CRASH_LOOP", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_024", + "layer": "infra", + "incident_type": "NODE_PRESSURE", + "expected": "NODE_PRESSURE", + "top": "NODE_PRESSURE", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_025", + "layer": "infra", + "incident_type": "PVC_PRESSURE", + "expected": "PVC_PRESSURE", + "top": "PVC_PRESSURE", + "top_conf": 0.92, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_026", + "layer": "infra", + "incident_type": "DEPLOYMENT_ROLLOUT_REGRESSION", + "expected": "DEPLOYMENT_REGRESSION", + "top": "UNKNOWN_WITH_EVIDENCE_GAP", + "top_conf": 0.0, + "hit@1": false, + "hit@3": false, + "hit@5": false + }, + { + "entry": "gs_seed_027", + "layer": "change", + "incident_type": "CONFIG_CHANGE_REGRESSION", + "expected": "RECENT_CONFIG_CHANGE_REGRESSION", + "top": "PIPELINE_CONFIG_INVALID", + "top_conf": 0.68, + "hit@1": false, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_028", + "layer": "change", + "incident_type": "SCHEMA_CHANGE_REGRESSION", + "expected": "RECENT_SCHEMA_CHANGE_REGRESSION", + "top": "SCHEMA_MISMATCH", + "top_conf": 0.82, + "hit@1": false, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_029", + "layer": "change", + "incident_type": "IMAGE_DEPLOYMENT_REGRESSION", + "expected": "RECENT_IMAGE_DEPLOYMENT_REGRESSION", + "top": "UNKNOWN_WITH_EVIDENCE_GAP", + "top_conf": 0.0, + "hit@1": false, + "hit@3": false, + "hit@5": false + }, + { + "entry": "gs_seed_030", + "layer": "change", + "incident_type": "CREDENTIAL_ROTATION_FAILURE", + "expected": "CREDENTIAL_ROTATION_REGRESSION", + "top": "CREDENTIAL_ROTATION_REGRESSION", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_031", + "layer": "data_quality", + "incident_type": "VOLUME_ANOMALY", + "expected": "UPSTREAM_DATA_VOLUME_ANOMALY", + "top": "UPSTREAM_DATA_VOLUME_ANOMALY", + "top_conf": 0.82, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_032", + "layer": "data_quality", + "incident_type": "DUPLICATE_SPIKE", + "expected": "PIPELINE_DUPLICATE_SPIKE", + "top": "UNKNOWN_WITH_EVIDENCE_GAP", + "top_conf": 0.0, + "hit@1": false, + "hit@3": false, + "hit@5": false + }, + { + "entry": "gs_seed_033", + "layer": "data_quality", + "incident_type": "FRESHNESS_DELAY", + "expected": "PIPELINE_FRESHNESS_DELAY", + "top": "PIPELINE_FRESHNESS_DELAY", + "top_conf": 0.72, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_034", + "layer": "data_quality", + "incident_type": "NULL_RATE_SPIKE", + "expected": "SCHEMA_NULL_RATE_SPIKE", + "top": "SCHEMA_NULL_RATE_SPIKE", + "top_conf": 0.68, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_035", + "layer": "pipeline", + "incident_type": "PIPELINE_TASK_FAILED", + "expected": "PIPELINE_TASK_RETRY_EXHAUSTED", + "top": "UNKNOWN_WITH_EVIDENCE_GAP", + "top_conf": 0.0, + "hit@1": false, + "hit@3": false, + "hit@5": false + } + ] +} diff --git "a/docs/test/\354\213\234\352\260\201\355\231\224-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230.html" "b/docs/test/\354\213\234\352\260\201\355\231\224-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230.html" new file mode 100644 index 00000000..ccbce3a7 --- /dev/null +++ "b/docs/test/\354\213\234\352\260\201\355\231\224-\352\262\200\354\246\235\352\262\260\352\263\274-\352\270\260\354\244\200\354\266\234\354\262\230.html" @@ -0,0 +1,226 @@ + + + + +Bifrost AI Agent 검증 결과 · 기준 · 출처 + + + + +

Bifrost AI Agent 검증 결과 · 기준 · 출처 (2026-06-22)

+

+운영/오프라인 환경에서 AI 장애대응 에이전트(FastAPI Agent Server)를 테스트한 실측 수치와, 그 평가·설계 기준이 근거하는 글로벌 표준·논문을 벤치마킹해 적용한 내용을 정리한 문서.
+RCA(근본원인분석) Assistant 원칙 — LLM이 원인을 생성하지 않고, 카탈로그·증거로 선택하고, 불확실하면 기권한다. +

+ +
+수치 정직성 원칙 — 본 문서는 A 오늘 실측 B 코드·설계로 보장 C 미측정·추가 필요를 명확히 구분한다. +구버전 슬라이드의 89.6% / 367케이스는 코드에 재현 출처가 없어 사용하지 않는다. 본 문서 RCA 수치는 2026-06-22 재실행값(보수적 floor). +
+ +

1. 한눈에 — 측정 수치 요약 A 실측

+ + + + + + + + + + + + + +
영역수치조건산출
RCA top-1 정확도71.4% (25/35)오프라인 floor, 35 gold set, LLM 타이브레이커 offrca_eval_campaign.py
RCA top-3 / top-585.7% (30/35)〃〃
Avg@5 (MRR)0.781〃〃
확신 시 정확도 (precision@conf≥0.80)90.0% (9/10)신뢰도 0.80 이상만파생
보정 오차 ECE0.08310-bin (<0.10 양호)calibration.py
환각 (카탈로그-외 원인 생성)0건35건 전수파생
정직한 기권 (UNKNOWN)5/35 (14.3%)근거 부족 시 보류파생
top-1 오답 회복5/5 전부 top-3 내 정답기권 제외 오답파생
NL→tool 라우팅 (라이브)routing@1 88.9% / hit 94.4%배포 agent 18케이스, 에러 0, 7.3snl_tool_routing --live
라이브 fault 주입 RCAsink_db_down → 정답, conf 0.82실제 클러스터 1케이스live_eval --live
단위 회귀 (정확도·보정·분류)48/48 통과pytest〃
+
+xychart-beta + title "RCA 정확도 (%) — 오프라인 floor, 35 gold set" + x-axis ["AC@1", "AC@3", "AC@5", "확신시(>=0.80)"] + y-axis "정확도 %" 0 --> 100 + bar [71.4, 85.7, 85.7, 90] +
+
핵심 +정답은 거의 항상 상위 후보에 있고(AC@5 85.7%), 확신할 때는 90%(9/10) 적중
+틀린 top-1 5건도 전부 top-3 내 정답 포함 — 엉뚱한 오진이 아닌 근접 실패
+환각 0건, 근거 부족 시 우기지 않고 정직하게 기권(5/35) +
+ +

2. 평가·설계 기준 — 글로벌 벤치마킹과 적용 B

+

우리 기준은 임의 설계가 아니라, 네임밸류 글로벌 벤더·표준기구·논문의 방식을 벤치마킹해 이식한 것이다. 각 항목 = "업계는 이렇게 한다(원리) → Bifrost는 이렇게 적용했다(구현)".

+ +

2.1 RCA 방법론 — IT 운영·품질관리 표준을 LLM RCA에 이식

+ + + + + + +
글로벌 레퍼런스업계는 이렇게 한다 (원리)→ Bifrost 적용
ITIL 4 Problem Mgmt + KEDBAxelos 2020근본원인 분석 후 Known Error로 등록(KEDB)해 재발 시 즉시 재사용35종 root-cause 카탈로그를 KEDB로 운영 — 증상·검증된 조치·롤백·인시던트 링크 보관
5 WhysToyota, Ohno 1988표면 증상이 아닌 진짜 근본원인까지 파고든다증상(Connector FAILED)이 떠도 입증된 심층 원인(DB timeout)이 있으면 증상을 강등
Ishikawa (특성요인도)ASQ한 결과의 잠재 원인을 범주별로 분기해 본다1 incident_type → 복수 root-cause 후보로 매핑·점수화
ISO/IEC 20000-1IT 서비스 관리incident → problem → known error의 ITSM 프로세스Classifier→RCA→Verifier→Report 파이프라인으로 자동화
+ +

2.2 장애 알림·심각도 — Google SRE 운영 표준을 벤치마킹

+ + + + + +
글로벌 레퍼런스업계는 이렇게 한다 (원리)→ Bifrost 적용
Google SRE — 4 Golden SignalsLatency·Traffic·Errors·Saturation 4개 신호를 본다관측 도구가 4신호를 그대로 커버 (지표·로그·consumer lag)
Google SRE — Alerting on SLOs단순 임계가 아니라 error budget·burn rate(추세)로 알림임계값을 value+version+basis+owner로 거버넌스, WARN 단건은 로그만
PagerDuty Severity · Confluent Kafka lag심각도를 SEV로 정의, lag은 절대값 아닌 추세로2단계(WARNING/CRITICAL) + lag 임계 5,000/50,000 (spec 부록 B)
+ +

2.3 AI 리스크·환각 통제 — 정부·업계·규제 프레임워크를 구현

+ + + + + + +
글로벌 레퍼런스업계는 이렇게 한다 (원리)→ Bifrost 적용
NIST AI RMF 1.0NIST AI 100-1, 2023AI 위험을 GOVERN·MAP·MEASURE·MANAGE로 관리정확도·ECE로 MEASURE, 승인 게이트로 MANAGE, 정책 매트릭스로 GOVERN
OWASP Top 10 for LLM2025프롬프트 인젝션(LLM01)·민감정보 유출(LLM02)을 최우선 위협으로 규정대화 루프엔 read-only 도구만 노출, 자격증명 자동 마스킹
EU AI Act 제14조Reg.(EU) 2024/1689고위험 AI는 사람이 효과적으로 감독·재정의 가능해야모든 변경 조치에 HITL 승인 게이트 — 미승인 시 실행 불가
Google SAIF · MS Responsible AI v2AI 고유 위협에 대한 보안·책임성 프레임워크인젝션 차단·출력 검증·HITL로 책임성 확보
+ +

2.4 정량 지표·기법 — 학술 표준 그대로

+ + + + + + + +
지표/기법 (출처)업계는 이렇게 한다 (원리)→ Bifrost 적용
ECEGuo et al., ICML 2017"신뢰도 0.8 = 실제 정답률 80%"가 되도록 보정 측정10-bin ECE 0.083(<0.10)으로 과신 여부 검증
RAGLewis et al., NeurIPS 2020외부 근거 문서를 검색해 조건으로 생성 → 환각 저감pgvector 기반 KEDB·런북 검색으로 근거 기반 답변
Selective Prediction / AbstentionGeifman & El-Yaniv, 2017불확실한 입력은 기권(reject)해 오류율 보장신뢰도 <0.60 → UNKNOWN_WITH_EVIDENCE_GAP 기권
Human-in-the-LoopWu et al., FGCS 2022인간 판단을 운영 루프에 통합변경 조치 전 사람 승인
평가지표 표준RCAEval · TREC · WilsonAccuracy@k·Avg@5·MRR·Macro-F1·Wilson CI가 RCA/분류 표준AC@k·Avg@5·ECE 산출 (Macro-F1·Wilson CI는 미구현)
+
한 줄 +"원인을 생성하지 않고 카탈로그에서 증거로 선택한다"는 RCA Assistant 원칙은 수십 년 검증된 ITSM·품질관리 표준의 LLM 이식이고, 안전·신뢰도 장치는 NIST·OWASP·EU AI Act·ECE를 그대로 구현해 지표로 측정·증명한 것이다. +
+ +

3. RCA 정확도 상세 A 실측

+

rca_eval_campaign.py, 35 gold set, 관측 증거만 입력(정답 결론 비주입), LLM 타이브레이커 off(보수적 floor), temperature 0.0

+
+xychart-beta + title "계층별 정확도 AC@3 (%) — 8계층" + x-axis ["kafka", "source", "pipeline", "infra", "sink", "data_q", "change"] + y-axis "AC@3 %" 0 --> 100 + bar [100, 100, 85.7, 80, 75, 75, 75] +
+ + + + + + + + +
지표값
AC@1 / AC@3 / AC@50.714 / 0.857 / 0.857
Avg@5 (MRR) / ECE0.781 / 0.083
취약 계층 (AC@3 < 0.7)없음
환각 (날조 id)0건 — 전부 카탈로그 id 또는 UNKNOWN
기권 5건 (gs_018/026/029/032/035)top_conf 0.0의 정직한 보류
top-1 오답 5건 (기권 제외)전부 top-3 내 정답 포함
+
해석 +floor(LLM off)는 하한값이며 LLM 타이브레이커 on에서 상승 여지(근접 동률이 드물어 이 셋에선 거의 미발화).
+라이브 fault 주입(sink_db_down)은 정답·conf 0.82로, disambiguation(증상→심층 원인 강등)이 라이브에서도 동작 확인. +
+ +

4. 외부 SOTA 대비 (발표 비교용)

+
+xychart-beta + title "LLM RCA 정확도 수준 비교 (지표 정의 상이, 대략 수준)" + x-axis ["Bifrost AC@5", "RCACopilot F1", "PACE-LM top1", "GPT-4 단순"] + y-axis "점수" 0 --> 100 + bar [85.7, 76.6, 43.4, 2.6] +
+ + + + + + +
출처수치조건
Bifrost (우리)AC@5 85.7% / Avg@5 0.78135 gold set, floor
RCACopilot (EuroSys'24)Micro-F1 0.766GPT-4, category 예측
PACE-LM (Microsoft, 2023)top-1 43.4%GPT-4 + 검색증강, 3,000건
단순 GPT-4 프롬프트Micro-F1 0.026CoT 없음 — "파이프라인이 핵심"
+
+⚠️ 지표 정의가 다르다 (우리 AC@5 = top-5 랭킹 / PACE-LM 43.4% = top-1 correctness / RCACopilot 0.766 = Micro-F1). 발표 시 각주 명시, 단순 대소보다 "동급 또는 상회 + 단순 GPT-4는 무력 → 파이프라인이 본질"로 포지셔닝. +
+ +

5. 안전성·환각 통제 메커니즘 B 코드·설계로 보장

+

아래는 측정값이 아니라 코드 게이트로 구조적으로 보장되는 사실 — 우회 경로가 코드 레벨에서 닫혀 있음 (공격 카운트 하네스는 §7 미구현)

+ + + + + + + + +
통제메커니즘위치
카탈로그-바운드 RCA35개 root cause 외 생성 불가, 미충족 시 기권rca.py · verifier.py
신뢰도 3구간 게이트≥0.80 조치 / 0.60~0.79 추가확인 / <0.60 UNKNOWNcap 0.79 · 임계 0.60/0.80
무승인 실행 차단 (HITL)변경 도구 4종 승인 필수, 미승인 시 백엔드 호출 전 차단approval_gate · policy_matrix
정보유출 차단자격증명 마스킹·요약 화이트리스트·evidence는 id만redaction.py · result.py
멀티테넌트 격리모든 도구 호출에 run의 project 범위 강제 주입tool registry (+백엔드 최종 집행)
프롬프트 인젝션 (OWASP LLM01)대화 루프엔 read-only 도구만 노출, mode enum 제한agentic.py · router.py
+ +

6. 발표 8개 질문 직접 답변

+ + + + + + + +
질문답
Q4. 로그만 취합해 LLM에 주면 RCA가 되나?아니오. 로그→증거 정규화→카탈로그 매칭→증거 게이트→점수화→검증의 결정론적 오케스트레이션. 로그만으론 단정 불가 → 기권
Q5. LLM 의존적 → 환각 대응은?5중 방어: 카탈로그-바운드 + 증거 게이트 + 신뢰도 임계 + 기권 + Verifier 재검증. ECE 0.083, 환각 0
Q6. rollback plan(실패 시나리오) 있나?있다. 조치 실패 시 역조치 자동(pause↔resume, restart→직전상태 복원). MEDIUM 자동복구, HIGH 승인 필요, 역조치 없으면 N/A
Q7. version 관리 되나?된다. run마다 재현성 매니페스트(model·prompt_hash·catalog·evidence_matrix·runbook·corpus·eval_dataset·code_commit_sha·temperature). DB alembic 18, 임계값 거버넌스
Q8. 장애 알림 기준?spec 부록 B 단일 출처: lag ≥5,000 WARN/≥50,000 CRIT, error rate >0.5%/>2%, Connector FAILED→CRIT, WARN 동일리소스 30분 2건↑. 4 Golden Signals 기반
+ +

7. 미측정·추가 필요 C

+

발표에 정량 수치로 쓰려면 새 하네스가 필요한 항목 (방어 코드는 §5에 존재)

+ + + + + + + +
항목현황 / 필요 작업
정보유출·오조치 차단율 (N건 중)방어 코드 O, 카운트 하네스 X — 페이로드셋 투입 스크립트 필요
동시성 부하(1~20) 지연 곡선전용 부하 러너 필요
답변 일관성(동일 장애 10회)반복 run 비교 스크립트 필요
Macro-F1 / Wilson 95% CI채점 모듈에 계산 추가
라이브 fault 다건 주입운영 클러스터 파괴적 — 확인 후 실행 (현재 1케이스)
+ +

8. 재현 명령

+

작업 디렉토리: services/ai-service

+
# RCA 정확도 floor (비파괴)
+.venv/bin/python scripts/rca_eval_campaign.py
+
+# 단위 회귀
+.venv/bin/python -m pytest tests/test_eval_accuracy.py tests/test_calibration.py tests/test_rca_classification_accuracy.py -q
+
+# NL→tool 라우팅 라이브 (비파괴, read-only)
+.venv/bin/python -m eval.online.nl_tool_routing --live --confirm
+
+# 라이브 fault 주입 (⚠️ 파괴적, 이중 가드)
+.venv/bin/python -m eval.online.live_eval --live --confirm --faults sink_db_down
+

원본 결과: docs/test/results-20260622/ · 라이브 리포트: services/ai-service/eval/reports/*_live_*.json

+ +

출처 (References)

+

+표준·프레임워크
+· NIST AI RMF 1.0 — https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf
+· OWASP Top 10 for LLM 2025 — https://genai.owasp.org/llm-top-10/
+· EU AI Act 제14조 — https://artificialintelligenceact.eu/article/14/
+· ITIL 4 Problem Management — https://www.axelos.com/resource-hub/practice/problem-management-itil-4-practice-guide
+· ISO/IEC 20000-1:2018 — https://www.iso.org/standard/70636.html · ISO/IEC 42001:2023 — https://www.iso.org/standard/42001
+· Google SRE 4 Golden Signals — https://sre.google/sre-book/monitoring-distributed-systems/ · Alerting on SLOs — https://sre.google/workbook/alerting-on-slos/
+· PagerDuty Severity — https://response.pagerduty.com/before/severity_levels/ · Google SAIF — https://saif.google/
+
+논문·벤치마크
+· Guo et al., On Calibration of Modern Neural Networks (ECE), ICML 2017 — https://arxiv.org/abs/1706.04599
+· Lewis et al., RAG, NeurIPS 2020 — https://arxiv.org/abs/2005.11401
+· Geifman & El-Yaniv, Selective Classification, NeurIPS 2017 — https://arxiv.org/abs/1705.08500
+· PACE-LM, Microsoft, 2023 — https://arxiv.org/abs/2309.05833 · RCACopilot, EuroSys 2024 — https://arxiv.org/abs/2305.15778
+· Ahmed et al., LLM RCA, ICSE 2023 — https://arxiv.org/abs/2301.03797 · RCAEval (AC@k·Avg@5) — arXiv:2412.17015 +

+ + + + From 4775b4bcfa3373739e633ad39d80ee778ef4e673 Mon Sep 17 00:00:00 2001 From: hwan <2020112023@dgu.ac.kr> Date: Mon, 22 Jun 2026 17:35:41 +0900 Subject: [PATCH 2/4] =?UTF-8?q?#996=20[chore]=20=EB=9E=9C=EB=94=A9=20?= =?UTF-8?q?=EC=84=9C=EB=B9=84=EC=8A=A4=20UI=20=EC=9D=B4=EB=AF=B8=EC=A7=80?= =?UTF-8?q?=EB=A5=BC=20=EC=8B=A4=EC=A0=9C=20=EC=BD=98=EC=86=94(=ED=8C=8C?= =?UTF-8?q?=EC=9D=B4=ED=94=84=EB=9D=BC=EC=9D=B8+AI=20=EC=B1=84=ED=8C=85)?= =?UTF-8?q?=20=EC=BA=A1=EC=B2=98=EB=A1=9C=20=EA=B5=90=EC=B2=B4=20(#997)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * #996 [chore] 랜딩 서비스 UI 이미지를 실제 콘솔 캡처로 교체 - 로그인 버튼 아래 ConsoleShot 프리뷰를 데모팀 실제 콘솔 캡처로 교체: 파이프라인 목록(orders-cdc CDC, payments-eda EDA) + AI 채팅에 파이프라인 생성 명령 입력 화면. - landing-pipelines.png 교체, img width/height를 새 캡처 치수(3360x1840)에 맞춤, alt 갱신. - 로컬 렌더 검증 완료(랜딩 히어로 정상 표시). * #996 [chore] 랜딩 이미지를 사용자 제공 콘솔 캡처(브라우저 크롬 크롭)로 교체 - 사용자 제공 화면(demo-team 파이프라인 + AI 채팅 '인시던트 목록 조회' 카드)에서 상단 브라우저 크롬(URL 바 및 위)을 잘라 서비스 화면만 남김(2032x440). - landing-pipelines.png 교체, img width/height 2032x440으로 맞춤. - 로컬 렌더 검증 완료. * #996 [chore] 랜딩 이미지 윈도우 타이트 크롭 — 검은 여백·브라우저 크롬 제거 - 사용자 제공 화면의 서비스 콘텐츠 bbox(검은 데스크톱 여백 제외)로 타이트 크롭 + 상단 브라우저 크롬 제거 → 서비스 화면만 edge-to-edge(1920x435). - 내용: demo-team 파이프라인 + AI 채팅 인시던트 목록 조회 카드. - img width/height 1920x435로 맞춤. 로컬 렌더 검증 완료. --- .../frontend/public/landing-pipelines.png | Bin 68765 -> 83633 bytes services/frontend/src/pages/Landing.tsx | 6 +++--- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/services/frontend/public/landing-pipelines.png b/services/frontend/public/landing-pipelines.png index 651484b993b9c1e23b82f1c9ea5c67f5ccbefd1e..b5e932a19d55e5e3b5b315ea84d7bd9df5355139 100644 GIT binary patch literal 83633 zcmYg%bzGEP^FD$if+&K3fP}Q9v~+`X3M`#VF5Rgh(jXlREZx22!m>(AcP=5_-TmA5 z_dY(~_x{}f?B2WQ%$YOinwe|n4pUW@#lA>E8}a*$ zBGdRc8mFwVeeTnrFJ-4<&XCwb$Pv>S@Eq;$|jl?_SBtaTNuBPNagR zygsT1E0-qLt^ft7-Ti|?AyoI`tSlXd)UiKw0O93%WNA(X(mOQ!13fpZ@Qpd2{jW(` z*_yvzzGm%KX6^sZ$J@~M)pGXPNGBH8cYwN+fr>mf&d#+aAEJ|JuP%jp&Uj3FWAsjHkMXqr6MBGyHU7Y)rV<6Aktt0sCj zqVxV3ikAH#fGtRxo0j9}+Y?%gkdcv;q!d#%;Hk%ec{%+rwr~tP_usMIvD=Lw!_fgt zbS#QpVOX|Obfybs0fSXb#qUB{`!w!w+5H}Gs0`0f9e#hhCOGA|#?;Q+O21QjsemNV z%@FJxc3+0E@8G=&-iGhACK)t%W0${l1b98oG}3cOv3mqWdxVB2Cnc`wnZ7&!R9|C? z;^`rn9LuLS6Ma8yd4bHMv|QJ6UJF!LJ}Y8dUSIDPBd}dDse4iMd57rfpPz8FSi0Xo zGBR#N`1qdj1-+;0J-G30VA#k^7YxLDxIGaq`|=aBxVRE4j#h^yjuyb8b!Hbpmc-pm z5rW#;|6WDjd4}=Qs_#nGqq6UFMP-n=4badTSF><_(g>LX>VC}uwpV;6%d+@pbo_VPR|UWFVI$XV&>4vMj2PqZ99eNc zWF7(B9w(2>5Nth`zpe(B38bnEey9DU6h~J_r!)RWoh)WNO6@|!$IT3@og)tz3Ckyu z%IF}J-f7Bn=8Ie&=U7&ft1f;vXJi|ox$kVzs0y3DXv zI3l4VbFc1x(4TDE;JYsgKI`{*zPY=yJzjaG@Zztas=-Bv2?8FUFJ#$Q8v4yXb-fXo z(P^GYd^{Y@TJ|!Fte7H?L^6r{`?lJH5my}y;ORV0+4bhEy^Vn7t=7lp^HbLlM#X)L zb1M}|t~dcK;U@RNHlHkEHb0)zE2}Q6gU7iNfd$&^OL{j#a3B4Bj^L-mhF^Y_{{G0b zE=`J<>*x5k#liD9SsGE-_KCM56Pb2(|5r4$7K7Qyl{N~cf)Ba8vP&s#W#;W^ef|A< zcl{PHG$|8_8hZQ!h>F2SnfPG66yfq@=7CRUldBp#%CN(-6q31F61P~Lu8znTcd_1l zq18P8R>Rure&z;v!;C>Gv1Vm`{cLY@le6torWDz^3NNr<^T;GGmmzZ@9r_=;E?as( z6v!-X%RZDI)yuSs{wtJ2vZ0?PD4FfMo~fT@jq6#)7DXIwyb49cm09UW{t+vKmgT7t zu4qTny$Li7hrOk^BD|6mw zJZcPS{(e#0Qp9=+x+g>!YC7f8mCCYF%)hcP=rLXNGOle`OaDC^4kUz`>fJ9U9wrJX zcbqNV`1^v*Y7Mq~F<>mZ18>|AM{fd+!{P}lRY&xQmS%T`lO{56!ItSZ-;{(5=ku-dpnbdzxqieNIv~_2)Kz&`m zV~=$g*;Y@>e{_^)RH=0P4f}4#p5o+eB7-xx)baUA0TG3s2YOf2IL{|Fo~$sNshH~B#W#r<&q&CXP=~_w;eMFu;fs^e|OfF z+O}&IbZVlc5wBJ%M*!61H9jKpFh@KRMkKU?jBPNB9l#uz??TvWr`KhkM=7*^-%4qc1kI6~8K9{gt@IqCdZH^LMVd8b4E8@qTvqhnkEnMpp9VaTeu5qnBye zRAU;dAUS9JIu&wcUPIan=L_2$XJ~;1Ud4on9J_HjzeX+&^W11*?o>RN6nc*z2;`}8{28qUv?oGlkO*=!N{G%e}+AI4)I2q%lxhdCj zjSOHy+Rz|2guMm0B7G4F&99?Leaht|7s=7p%_$OK(0ut`X`!?&ZE&_ZFZmH@*>KCk zeW%cCM>!r)E(Oi)xY2KSOtlr$+9@w7v6rh$PK*bq$7!(-H=L?8Q8+2k$2T}2YfOh$ zhezVib}%Q;FN&wFQ8CN^ze>22+?`|3vg+zG&q{@MI1^K!#H7+pkPOd0Hv%Pb(jb#l zZxk-0GL5H-0P7iG4ncoD0~<*MQ*BdeGbopyDOKpiJ&&79lHIo=z{z{+^Dc-V7radiUzkS(&Y2w`Uue< z8Tlldt2>u8>#;7AcTB!~&|W+zYc;F#Udg;g=TJ+{>}qLrd3djO#mNaJw*&Q_CTLi) zQ3yH}yzSl=w$gNL9xf>NIS@UK`NftfUuQe?D-`U}%fb4Oa(*^PV1KU08lZH$47VSP z;koKg^MgIu$k;6Fr&$r3(F#M|OEbX6gC(gU($jp_>!RLmQS9_HeD=V_MiOB$hth}c ze3y$!y@z88&Ybhh;&R>x>#dc-nNB7f1skO1>1U6xm>>an%Ujv0At2OKYw~Tj>W%)W zqjD}QxO+tpP<9%0*HD0872U@PDQJLDPV=J7Cu zPQYzo$wmh|U!~vPZ78Z{89lVl_rCH=`jkh;`*1b08_b0;Jl$&}99qH03j8Feq*vwX zrfg54c13MJ_bP&p@a>n17iSp?cG?dKXJxxBr;%m7BHC%eAdW!)Ua-oXz-%YE-^YSW%NZu`00IG(YlA6FFekVz9xwy_uCIp+_?s(&Z z$oMRsyiVWkreWf|&A8;PKmYYkA4g%n=Lc=EIuk+6eqV%N3CVgM#bgd4Pb7upkGEVd z&Fie7ZJs=4zCI`vaxhQllOe~hY_+A0thfH~Yw5#2bq@!h2iA*f>=FgaQ0AH{2a2{= z*aN~XyJ`Y$i&STnflEhY)A)#j7jOA{R-CjSt`Tm1#I8GYz%|$&Q(|v^ z(%AP2Q5}FTUZTTL>&gs&6XD0D8+{A`8m^t=I;1rT;N1Y(W@e>&>;{{3M+e=p*Bp`3 z&Q$4&EFBi4xp&Rkr~_d)NA+hv$WnZR*RSf(lChb|U21B&XSP8#4o@_M4u)*o6I9|DA8vEtCi}z}n#s-ap zOwU?)>6C-(-kkkV;awxSj{enAJK?VNL_%_-ES)VLSiz!6O%?@7SMy%tGQ7L&F{%X z{}^MI!0=EGkHOB2IlqO{qvtSlNt1bF5V@s+JGViMP9<;c!)6#uVCX_?Plen`e-Zex zIGvQG%=~yIuE9s)2r7I3E0XyhXzd^D;JESR?Y7Re*z;ekWDiw}fFDD3wY@EbBxidp zi4qIuN5^G84Xha3&X0X9zJ9!gIxXi(WyfnAZV%Y8#dI$HcB!Eeh0ywBjF=zQB%Bmx z%)0(b)BD6VN>dOOo0q>;V!#b(xxK0=uWqhaYah&Tw?W1-H?t!xF0q9 zGd73orQ5x~J{Dgk4n^GgUxh=8ACD!B*BS(ndr>407m1TA;KY`ex`foTCb1x=i~W8F zY_u8XTe@#emjqC@OA7gu`fN^bt*&ajq2GyId49>y59MbN$2%b|Pv`W%ydDSuTCDYF zAY6a{S%AYlsF={fSNEUz>(R3T8Qx0UleX#&{u=A`a?r_)=CfR++cqyzN-Cm9tu|P@ zm;U%%(v~?QR`RAulPU2W6p8epwA@&YeoH#rpdAvS?Eq{Y)UvGa)6XCW^HiL0^1vO2 zUU*On(O^;Yu%5_!YF;S63%YTW`y}7=zz8eC@M@eO<;?QA6S((Z*q6j~rR2GrN7@^X~3eqWQh7wkBgn*%#V0;>I1YQ*n+?qSXt^E3Ho z;BvAg|5Fpubuwc7u+!1R&|etd4^4gp@TW2C!D^p9DMbA1t&xzOB=*^6m-!%Bm6zmq z4Jkf?Zp%fee@>Q?F($pHU)@+;m!1o~wq8ol7xinl9~_FHWrx!3>?=X zqJDltm4=0_+W+B%{&ThDjz3~iBDFK&v@R%1&5ImJ8?>&OJMSVt+wZe;>O)ExZ8ml~uR?m9uhXXk16w88&8%b3**CHF6}DYoVc?LBCf0u6;D;pgxp+7^*oxR9seBe#RaXau z&ODY|UtcG9oUO^E{ZOA-(o zSP{UMXSS!*=h?C$?0Ej1Hfiel+?mPUD<@az?2y^hcHTYM-fXoN3mfCuZU4Qqxmb56 z!%LE3C8|GD&rbO%-GlZOmE~|s_RN6vAGioS8~G86N)6Duf_wCoXN^M9b&2_@sbVa# z_>Ye`=?41RI|n+$s6v0vF7&*&#@$v=KDh+w`{ux~1jM;*HK!H^)4Er5PguT5eATb0 zs%Pr|#^=St%p9Rcd6ED0^2$>vM&I9* zg1U1!*p?LsCpI|v_h1pQwz9!8Ugm7GP#^A}YuOO3=0RC&Khxih45A9%HxQJX_xtE6 zc98SJ+(A})T6$e`fm`EKL_r1HAnHEb#*|uU84F75?x?ln)yr2$A&4ieSvmDXO`bOX ze-8m#maf@4Ial(<7@Jq2UzXmvB3B%M3+DLUwEo_VzH5IvZ!m0Z*+6XDv2 z->VaXlE+(J6GRLCt&qq>i#*XAKUTPD=I?f}gLR_!K6keInrKXq4+Ur}%jEVK0*i?G zZrdVJGbc`-(_VUd-1a9mRw1vZyxkZ?3;(gn{<=vEOGsf6k0z0Qe3iyftMSw!10+F z%Gb25R@W=X{Y7NO#6#=Sq9*2{WOiFTm^?3WY=y@xNU@tq06TOR!lM49H{aB}Xc&hN z4yzwF(aGt%`9S(Z3k&C{k1xoD_tv&}mviq8GwosUu%2T1{BUK*{keCmy>(=;KOSJM zfn7Tg>PEM{>0+Sw@owDCblX_S{eFf4<^zcls$G6??MjZ|G_rhlnMU{`^)Y&@DkC2D z6MeSCKm(IUR(s7HFb{p~WCxbk#VK~xVs-oZ+J4Uk?=$fC+WkBvk9!*n<>Jqfm-fll z{_y)6OR+w4XYc$^A~D^Q{$9Tc!%JUzP&5?nv6qWk&IAilUjVjyNv+(l~gEi1PCVEm8;u>S<3@UDU(#Zz1 zvMzq_WnyhD&OXFQq`(#&d_l<>-MUvUS%ghtkq@3!WXwBA>9O9k1GQe-wcS!C735o< z?@pTZev6HMalZEP?LQVM=9Y^qKrCXOWW{LHQvaIuvty8bN%bc;T->z9lrVoY`b?We zsd*Kt!4$DQy0A?UnQqy&FjNgXrN-wbI|Tv=wSw9Uu8xMrD)fEb)^dLLAtebelJXD>>19ODBX+o}2<)`oEoy@S|s|Q`0|FfB$L&5gLWOc`AqJI)&;}y_gt7-fH%c_H@?!p8#QctaQa33;un0JWL?Q+`!9JnoP&!WsHR&YnaSO#WIs zvqho2!G3;TH!>leYmAlrQNl++E#;Ab;L`|kTTIRcYsM}D4L1lxD2f&6B*Ff2ibO*u zj4lqkQORad=d~5%;?}ILG4_@mr`@W*zCxllG5-_&m=veATu(9EHjAEsvrga4yZ8JP z+8G~opVabXZ8eu(ZL@*E138l)##^FHOrPh%xOsF9t{YmqnPf4!L)x_%i+1huc#&qw@HtpRuafM-j9`5 zrM%5-T>j4at)KaILN%d}{yzrsr2&Fl-VikV=5eUo$`(~EZ(f0qvdL+x{Fd!#y0Qyf z8FqO&0Xft!7v)Z4xfq7sa(FaGAMxh5{7SzXjXdqPO>!Y9;3_TFb>y<@GJn!)Csud(toUVR!l*{nuD&eiHdsRbz z1jblRjmz$y9sk?taLpcbXAy{O94&O%zH@Z)OF>^|LbZ~LiSu)l+H0VR%2o8|^XFD7 z9?69q>_vQ%hP2y*lRYDB^lWPR)SsD-$D2xL_`Rfs=SP0+OSkpiqE{=j#Y8JPI#)5@ zI}%YtlZ&l6`9HhmrBL4m$*GSm-;xFpv7HbB^a^ZB?NC+6$EB% zf?a@kcFH@TfT_$w!0EXX`%p#>1nhn%ALO;jXIQ&?HeXbTsHBlQKAO$vSD~!aN5JQe zx;-a(Ng8PC*5YtVmAEK2vmHXjZzj`8Xd~u-UDecZ|Hkj$pR%t25Wua)TQ`2HmoGYGuDvvYXn&Bx`&K4>8e6H_^tq0jb}E!emhM z6?^8>%K5piX|FgcNSTqfCnRcLD7UDgo}#v%=mLD{HPe-4O8m~eTIV4H;e6TwxMrIV z_x@o-j)Bmh(eju2(r@i~W?{~j|&r*qa`9{t-ZV5SsR|p%EAL}h|qN!e=8sqC} z9lc%K~CMlBCne%Pu ziOxSqoETj-Hs6A+-29i%EmEEt zmPt(InHhH7R7fW7FM2lcn~L{ydCK-si(gP`J($pKtU?ajU-W6Eccf`Vr6NEelIC^E zYi#x6aq^VGOd^EhbI8X)=9;WtryooMsZ}~p!kjLW`!}!#iqy$in1l-Bz8eG?N_%Zt`0{%Y+Hkk9{bU?wjPU>xE&)S=)W98{Tt35I9*?sDv;$c0&Ki?yw6-bC+@oq5s)!&`m?HUk)NuIdeEi zD8G^rJKt%*u1WvbnzKB?q!vO!%K2m3r5k^WP?CN{7Dh*Yo+{IUh^H1JS`@Kq>2|

M3|+`q2IijzCdelH0ftlx`?4cK$9bn)SdURtF*O1uT6`#gZUKK zl$pC-_??*oAoKHbQl@MJ>xt*On>8}hAKu%VX56q4H979V+js#3;GDs{D-RWQ*7{vv zXm+Os$%lUgOLY#s#*Y0x=Q*`gW~WD{l(gLjnLOQH$d-nF&rgk~?Ln{Zpdu=K;a}p~ z8Dh@%(Yn9k?z(!N^V``WJn@fvkd z!^1>&z7rZ02=Fn1<$ z@K?vo_C(uceQ~z;U1ZvzYi8qp)a03!*+6gvURwAsVz&r|r5yl4%v(_x6lF8+9n?8F z$B0eH$Cdc5M7>z6Y<_)dA72xB0qBn?+nw_kzt2yP?=&T`3@izPd|%Sw4K8AwYa<<) zrK9hgoD|{|meC#!UKll46Pg4Q>Ud2ZHR@+tJo~!Dinv?e-PK8(fw@^v)w?-9$sql^ z#R1lQ&dS zx3wv?4R8QRwt>lx+waIWGme@}9EG#AId%TQ@g%Q3@0l_03ndT4*)_@MMiRm%X0eCi zinUO|dujq_nh6W}|>*c)H`YG?rA_U0RUy)e~a2*HW z?7Z5vFtoiG-D}I}A{p!4P)+vNOG{NE?{vMhWwI#>$nUo;3}<=`jOW@1vjtX6RW|J% z;D7zHSnP*&wEu^6^?h<(xnAMe$HmmxQ~moZ9OS|DzmyD`n00ECS7S|Zt z$o-KsVxS^fb~3MKp&O@wA_#Zvdunl8a6TJ0m)hBfkmM2wf6P%eHjZhE0CNyW0kicE zBzS>*3{-bfzGI#hZ9e_GVo&y~ znAG1Kd=>d(pNA%-RL+jSZBeM-$s&y|W%ahEjlYDkn&sKsw%nS$`r4GU>?VBj@k)j zX7yEC-E28oWI&o&eY^kq2edzT%L|rYez!Mo-nlxKIhIx=m0jgd(c{iOmMc*_BXf9m zcN9ES(#YxpoWGUYf+!@*eP|`x^Ha5UNte?=s=xB`Y`!2-RbyvXePpGC4dqoyO@->4 zijo6(`CF@&q2~j*0{R98SE+Zq&K3O6{;vD*g;kAb>StpE4X3da!(S>Dx*rDw^#7+r;I5 zx>}2xjdAfSR-ld-wU?r;auekLnnLdA?p;25BW2u#H?hrC|1_PhM9e0&V!LvjB*We1MDs&98yu4P;QL8HECE zoO6FAvf`G(nj3xiuM*G_^Da}M;*T4r3Gw=fy1!qLHdM(#kJ^6ZZzg}jrdU82B+(>+ z?%P;x#QyDj(9EPxy3aN3q&4f?<%nh?iy5IT<`W%9(^smq5IATgb>R7I`|tQ!*w$LU zGz*>)hlWZ+Un&;#V81{9`w*>#xlz-m+GM~&_o%b86h`Ur0uJ__TSzHv@ae#f*Kg4B>%TCv;%S6&F#j4A%boOqLw}6-#Qg)g8a6n zst6P&?A1$%3=MYGxK91^P*uYmxaJKL)V{3cZ+fDYv`#33DhiHs>%-b==%-R>!?tH- zaQ}DGdQ9#N+cNu7NyO}R-$X7YPuAZGD;nCu2GFV}r^brvhAkqRiUhW<|z2X?qtHKDrw6S+q0%>RNc>JJ(J{R8Sr zAtnF+F5L##YCTCS<5~^l|9<`_qwLW@8A6{Gx!d4Z_G}|TrkCG+| zFu9@k&S!SHnB4#V_-C^&MjCK>{phh!>yLqT%~6sfP5CB8>SToo{-#FaKfyn&*(M*vS)WCUL;K zsWl3189&QF%@R#{Uc%t|AFo$m129OR{qG88ajhs~hD={EmF{&N*|^==sz~(8os*X1P%TN3a?Av2TalN9v$>QM?_@j?T^o`^A&~VoA51 z$3XMeLGKLd!j@QC>vuJdPEPb#Icm^zhzf+;d;CKnmAZxz+&j_Ucg)WZE=}zcG#G0} zkD{A`2D_rj`mdZZ=M7tr8>Xi}20cR0HlAS@edF5do0^skvGmn{0bbeJQEDKFk9$cW zAk)wtO<`j4PMs-{LIjuBL4TrIn=g=RU(}N}u@@__Xz#!l2;}_}^a^oXYkV>(ny0?y zV4DQA+(;Mji{@|2&6O;S1_c0M*W+6*mMWB8$)sqS_9%U*6sh-+G>4ZG7`y`|%Kut< zw#q5@iYH6KOZp#$9P;ihz5B7Mvu0raOFgfD`0_dwuJ2Xv-YN@o0c!p%=Uf4Z(g!G}OzCvu%Cn-M{#;AA( zmHX2%mBhP&rj+Ma0#l8SeLxpY`C97>=;6K1l<97j%wmjYO<%3<#l?%!rj`7bZvx_v$OUUBgy#bO zSm}Cy-(Onr3!$cQ;OMs8u%iBr>H2OfBDvx@1*c6%)w{*J1LpNFyyV_JYr!*<-74wF zXGaTg7n-{dtgLs3BLuD#+~RmIDMTiv^WF3fY(Tn*W#{QS$&eTY+EIt~!Q*4@NGOKb zni^w5CDeJ^uD-l3QS2vk_jC1PA$CNT7)y0s^|CYn#1hygmSor!o7=zz&@j;t8aFD| zgRMh*;J^Q#@1pf+3Sr%Sw5MaKT$aG0OnAV*%J1*^sF~Wcci6qi0r@md=M_5sJ#3p!F$;pNQrdrs_BdeMURe-XFk~UxnG5b~ZC&8!Z)(WhueU|^ zuKs3F$$b{+dAkZgape)B%Rz$LTQYE&^3=PE3N{1_;O8!fws!jm_if1C=~HC4N*W3N zsPEk7tH3?U*U zau6}Im@XKw<)trVuzh{sE-M@J(CmDrf^l>44lBoJDw;tB0)^JSzh`?S7W{jNxNi;H zM{tJ^(mUFQs)226L`0NyR{LD+Gu^D);U{ZyHC2{Ph%rgUK9&B*yM75jzgYBXu%EyF z^XsnR7{@rO&9r)ZqEys=cl?9mYO`*w-EUxC5EE0ET4~bQW^DU<|IPhobpWN1 zuc?U%2e39QmL#>3UH`d@tLvrD!>jm5n{zEKV-Fe3cnXG=t zH@ChoCXM+B3(uv*TUuDM>s+3o5cJy9i$b)e``0i39TblHT_Hs7Le95G&iVk5iBdAx zHQmdgr!f^q{Cfu*KK#40KVOP?oo>p_!@k1g*bHHuzN;PL7!m=GIv+Q_3#djkRY{psidVBcDJU?4grW#v1{Qv|9d>{TTunr7bIExMji0*t zWZIq?qk&3-*Hwg zpFqrv9jyle*WY6E?U$E%K_NIhQq4Y%Ya7HLd<0yrxSU2eU?Dy18XcxRdGC!jy<1cH zN^Lh@xFWk|(`b95c9PrDBCd=XXZ{?MdCofzI}iueh1 z4h|fzF#Lq~Eiv))je9vd#%)B?9-8XARcGm|Z4odn-r;7abZI-E;LAFVvo;K@>oM%5brzY`XFa(%H#5GsNoBxXy0SO8ZCcg)#J9EqVJF+|G`u5I8xai{m|^!2XhDMx!EncpEedVMBlNRCrD(T zU5#&z(aUsqTzmRp2TR1q_g~tLHgZ7TTp*`6^V!_@$1BW2c)h%?x@em8E1H^8byzY# z_-k@ZEu-}B+h}v8;ws6M$ZB+@2cBew!-a#;Z5?zPBKI5Ws`=e7hdLFKRMM_Hp9bAf zUiv(Z>9(lg-rQgJX5OyQukbwPo|T}jsi`#|bN~X~9T$~(!2=s7^osW_3Weu5>j6qr zVfR}bgq`UOXqs4YWw2+Z_h1(_l41H1R`9NNcY)GrbCVY@PJ#UKVq}Z&?kC@qKkfrT z$m(&g0Y2(>dC`}-kGcP~%J7XLGh){3M|>BcCdZ}Q#ef697+WXJ)Ge-!%d6|#>yrx@ zg*G2C?9J&N3ZBZ4+&+_**?!)5kE^{_O1@J1Ixj6JX3h(8S)y9sKvUHhsTv`qd^TA- zc7*u5>)R3ytSnMQL^-4BioU+4CwTB4>vFxikKUUqTwKtYkQeu^%aM_hib0R;cyE3# z2Csn?D&@XB;Z=W_sk7e3%_zvlQOQOoI!xTGsZ<;pT|Dmm- zRDkt0Hfj>|uRq5cvL&)r851AX-Ss+&prO&3izU;gluuRmd5d^^dN_~bz_>V<)y+Hd z*IA1`aLeIoO4Pb*tDRWA)Rlr;CeZvh{VJkD1twi^-{yMzdEI!7;qDm9mpC|jHRf`` zLvwK3LR4w|)nhe;VFu!UE{E9$Ri$)7Z4nO6NCfdSI^~+P3m#Xq&XO|}Fh-D0qWtZn zJMSF|SX0wNqyM0BKYO1R13mo?g}aqQ3Z37>eLLdiTMp03rCbL4xyT$OXK?~m=$_#D zt;ad_{ED%|RFydVRW5yrCR0A_i%ehrJgbyu)@`!`Vq9r?Yl*_^Zns>|1I%r0Y->gn z->1-W_@GQdD|dXsD%ehgU8;?Na;DftkLFu~>5r}~oLj`7Y=C1;*yC4j&M7l@i2`;V ztxF{SW*=htK8Jrq_K%UD$Es=1cFn?E7?`Xyq*mFt`lY$J9#5L(<)E=u8A=0<5j*u9K-hlK$m0<3*Pw5M+% z>>y*PbwSWMlw0};G^dg=g#7&_+UM25(*EF574sRRd_L1VjuB+vq0#&Q4;f$N)tA<& z9 z2RgfoY&ZdY{d#xve0Q<%k^`4)l6frsEw9f)I=hhYe3VBWhyeeMYIEcU7FyyOswXiE zZIPyXNXQ@G%vlW8N*aiMTGFMRu+klaOxOoordFW`krw3TksjayrkPfsSfrJDIW_}- zfgEJM(=i~dh!jII+wG+c+3ud}XL|W(ZVlD%E)Y#++b*@0IV{gzDQH(pZ&K9gu)KWP zP@qKm zI^AwI84duWb{xmT2OKNfm2`Nl7orHR-FVsv3jJ8}gRGs7jpv zi;w{}&Sd56EFz{=XB-SF%mn#-dFf-%xo`nGv=2m(6y4>9{caUArE_qk2r-w*mRTdpp1J7he0fo+e)J49kM9>jj+sWLXsVc*n)6BCsvg|q67R%FiBoV_F@ z@ar%?>HA8P{}Wec!K{(>7nNwcBF^~ zouE7nW-2kn{URTI2n(&ZIBqn3v4?b+kA|J^rM;;2wvb!vNj~Zj@)eg^ZqJ}#nGeSv zoc=a|>)3e<$XtWzYSF?@GF!+18H(>&Rml|cAtC^0WC)v%e-m!5AFtF7p$esoKnTv3 zSnO!AGJUwVi|k(6o2k3nt_$_g7G^$R{3j80m^xbNPA*bIII#mbEeGGiATK1fyFywY zp=AjaeIXsD6`u>ubA|-z)q+1-P#7HXH%cRczxLwdS7Im@?l`xe(4^}xkPasrAGJBS zIdDF~Ud6+DB#7E7(n8lgZp7yi> z%&xSH%xHu>Ov5h@?n1^!M}xq8TVu`LsNly~Iq^qI z?M5YriFV~8;^Ftq3`d^DVR|J{K#-rvZPOl(Sx{*C{e1tv{bF%58d)pXp4jKFi*VZM z8M8EORRk@R^=xp_^MOV~uR4B{HN2#}W7zFI>*%0$U>_2JH>+ga7K>30joxDRYF=jZB9HAKy@z z#=1JkW@sPZcw*KThrPX_-_z$RS|Nq06B!X{@c@k3LtmzVFdzd1!}71(gamC`xf-3a z+uPfzN+X=$G|vhtYOlLAT`H%o@VbEgY>Cmw;`&Xb{%bakiu7c{&Tr=9lafU2ItrhK zX#y;H!6(NSz1gTzu%L@SD*2Jl=eM+6Yw^DmU^jxUni*2K&6SnyQU(~dZdBg6Zmd<6 zdh9PCFQ%e@q6NShgqFJ)av6HeIj_Yys)w{I=PwV6xny7Nb8zJ{DbB+$j4yv5H8puX z7N15U;qnSTZXA2P6Nd(ZymfXXWpM{||3!KkV`C~6gM=j7p6O|wYMruXp0Pp|l!I?} z+tK2;Pl}0o8PORY6;%g?fr7M^kmy+-OFOJIKK<2_Vds|Y{O;(eK>siHk6G#f;ODvnVaHKBs@jOGih zK&#n2lOyJ({TUzQ`v#+n&B?8vvCZI!fT#$cYE&$%1m?Dx&dO9TCgpLLmoSYBX-1Y1 zDviOuxQ3d1NwNk{qd!M6JT@WxPZ%kTR;1{hz}9ebi(0e-B%p114SmGDy3XpT!OyF z9>!k+HLL_q87 z@6VAA9{Y2ERJGXc+*y zys{!GDY-EOLA~8EFfg#i!Ia1(B&5&hKawMjGE4}c1BEyq5D0W|KE0qg!TCP;J(J5) zSx4th4vO>bOkVMPNyK1|B2OnRfO%qMr(Cn%cd@TDgK^`i4CY(tF^6(%GHKWlivHOY zk_pZfaMEGS4UK0c!+@C?TDjh}W7!zUeZ7f-j10Xv9!R%=yySKh>(XDa;Ja33Mx%hd*4@Wb^D z8Y&4=RHVmh8yuXR>W-ia)kVD%><(H#xuV`vQT{JlthwA?9&!3fUEE%sZ~^=OIDTwx zZH*vi7jasa3c|##fkJJkDl)*}o9~rvTVsWOzP_6(WvyXOD_s-idJTqfZ!a$|l>P@Z z1T_kkqaq{Cp)>8@adQb06Xe%W$7AydHE3u|48n0qB7%r@)4;(Kokw1eC&3>R?Ze@v z^=^D&^_^t12&xBt_08EcGPD0SxYI3=U-M*~u3IY+xO| zvlQzp$gZNHM1+B-P7&}!DO|Nd31 z=Gk_7`dn?TtE_AYiV|QqXpKuqm@Dub67hraf#!-pNIWUX|F1V>ZHIL(UwUpQcc82e zi9|Zg))tEgVXCRAO;s2m8=Y2Awo8w4*KXV69A;f*`b{-j<+>Y#8DNy%$;e>dDJ-MR z_WI)BU~9_@Wyeh}8(p2991ISVWi$Kp0nsE}*RyrD|6xQm_ihdll}3pBU>sr;xhYS4 zSB2XADr0ffJYGWgu{0sXZ2Bn>$WVHr``#>{{oL=q+}=0x`J+2il{Ysx566A%s5d`u zPlh6M;>HiGP{#}+=wXODQ!Q{fDp8QYdmPeU-X?fG_#eqE5=fq)c}_ifayj~JP}6L( zgGt1j4$iKlgOL`7g8r;UbLtxL0QKbv&L~Sx5i7#+FZK2HHgiSdC}MA=J8IccKGe;p zv3W=M)X^s~iHKY>zeCjjHep}C-n9IPz^H>E;XYwgU{C=45#;JH_FN3XVgNc8i;jK) z_i>Bxd4&LVLn=o{>p_d~sA*Pif)^x0#>aV1Y<1}h0rda1Ucyke&+lSCVFfz6yVqA$ zQDL=>j*d=DxDBN7+*}-N9C>OKD56;5twjVvy*M2ehoV?N?J}LCRv092iuJe0P1B{Ki45srJsz8(#6v%`;4@d=X-1Z7mm5T~+l) z*!y(6SVJ!EEw`1irluwoI1m?CB>m-+dT?d@Xx5HHi&vy%wr0irY4Rs?nYeFtiNS~% zS!kCV(=FZQ1%f$@T_aIGQIVdHD|a$Ew7JD#f-olr~Tc`RCG6doGJHAwrz4JNlFGqT?=|5Lc_HS~T zGD7VSUzwhvn&p2ZVO4617>3u_P5SmI5J21>_a!7G6sqt5cmz-x{FG6Eu;U*zalGQ< z;=W|||5!1~q=5rzXLlEiV+s$!At6Qxf4IY9E6Nuzuj?oz|39X#0xZgHi-KYSqEad? z5`u(ur*wCRv~)KN2qMw~!q8nK-OZ?UcbDYQ-7xTu_j>Prqn`o8%s=NpvG>|*t<4Y? zn#CVYfQvhlBTM*g%rKFinA>S>1U9@qUH!oC)vH%$$K(1pr|=uVje!pgf*H@|v^K!w zx|1Z})8u`5(w{0Y-{215M}V?}LnFt>3=^ay?ABA^#60X)6M|2XH88PuRTdUlUARI+ zNlD4TzyNxXeaS?@{>yt$&_GJ#cp}Ux8P%IOQaEurpHFyv9GwvBzWVccf%K$kq7xOx z;&X0m^0ENp;}LsR#i={DmmHuPKtYU+d~lf=uu#UK;dKe!a(x*`8geXBEth&#+@g` zhcjbitNubr{%0fdFcsNk{>x<;%S|#@YI3r2IL2RO0$+lBaF&8&(d@(+Kz&n`Z8#uq z$-y|z$pJz)PK9jdNJg)PpLgo)L39Yt64v+MRWH{vBmDgG=4;=hqN28@ZiAV-CT47G zygR2dPy%*&G@(#1!>BMDBmhi4_oy%)b^H8+|XuJgu zTI83n9+bRNXOpG#TOQ$v}tI=iKXTqg6*_ToXLzU$VYqheZV%aEOW>;K( zmQkls4LOW=e2OP!BGYpiUk+;xf8dw)b_hruCa0&LpfPRc+k!-3eeLidW;3B`ZJ@}g zctqVC&l$^FE3jlTX=`hX5uU;rBL$wZY+k;}VZrA$f)+)Ahc23k#pikQocFkVk~v;R z_vgo+zP@xQWkp36|I*)8Sp_Kr0|R!cC;r9ij-1Vjd{q;l0HX*;LZ{_Zw2HKi`wT6Jx#(ZcC&d%u39zYV;; zzO7d9nFiloSM{1ttV2v z`XJMndO*uZQM0fXaaoCOBO(79`Z~+u{PPQMKf-Yy$bnL^jdgn%(X-UJs7TG>`D_#v zf{6AQsTGksky0zI4elrSa4y2JzhW`PNM*_&hS9XyLOv^%npWXb*&|4=cW-i(e&;TS zreOlfd+`ddzDVSCFbX}!X^*hM6E5_idwlM&G>VaH9PuiMr1%x&Pk&;_&hDUBDP)@5&vn_JZ99ASZTqZ*;$&4`zx} zNbXEm+qQ=jA3ZZOLyU}!l+CT><-PJF14tqP4$j;5Oz>Wfb7>zym=#UIWj)1eiU5&t zs(??C=h<>6j)%cpssLfdv2u?anYcFw8zV409)tCJP=xib6&wy6S#@=hg@3 zfSHhnt6S2M?#EZFJq4(;gJUK+9V^%*@@Y!N8Q-^x8vryN)15sl>S zT0A@@?Hbk5b$d7;90`3R+lAWH?-5lG;now_PuxTF;s-$GW@A}i-21@3HKpy#qkCms zN#2)_#Aj>8=^-74qea^sH;KgnToZj1$7&E-UcSUAtq%8!cR=*<;U{h{EgiRp!o1&l zs%^#p9VMuI77fAoKAm;tC9&OKY-M6%0)ZKJ(DFp7(LDGvINnLX(cDR$+LOSR55ip# zHoY3|Q7_VQzrH#L6`a-H#M6u8P4FUMXD%>k{^Ud=AJlYn?YY_vP!v$gPi8F{e7K|CFPwxJ^1KotE(!`QjU%+vwj~$ zMe)AU;)y3_wVIa8;s*{A7ON2S`z*KIadb?N$jwhK)So!cJMb1EMzO$+>?jbV>+F49 zQt^t}PDiTN{SIx66vdFrN}<|((sQ=7QBvuQ*gIKO2~|2&D-L()*r6(&@yM8wRl7VE z#STi*FxYp30Y~_S*N%EBl+)@sI90v)Y_ev)N2bPbeK8fkS6;sVU6EMcaF%`ZJVyb! zBr`jE-x&C%w%aJHufJRKzOg?+ug-5P(wN-qi+#-TbUUJc z_4WBh7v+85uhVZ|27;WC3NEvMCychm$*{FK-al1(eY;VqlU zuBoL3e#8rTJZ=)k4|aKgZM`2zJKh{86@VnQFSWL{fjV|w-dZ^vU@Va@A991Q6FpJX zNLm0(Mc)Tm`Qurgpy9)6kO+eK4DKG63GOEdB~X#T^(r_%Dbr$^4>B0rY$I_sjj;V}sGMZ_Hd9(4j;2E5_(9OeF;>5Adr9dzEV2K5iZBN|TKbKh&st5f~y?;l3&~ z5=tfxJ&CrObnM#1-m#L0A>7dxF{rXQ=y#|x`?=}xyZifd(fdC3Bkqml;19eCj)}>R zi7~-T`Wt8+d7Pe}j;BO3G&h%W4)zy+Fu}^o%DQ@bMx3Q6qT~gTUz-;=xwx{kvevrT zPd3LRY;@p|WCm#fb~0MjAs|I!)nFf)D>sv`D{}JSR;3xtDk*srAUs&0$>M)~b>*dt z!p*_K!OD6xlr4SNs7N1fLsVO24w8aXP=*ABVsL9_8$GKFy7d4k^64R=T-=*<)^+Es z;4ANTp(rw|LVBb(Ujl2E+P8{|$CVa?@8=h8(7aMqsCFl_o%f?Pv_4OLV!hrRpdo>F zBkbRLRx#Q)>|cSn>e6xk0ZaNoU)9HFk5PQFpxyRPCB6Mm;eCC8KVYIu^`$ifT~a%^ zC#2IG@_If=mY0vLL`X`?f{87`ofkEN(YTyTWJLk?)gfMl0gA6reX;iGsq9Xp9Hd2Hf5B*LyDPwf!xtCro0*GFu@MvCjW1^t2iA1ucIa>z^ z=O{=#r|B>@sR$9c_YGTFRFCb?*7FjCx#3~i_=Bi^{!ad@ikqGE>$O>(#J?0V&s{GTNe~gOx^iyEe9TRqNDV;>r91zS20J> zT1S10^t2c0aq=3s%m04D??2tl>|hDQ8+F4@;PvWFVoI?%{`+PFl3<{YeBeTxb`SU{ z{YR7grTa4{DiwzNe(1N?4y@)6*-Qm(mV0ln>K6dUd`yQtEX_(NRD;|zIv^ZD74_F$<|ZWtj) zW3myb!>Mo;vG>M#C=^z!I*b4P2`z3hG8XIByWAj8=KwIl?`D_UhvL`O{QsN&i-6f-f57qkrtH0L(S_3)B@6nD)LM@c^9qVQ*vaxn9wP<+p_lN%dK6^GM zf;d^+y&B2(1(IAvF4ky&=l_3Q!yEweof1mfpVSdl|KIQu@Ar-Pw)s8#>p3VWsxNlJ;SpehFT~j~ayW@o#*geP}QuNuNAPFfIphO!jmCfwGlu&T*A6B1g z^JHg}%#yOci5nnEPOUdoFXAY7d*q{{%;C}DgAJwCZ{4E%?lF{$D7LniDPM8-X{Fl+X2T`C^eIC!H7E6w$Muz5_pmAGkn4w3UU9q?p zdzvm9De>VCnKG}h#6y{;bNL{&hvPHU1aqYD8#T)-%j{eF2grKCA>MM;!?qIyY4enYvtx>;oHY8 z{(%u)2Rdr@Mt@!PyKKL^?(zur#YF(^bwa$83Bwm(!W1^n^fp<+6Il~^ZUhJRS?aT2)wcVu>m8JQj8!+>c6vjvw35k&B zEIHo1R?EkmPkP(|dT@3a)!OKBOm;s*K2^_g6{3B`OIelwR)U?6kMG5cbjfI{*3eqd z)1v(Re1HG9Ohy#gk`M?3vFq3iNu?q+g)fZQn&<&BP1rk|*H!4wB=U4HZsKVVQ}r%ygZF9rj)Bkzw^7^aY$eTezw!X1 zQ0&0hl3E_C(PpKFr6S|yW;dnc@xTv%0D3ZX9Gc*Yb6*+ARlNQ z_iZ8}0hnloYQ9Y9WYbc_HqUk1BV}U~gwnWgQJ2*alrb8PJR$TWBjNXYXJD|tzHV+{ zP-;65@i*{1*^13$`3&w@k7>CHvnG>)NrDJDjfrt>8d)kJM=OyW4X@Ss$m17%udly4cXg%nK~UlOahi9-Y~Z79pVu2g z2i+?8AuAh;BL()}(yuYTb$pV_R{6$BBpVR+b%ZrLs%uwHN{;V*UNk^hbBK-LM5MiC zw#GZ6c@>Sra&3FX=1t83ZT|8Ko=y|?`E0{;_OaNf&EzK}SBON$+&H4=ID|LzwXcb% zs?L`B-wsnj3@t5nb1-DQV<6{JB62o*g4XlwFM1yq#FTQDk8f9-{wOk4>OyN~ussP+=KLfx1R{FfN()s0pMv7sy+YFuU@wK%>egDwDtf9H=o|vDw8H8+5ebRnBJT#hc^N#|#LP@S zZf_mbzQKc9<{8|uwF~5;#GEBQlV#a|)iwL$m<|E7jVAQ*)2HCpMdalv4Q}uv;%jG~ z2eAx=B!fl?87r&PK$;K;=e_rS3EA0|{7~-c3D&{hlV!D?`UNIDa1ElmAJu9I941nC zNcRPoRJCBMeBv8JHPQj6;PBZ<6bYp8eu5wj-@0 zI;;&*4}7?8d-k=<-F|5iN7sUD$l8;KkR&285!&BlV_K?FYX3l&yV6F3@pIqV4sb8( zUJbLEX*yk=JVfzH9nyKH<{~#sc4P4No*m~Fu+x!GX?5A08EYy3@}Iha%~uKb^)m)8 zIv1YD>OoJBsFih$*%Cc*rcq1{F^lPPc8D2+J~xZUkwmo7&tmZkbaTzF$zZ-zT5LQ# zJnSK1s%Y=a?VGV8U1)UlaFaLB(%C__^iwXPzVk!G;UNY{uB7Ntta+P{)`vkU@qr(w z`$1M^rL&-*V30iQF;o8%PPEcgCD!VG9{H~imEL`NH6BZ2e6zk;%Ok+)E`s>nKp`zP zG5;`0Gg`v$UAeT|!_eXz6RCuvtxwfZPgPUF#P|mwiW}GlS*b(qPvNYme9+F7+m|k< zr^mF9LmUqe)&(2_G8Fx}iKi>U{ex3brW8uk=gNP2xM(-Q9DlVx{LF_G$0R2b^`F=f zh3$h9tf#v-C$oQJB8OLiQC$0WLPjCHz=p*_5T^&??*c7K&XJ2}y{QjClVs32)AjPY zs ZzQaB7tEaPC4*F40r}2t+R&xi+FDRT@tmoV*QARTB%6TW2wGWTs_Ui;Q@?y^ zG!F*MW$Wrseb{Yk1eRq`90Mo2*b!W!u#z zrJ)G0uzcv4nHf@A-dg)^SURI)sp$HB^!(D+bjbb3{)0}M;vq0u=Dhb>Dq|g?;e`)v zM42eCX;S+$r+G;t^vX*u(9X`UT-jylA`>3m>CgCGXnTh13dGp+XCI9Ngd-#4SGJbZ z`Z%D#Vv3u4;tASdlWfR|^-~np7I`1P7UIgwlPoKy^Kx#Dl``i`B7myFy{?_B`;^cI7G`tVQ z91qda6WF&|{K&k#k@x)`2Z85 zeGdRWkt>^cvJ@fUvN_hfto&JOpg_`_QNCJs`kHyI-z%BzU`Yt;1Vm9_8C>1kznFLJ zUUnd5bbT!yVm4@hX(<1(;{DI17rH%*9kVcX2wJIbKe#ao0DmJzk=Dc8yfj` z<~)z~1Cf|Es~r*dlxpV~m7#@GSKI2!qb8Y4*AtGPZJ;SK3^(4JK#IZbyeLr@&i>C4 zC-^XHV3i+QcDEwuzSBNi8V*hrC{apBlvbAOmb)NF^VQ>xigZI>iOwR1MtqAlr0#-R zuwm&OfiJ+dHzv!W+@JWk7Jztx zLDUC9imk0JK)m;GGaNKN_avHc@^9*3Vo-Pf9L2R2o$c=ies=jZbu|_;R##ol({)Z( z^voPADZ`wyjY7!pKJvQn$FiDasNkNvg9DE)2n4bZLP?m;G-Y(e#MH*a3zLbq=e>lN zFury!6INfvr$lnOEPrWexbnMI+L#=+|9`tO)i<;fhCwx-e41OjEqc8t{d}Hpg|$S) zbY9$FoT}Vg=~jPEB*-Hl$%1RIlL=X*{~R1V)#wQoLIjdx?eFcKttJAE?es~9b zrtf4ZjSeeP0m7wvVPv04A!i0HpP$^7e?c3lLC$x*Tl>IBV9}1VuI~xyL*PR&$mdkJ zk`xm|O!8cHy1yOp<&IT7CMpSCT-aAle=6O5&r@Z2yrJ6GM(V41@^w@_ImG)m_x?y~+M&*?wQ(3`D86XJI}%gbZJ8z^!Bl!F@2)4oQ} z0O`ZQyN|BFFP}XmWS^Rx1QH?ifSjdr;dD(QA^vjo_8=VUU@lbr5K7zx3D%;=R_xtV zQwM87<#&;KBsMSkH{`34UVOPS&+N~omRn2i2Z>mi(;OV`UwBQ$WuW^%qrP9R(K7Hz zSm4=2Vyj`iPIJkIzItRWSGmI7#8!Osr_{@K6RSDQ^&z$2KOOt4(Ibn_UXot}Jm#;5 z0s;7R0s?Sa^(XlYK+;1M-EDl((BPG>K!zPe`x3Jk9n&H%D$1fE^HhDGl%Mj#li~Q% zh*~i~58lT-N!oNCsU6WJb+3pSJBWgjG54!KJzYU?u!*|%MlgLgaREKk^_<=>9*@66 z!9APKo~~mj*P=ahM+XeFTaW;G3={?2QjMs@#E{EF7XWA`;Hh4v;g*#%KlA_+9-!*O zQy*5<9;+ISNyY%Qbt2^l)Q`e^+c`qI49kqoeE(-(Y~jw|BC};Gs{`nLb=2Z&PtgRGo=) zO|7l{+`GDrKrma{zbVzAi|jbi4dsXOi(JZyn@T_ThvfeE%3YsZu|-nzBfx;+hajok z2kuTx2_`JCug|&ok@@&|_1oD#S$f@g!$*#bzP&{xLXJTKVCvi+!%{ci6bWMkGsNDG zSgJYQx2m$B`vn)Xn8yr$Zj6k3-gWp^577>3U^n3e|1^e zw=b{>P-k!|MEtB0PJc7053|k|Rvd{dqeuS9%E86Ca`+)e3wrI43T@ds091;>)Dt??D9KXg3_Pe^8Y0$w_ zRn1!4$8)Itd$NN+75MU0RwB+NDX^W%N+pzFBH2oKEP`}uxy?s=NgbHKuJaY?{iy>B=*LNm;tIG3kr6qI1|EVUni$BeID-QONQ1SDe>Fp6h2|2eMTkAaTvakeL9Bgf$Q^Wq@^1qH>`(NYF6kLwfF zfbP7Ko^L1G|BgwXkVI4xhi%`IctirL^+of~JN^P^c2{RXRN`1`q#mnV?jHo-55TXh zoq-CZSXCOQ)@HQscx})q{x*pHxSg#?A3uAy*HR2mn63a2d7sY>AJdutBcQ@@;)62i zh2Do3VF*4V0rkxsXrJe5&$_4UE}*ef%O?m1MmQci93CE6j5-Vwx%SP}Id8(0oizb? zna*?Wm9kF>ka+eN`~a4IfI|(K{{kLoUusVm{O?J2O488Kj2Gz(_-$KT1bwq);pHbRWL{k6 z1kc3oY(4yIF7D&U&v0?GJf8uU7Z92{Jp#3@$jHdP6+34>uzSCFQ5cHQgd5<@PBgd= zuPf(bmPK(C+-whJhXh3Uyi7_?1{sO005Ibck02>6FRv~yr@l|l%iEx-+#Jc#ny z>~ok_gg4}`ve^32VkbX{RA;K zGK!9id;A1~%r9Pj_Nd;o&Q!d3^QOcoP!8w`r*Ydd{r&u!^!JE`9zS@nPagTXPXP-PGwHPV zMrI|3swe(%RGjpYac^HPE$N>qR@)Mww1`~|ilX#^nCE%=^K;?ha$H8o3M1<8o8Ly?!#K8e=USNGc@Lk7yJLo~sw5t`) z-W^TNVsH~LA3b|#ZEZwUUwli)52Qxg*6{=Q@2I}1|JMp+gqIYP#O>EF1Jj7?07`9L z9QWBNHb5PlEZKMUBWnx4WaZ)U9Lxw1KpvIb7%L=m_f;m{oNjYiju(zQ10l-m*RuR& z5)@jM7P3JIkQF9yJWAm?wFC^Zl6;epSW>L#QiZrRkR_j7c~~fUJP8Sj^X8b*$$hk2 z+!t2gySwxEz6lTwfpOlMt=mF+k`kMkGL%n%|1%khtv+3be-5#nDtOM)n9#IADGhmX zpPZT5u>Hguhe~FunY)HX!Z5A?zzn&pQFnB&sQuf8(swJ>@1^z>kna*5Fw#l}Cu!&4oxpPiYx zb=yCV4=hJxu@5j-M99;fdAR(&G}sgY3`UE@!y@H(0}<(}&naIypoIa4_1>jqyRPz#*BhRD;On zyiCY!i7E^nuor9Acdt5Y8yo(2-_!E)rtccv zx^;VImXAs%>4*x^wqOV1?ETwkw>}7&-JsqMNgZo$ZZ?L8gjg!dYgU|5`;ie56S?!I z6qT#dgPpv7gXF-ifwl+@1pdH_E5Sm=aZ-ic;R({IrPd^0&SvATvXY^Wp|H-`@u4lV zz;++0>lRN!5%V7_7zHDf|MMhiZ3nfZxtV-*^O~^H_-N%x;n7LW_`7^o?DcU317g$U z7x%n5sc4uOuBPr-FFK~j7II_L8D1dfi}gy=W)3au{tvK0*^_f0CK#aCc9xO~PR1A9aimKb{UzeEgJi)!DFqIB&?|%Ey_|~KDf&?QDu!xpF>NDAxPmf=izps z;Di6T`lnC}uFoxX@7xP5ZQj!gFtb5%37tUs!sy?H^u1n|>~X`kvaeM8*r=x3O)l?t z>cXf>{1fxR}x=r5Wh=3av@+F*J zn41cwP9P%_Ivn%C#ql(UhwVYnN}T>Q)oA;_YHnFkUndX0zN2eneV4_xAMGzF!KWdLy zY-{+Th`9=TClw>b@S6q@pp>lyqumw!`#e;5TQUjCV}LvB#tZ&}Oy}N4QSgqBe;}z8 z1BKpH$)g>qsBpi5YMRBq5UNHfYctd@n;Uwfg#g;x#oSwdg}8)!?+ z)y>7p)b}$)^TRi|2|bKvW*cW_8t?gV)|p7O?^zEyxc8$Ucp6M5-1B!{%fgc0*hoA^Q9z}!aWI1yhg#Up zV4CwBTIKz2{sheRD$MljXFYPof^K&6F1jhsT&v?1wA^>JlFthAR;=0)`?M~mf4>O| z)obZUg^vD?4k}3{4WS1n;D-MuOPiQbV$*<8m7!98g-feSskU+_T4Q6zEK;In#UW@z z@pi)0C;j>~xqzIhogIEOAu6gSx253z7(hx#=kLao3wM!l|2yOJrTvcBPa@jZ%QgWA z4Jv7n0t$*Kz*<%rpC~!LOx{0viuf;{C+4n za}rfGHabgLP(ize_<%+y?**o%V6^Cneh~>0?=5-Eq=t6d!JiCMg^54H%*gshWS1QR z23s&`Umpj>luT^Plb<9mPnJ6p%tck9cE+q=+>lj+R9YR2oNWy%dabf%V z8(N@F(c^dw+V{+VUxP0*PCUl4!yOyI8TkDqS-|a>ElRszA)Jnj{^So&!na!N6)u>N z4ZknCoEbrIa1mN*;Fm7OiS?zr5%LrYBf|x=fCL zF6t{WaO6$@i)DhjEAz(<;;##FJ7rD-h&O`r9=#vHLeuCRNs*sb&MGqn*D%)W?;>$2I#5FitMvAfq z#{(5X2xUMJ;EY2c{E|1l`Ex*I15TnlcMSc=m_e(Za>u!o=YQSE5gl~EABlMZO7we0 zzzHNu$^=ifCAF}dCucY`-6EDPYgaUaUf2#gs!bbr{-PtnHa*|md^^MM}#@)Su z5OqN9lT&%LzW)61>DAfr;`zgkarbG&EtJs^DbX%t2fz3hoPA2-o>xXL38u<_8YFz zB4yHxu!5L;jw4JY@cx;ThUkilcRnKJ8!S>z1$F|N?XuR>rKjK62-gs8)D&__2cmZQ z4BI?`MM!Iw+1hst{muOGd-IbRKnl4ziSQr3QLG&mV9=z zYUiCXxcdAHMa7Y~IjIo6Cqp@xd8NuEd=RY>^HWk*uZ0Z#FyMn+>#^N7hy3KS&1APP z-)%hAJ>PH~k>bt&ez0!yV`nNgTt-sTeYDC5=)YDW<#rbcmA>Oc1Y=wHO@Ya#&3uo3 zgVXtxobKg1!_~xow5})SOqn&Xnr#nHCE~Wy2^rJPmA#>5JC5n>?7q}O6|4j+;_#rA zxi-U8ER}8FwU(SwpDspiP(T&z9fe>M`Mps3!8uBc6471w9h(SPz^O0MqdZ0r$Vebs zYZgMTx5X(oukGyvZx5&4Df7MWP5I+iI(yAPTV&kW2N>#|i>a}9MoyOOI0fkRF2Gn( zNQM)zthkKK_M6Grj8~2N1xRC&@XI|GF;sGJYw7LPzP@iWN5TKX{HVqp=;*AcKMsgL z=Q~)^>gxmg6y&^X2r)5noy!hLY)pC%Yweh}uKmUR?;VGIZeVkosL7BL7VyR|w??G4 zy?jb{bspF%O~_F&U-~xDd9zvuxh3sKcFpH*+Sjm4$W|b5d1%gIBi4Iu(G(Ey{)n0s z2W?>&F7tE~t$~+< zZ@7}?PeKLP6w2*0>LjwyVyHW4LaasGVvk$GeSQ+&shM|Akg#?36hF36+`0XbnAz^f zBY|qGL94B`1*vR@;Z@>HaR{&Z&u4yQi+U})6SZbQfxQ+voZ~gssEzpHe^F^Ze+b-y zfKyG%^=X<09XksP2D(>?{csf_N9Ns!_bKm_b1?3nK73tRKsP(93r{!%#Lh?4)s}o| zKB*W_i$e)PA?ve$V0dkPJ!oGM*}io5?pXv0hpH<-7S;(*bs@rz6Kp>?RK1uH4U>(Q z)X`=(wq}-Z%7FU_@ZaD9u4SZ8kr8r>+KnztKndRAg-i%$yS)5#vi@W$H?WpVb!cbU zKGkZn%5rAn2~c{~yYK;;vCa8V>q~J=O35g%56&4Bsd2iwE`efW>i3y@2XMwZoL zW219>>pXWqbatZt(xr$Yzp#>EP%qPT_~3i0ruPKJEh0!+pNeQQmBgN&kzI?1AFS!?;o34pe| zTRd_i;Eq&zt&+_)6W@G{*cetC9&^*dRmAYhn3*5fH#4z3d)pQR%(Q+kdP1%i>{$QBvc9m zgolS~|_hY!*`lt%Y&m){19T)7lBs&?` zud^t=Ev&4(z>dGEGF|u2dkweM0I)N!%}*zPY>ByzJP)TM#|s0ef*gZ1_d_arEmots zB;dvIm6Hpl0f!<=O8?o(Eah8GY?M5*p`!}I@?16Vqsi~(vX-_zDYUZVS(@O07KDMg z2S53qY`d5AWL3FqM}L2#-OfjsTe>KnCEE!7_O`wzGMZwUL&8ebG~*tpRi6H+HEzN- zBbTJlX(wYYmMYU>T|uTIdELNl{&;P9BRg-}UkjsgO$IqlYzBe^pHB%O# z-_UgSyYqZ#H{DpBkFN z>ZYK-S~8$FYdcfJx4gs@|2&@1M|)>ODL?N)y_1D4ufvk<>#1r>HtP%Zm*VnRdE2Ms zJH2Q^z%tLDy-*v%Z0fM-!Us$efpec<^8)aw_hEOwnsj{H9(L0Mm@@No+du$#U20ie zTYH}NL50%NXgDV{mDiwWk+S>kl#>AP!#5kI0za3S)PUDnO|MUU!gbbugVNjqcoKlaO>*mAQj3tSYi0X}rLkEHgI` zdf6@;cf2cb85OPfb?Md7N$bKJITrQBu)om{oZZT^k1b#fDy#+@;*R<`o;-2Scb$Ks zOckMhHapW5M=JF-Iazn4h*6DXMAc_(bTSP}WPIXNdO+5Ae<5#-t7 zGj@OAZ>FIa@b|e$mtg>dm4z>1#F}O`jeuy@uc6W z#B$5459?I{Iy zjvi<9;TBURT|4y>owud30NeyF7ts*wvVx7oO?RXpCrM{_-aznrCV5?m2pRGUJtlv| zcvBh;OP%=|+<;(`ydjA(HI3sf4G+BWjAnbVgrmG|C3P9Sr+v=HL0v6K_6xdB11n~h za;N&&8WVHhw9aL_&S_oA*0#6nwJ4~;N=rf3w^v@^qL0FrR#>g3PG;6$f)oA-<#(l6 z%2^=#ro?R>D0zVyX>WJ8&oOP-^>-@CFCZFV9~;Y+OT9F`&LAA`AB6J*YX>8*mWyLQ z%ni)Giw&Q)Af21b)$Z>o8?LeWQlIx`mWO+T(R%5m{0*ME6hGk|C<^TRL9jkKk0+tnCT4i1r2`XI?0?}X zM%s<=k`!_dPDUwo!MD!r-{ht1O2iE0ckw@R zcNJ{rZaNI8a<0*>bLf2h(hAg1!1ZU(ofkrr(LeI&)Z_~FvpWDg8c~>VSaKS6i?@4p zh11jWBDuYS4RRHF?I+U@DIr;+4uzXWp-mEOoTstA8QM~&Yl8L zOpgp%tVGBIVEEjS{_*9d?1}cpsEft;e(QV!k%lPA@dr#WGt9>s5MlzA))NzE6Kj@B zfh%GH&iAnvrn$28c#T#U$F`uAk096l3u~z9naUj(#K5mGw8K))n#UdM`s|`b9`s#4 zuW~8kd#k@SUHDaMR`{L==Gops2`X)Eki*Rb@soQpXPCvd=R`mn*PGdoCX~eGXnL|W zd3l<6O`cw;4POatg>!RG06{^4?y+?0+^nQu4``Y4Je$AT=Ee~OKF~hmTv90$=28t{ zn*+P)lLc`&sV!rj&xIKdKMA)+x&kil`)iX>c?rP5EVhYvN?sB_aj5l3wE_8z#rs_n z-Fl~i<0FtKO?};Wn(pq-)Spl3+4sERciQ<$>5p>sqq*G`SsURIlAZSJ{O~C-c5~a9 z*E99zuhh?5T?g2Jp8tpNM3CSvWzPbI1R(4x5pS~^W&(ssf z$EIkFogZK32LM7)taY99`b@fZsSm5$s#7m{2NP32T)T#XcM(viE#`|x zBSNkb8%ma74rFE;G3uTL%H8Mld0{mbS}YcR_I_j8o_^YCbH2Dbta9{17BpfmEca-Y zmroJ%VetV-LBVgA$#Zj5q`?)B>n?CjWZLRtBP866eEA8G^un7L1`g?T-f(R6H3C^G z59dVx&1!yM@)R)-#Gxm57?{hLtZ&SEp3K*}(=amLB%X&b=rjP*$#|B%f2)8OA+AK@ zxouRZks>^VKjeJJb7Kg2z3^Bpx7Y2{##jJT<0|VL7XBB5&9l~B%l07jE{uZS>iVR) zR;zdiZ{CgCX=7rn#__1bKu?cK$_N@ENXF@TF;KPb!w)&=nIAX1nvkz^-PHL#%kPv~ z63jTvR_(!zzA@iLGE;7gjl6}am|B|*7O5(yD}Y`vO%6!VBQqtS);%9T%&LGM_$L&L z&6So`h01%;Fmr6q6a^@}>geli^xCeHp?Z4Xjd+R`U^Aq=F6lm)$u&uQR)7Pe2|h{S^qb zh%*zwZE&95Dw+Lo6Zqpkd!$T@w?V{%qoZS?i@_u6-AMBlSj{%x{8IGtTi8|h*_{OD zGwO@5v7+ti9B1k1df+ISaM>$tDzB#p3BmuQX#y-ehy-jv@7L+7-D`(F*ZIE0*?RQ_ z#BGRfm1%R%PuwH`X;h+{^CR-(DN~-I2xez6r)kppQN(Ni%*(C0R-!$xCGV#qZrvN!WHjAjFXYNmaPq)d+iFO>L>`*kJr#RQExJg(I*)R*@v1R3{70ni zpfB*)!vh{yng+cu@ZxGu2dOC#Z+H(BCk9g}D-HW6j$qhm-5iW2Mx^lD4!wD`F&916 zl=7jn5hqHi%<+IuWEBvQ64?bMM&U1j`&wvE0skxy?&sFP@YKzrCX+z+UdE52{1MUx zIBTB3Fk$$U^Ndb1c9ar>UhN>Z>+;+hx?X&(|u2Q~uuK|Oc8 za0GNg+tb>HiM0$D`<~uL{*jNw%6%!uV_hYC2MfU>W#b;CXsenU!MxrMMybGSTp2!? zUxFbO^zowan?jZz=MtOo$GI)KSm)WhBd!8SNhwD|g$BT4SKXqYsxVhpL|rpuD&=LU zc5FXE6LQ*|GPw35)z8j;jyt1FZN&E(G{S{KZ4F+~ZoHc0;(95jcy4A`I`M8hwu;zu z^O}IWuz;Gty8eao%A@fx}-Ur_$KB{0~{>Bim%EFX#{{CA_iCFRJN(<&$h6< zR7GIC=tF-c27&wlhOqS4=98s9a#+O73RKWkPIsy|-{JO|cY(8+)AO%JfhT}zo!;D* ze7!pZ+zdTWH(XX{T0!PhZ-00~-5h8&)$o#!@8#AaT!b&{DD(i9)`1~ruL4y z`m?w<=Z66L5fz=?9Vy-Zxx0#W?$)DTp6kPw7+f}6>!?q`tlzLl2;5mgD`1)!TC7Cb zC}Uy61P`v-ac}r4Ze4kUkKN=B@xNOd6-~E=r!^P1QHsf#J<5pb~qht zeUyS>g8V+41@9Ys=UgBA#@)(is{+(=K3oW%)gt(*6=*n5)Aa7$L;%iFaFa7(l~(nI z`bBfXtq(a8X%fbLhNZ%nK1oohzJkK9Lh-BEjFF6_4E;h&+)kIXkHB;ynf2&1Ij3KE_W;HrX0Acc$<95 zI+n9OVnd%$+*i_7sRZ>;z&I_F z*qGz?5S-njQ4T0HOc%Zv?V?pGYbC17snDz0bPjQW^xS+^$2!t^wrZq2SmgoP@qbq| zsj1T;?p20O0W*GS55ltx*YcnldFhd{GFIP`l5(1TLaJL`zG}HU@IZywDrI$joNRPg zB4%-r7yIpka9Itz>PME*33|`SNER7tN18&0fEA+!V^&+o@wS$IC||rj(WgnMh$+0E z@IIP{7%AsT=DVhfq9PK54^J>Snx^sg5 z2kRP#Uz`!RrzV}b3pr9! zxVcVmeas66uW%Y#KmdW*87=3sfiYmXzjn3Ttr>E87zeZ38gFH7?eaP}Zv0P+B&yD1 zt2fM4WYn9A(*7Z@{kwEd>FB0+BEZci?0Q_wo)zrKmm<`_YmfBp0&6uhm3Go1w_x4E z(O5W%!xH#eaq3TBMx_}-{3+0W_HzD&GuNXyn)VI0W>1;y_80zVJ^IasV77$@RX-Bn zhg>mRwHFcAKS{4wj{{o!z43BeDXB65Y`$MHE863ciWUTpdC@Q5O(&cGkA3Sz)xEqJ>aL8+ZPEN?CB9hBSvG03@Y_M zzdv?W%!Dnuwk2OJagNu(bK%krVH7J*uaFfY<_FeXH4(HFnM zFGQ@5XKPslHs@4y4SY#fV|g#DF++G1No06 zyf@3&o?yD)KiA(m1H|iH@N9J#mm<4>h^n*pN5)Q0&REgqu?*WP@40kzc1q3g>-4h| za=Q$!u~Ye-MJK6VJWe|MshG<5_D%q_$vj0m`^(Ef5(UC*#;dx16SBMK$X~hK)GCgS za-W$uCka^Z^FDD$9cfr;&y4q^d(}3W7K&g$1k^aIw}fh0b+y$jd$jcQ3JsH|9(%*b z6ouOGC6B{HX^`QPoh=SPlb|9iBsj;+%#2Mcm>eJ9?6+5eBeJRJ>$d^u=JU ztwG_2=0gVC!zESW;m%u;@Cs8HsEEMK6tdIt2?-CDK7zqlCM-H!^v+BsdMze*1Ozer zqspae6BLt=JHV(}zlmU>S#L)v-AA?87+xwFlv}DFZh`;q7TaIwCU~E|0X4U=v4iJ! z1hgrS8l1?`H@5>7d~&LRz=hEaJ8U#Zd}nxTh}&HB9a=!Y&W~l4E>-!{q{nh!`#(d+ z1>CkX1BNv6RrMer7F`9Z>>Zb#sKYye3p;h@AtzquS-Q2~u^hl?fiac44d^dte;E!3 zm62SK3m5Kfs3k`RyIL+Duf&nq@W?X#;IY;0`dHdMC-|Bkp=HzfF2ljymFKIliU>ZJ zbyPa*_fT1nQ)-Y{D@?`7xP@TkC8R?ZTR_<4SF=tz(NsA?2#UiVzkRYxHgh1PP?J@2 zb8d5DU#~ZGv3p2*Q+`+5gHx6C%SGvXC1b+p96v{zNgID-d_CW;1b-O>2z3tEE0(}Gmakdhqe-zW$*a$57 zLSCwW4*t+$k@1{|C#mS_S}G+_6B|WfLV$1 z=ISbt*^U<;M3L!CczSz}rrPj8`w*kHn3&fcPvjF^CqSnRW>MHj| zVUnJJd#$HzOnc7iigKa&))iTuD zcDJ^+HvD4_CyD+KXQr2>Mv)`>(PvjyH`G|NP zgRmy}`32)xIi%A5ulmyI336UA_ZmStPh30Xly$TW^ws)gBy-pE@ED2+U);dXYgBhFfM@o0s`wpw;_dmY^a4+YR z$KdJsOA^mqozqR}?|3i6Uk_8G94kp}Vo$a?8CQx=6Zo!NKQ`x3d4SEInA5U}lTD?QS=^-;c+5!2QYc zF9!D8Hy;2A1XNjYI|BUT?>Ul}FZql+ze&eD9*dDZ0OdS>{ve{>i3#;k$7CEO`D8X^ zVC(Hx6(%OmF3JDE!+B2X7~-~D10_%C0xg@o-1guw#;QMtF8y(g%i?5}z?>HJ+Md9= zy$lBnLoOM@NTs4eNyT|m)oS(W;y`50$+I7g>%_subdb#dCi^-x6a0b*6N(#9tCU5> zQ|J^>y0i&EDeWU*uTFG8fc6$-L==+HGO#90u@Zz|9L#U;k$k)%A^;q=^1B0D<D2uMlmLK`;NsxEIT%+QFohd}UFlq_#wr)UdN4mmK28oB5yn0|5ykcJ)6SLYsL~A#Dv|-NK zyg!k>8ZTdH?!$foBQj8FX{fKanQg4jd$F7O9kIS$;oCO@GGOkmCe=z=pw$#F&qZ0i=!>_Rke;7IbeM~3A0A@&G~!Q#+Fx(U zwN3QVwN<~Dx;WrD)^EZTl!(T}=~1()NANE zL6#~yIq&NHir!oHtf6cT?>}6e8-LR6Gu~-xYJzwwY9^*{VJLI+F)Tp4g~WLu7fw<= zZdaX_PR)rRL0);`TP$+q9h5;H@E>RR(gm*pj>f=uKiMv+;6PV(e&dgular4VN7J(ix4KrNS<}=OuZe)1&t5GoNW)e^mV_*w ziuj=odu?FOAMF4ohSt`!SO0iDL`#mNIqRAD8}>oaR#jOkr5HMab$JwG?|-wbQ@^*q z{bvq;CRfrToxBuQ@xbR(UETT?NYgO`QP|Q=j8bO)?WSSZciS8%dZtx!&^Y(tD z7z67mU~G)1W85F(#k>HS8!2~*(potC*?M)F@^(4KP;8WOZ%oJ&8mr--=x0!~+3Nb@ z){^6`#TpF>iS=n`FN1dq-?4>-^=Z4FJoMq@9ALc`BzNx)xlbg))T9Xb*cf0 z-89?`AoBkl^l~$jTjl*D6O&^>3(OD76qK4@z3XekynMu+M#~n5!UM36)s@_2#(7H zXL@cvRHEVe8QZ!i<(Y)kg`3M$kb}gytaS8<9tckX&WxKyNk+i=_1tvN{>T^~9p)@3 zQICi&TmNu3pl+C1J>8#SR`z_aak{?x z?W;@M0p(2GcHt(q{sl`F;o>OL(t6i>tCgvl@ zCt4{65<7n1^~S0y#9(pDLyV7cCLY!jXO=y3J|$73L)6lpbj_7Du&qg0TVPjtDJ%~W zH#P=~l_}7z)ubF4?8%aB9_-zku8IhOI$z4m=W`ol?ZEdZVS#eA8WtKowRdkIC$57_ zetL8BDWzXXO1d**(voNhWHHY(WKxAAzJm}4Q!7Y5rO4(Y9Nxixvo2Kcwml#)E;;n# zaR>Ous+3(C<@|T~prHANdDXSe3q3MjNwLuZ5ey9<8x|E>dn`UK#L)Vhj#uQ$R6Bj& zc3v-)%1#MisYz%adA9ozbh~xF;eJ8_m)9Ti=iT>3Ku7>N%Fy1xzD8p!8DfX_LF^;G z@Ej>x-o1O6UF))w@HDo)y@kCQyc}+WdWEH>OE<+;-?+FqZh)BvAYvNX_%A_0LEBIP z_mb9%F91Ha4=k~+@mt?kw`WRd>4zzQc&=5!Oub|P`}AP0QPtA?!3XUKs|F=TJd{|m z7JGrBA$tXH`|8o=Sw*9uE|_>#RF!k^_qPpb{oZ&8KWCvulUI9>*z(o9RzvQf`Llis zpirHiZG*e)IVG1y3Pg4l@9i9MA;kmhtMpRHfak)+=JUG@kf^Ef>`PN>Ro#cglxW~S zKG<9Sqe5qJ0(gAs=61AeC$$_&DG(#=oN!p%m^tgE;6fpnJn8gU6G8gW$;BA}&oI<> zBAjYLCg*^eAIs20=Qb+qC3^b7D#FTed-XZmA-OS3>z=S;0gC6I+&y6&8a}k2Mj#`3 zZKA>d&yU-!=aa`qS#c|$8EV@|Ih~&v_=6#}Aksge{;z7=R6OY8=C~20trk*)zJ#Tu zHH81;(#DCOi9lB8UYyrO_aQ4YR34udd_`wNm}r5N-dg76pW#zWpxux2Lg~0u0J$aD zO%n{^?a4F$OFkY0CcBw3g&zRm3gCsyW!C)DI@)20bOtvo>1UsBNcU`wS8;L31tv4K zZhy`!WVgtndEor>KoCDax{sS;3GGZEmh{ulwJHL1wBFwSX_}9J%+c|L+lsyKJUl&b z0spcdm-H{Qc^?eBbKKE^M20ZHY+QHZmssJdB)qUC+2rkAdQ(Gy9p%mnnlN6CSN<3Q z>;B&@ysg6Lcg60#@P-Ch*%ajyrfN+`_uPjw$``b@f=LH*IbWi3Xx?g%BJKo)439aI zF4k$tme$vW(Y$|~!CVi*RoC1k)8`~JRHd`GzJHGf5DgIuoX@Wsh2~drqf=8!S8$_! z8aY~0UJ|Cik7Xf9h}zvh&xqzr=u>;6#!os2jH9$Xu5@0x#nyJqU?(>fX_dP(->bId=Mn5gvhdi#@!9VH0Z0Q3Z<$ zyx*jsNvPLO)uqWF+4rND;~UYU{h!RowE~lQ+Jha_M|v)#pn$sgIwN3+lDj+5?9fy9 zFMNN=`7bsc(7Hg$x&Js2EST~7R@zKg0G?TA(LJ;^0n!*q->;*1w(05^HwI23Vzhs- zLt=Q*EwDGT#P2cVhCXm77mWP&9WVUL!`sc{O+?=d5%;Z$`RgHST%`yGMB@BuEb8|N zjEE=fm2SgtE&MGFJn-l z*b1ST*2IAONb0lAG*_a=PvJ$o zR9rc!(-o7ZC{{?g%8ojC8ZHj9LdhBIf!r#=3&cCbF=~JaRkOAie`BYwl$!I=Q%@2W z(VH28yC+*2ArEeXkj$?VX9ZSO5NtY5y%~5%zV&quBsFayhf!nr&aFu4(|6Gwdf1|= zzewq)rdg5$H@iu`oudXof}XJ2{pYB#g(go#l+ynVA`r?z7IV; z?H3~^x$5xdg0`b zv!ynG8N7Wf8SmU_2J>>aJsU7cc4OYrf$5;TC!7}(uc3e~18hsOg8ryErcD5|xI<@( zAs%+~{Ts8bLM;t)5huDrfAci3lxZ53zf4E|&-=m4Zw(`MkRUB+aiZgGCCT*k_f1Vg zN3;~RU|IxY1n@(IzK@p8u>JSl&^t_u=im%_OLQd)7ogjESu5`4p<_kiOGg9t1m%yz zs~g1$>p>#u07wY|;aqQCtQdg%2y9W_y>X1@8<@b_L6S*0lPTi$YZKm{Xw`RK7xDGw zTem5UL@;3lTQ{NK<#LEpmc;aV0FNLb39bR*#rCRIpIdFj{|1H!+y#IfWL`@U?=EQ# zkZ7Q2ZtDubquq<#Kc%C^M-%_Q9Ex(F59vzba zY^nbZs6+dGLCeN=`1{j+0BNQ-Xuctgoda=1K3B)!@B9u+Z$Ezgxc?34e~(qLERYA$ z@9rtk@fy-R0#beNt!**suo{`-<=6FpF#b3E5Y0!!i^OLK@GIZ$udp2%K(yu9%RjbZ zMuM>Jo>F^r;ch1CrG9J&4!;~Ntv`j-%eTa7=j!>~Ts}xXIj{c!uz%0US|Rc9x*9Yo zuY6$U(dW%I+J5DLKs%q7tF2WZ6t7bSzafEa?%3?Q=HEAiEnP8p45sNKEeCYB2U!>{ z69of2O*H>}&TlmAtUQY8Dp$kc3K>wg=Hh|;M-}~Tu42ta%JcX6KGgeYx=v_bce~=& z^7)h5Ub@M^QOifAd*Q&zq?}*Tlkx9&pfv-6*1E$~A_NWXk{n=27Lq57s&ksOBZB?> zJ~jKDB4J8D41a(mvQo?#>L!BaCKp!(ll1V#D7+uTwBsnEXWSsP579k}&oWre53cgx z?e|7>UmWful~@p}z9jO!ZCooSue7OHJ`)`ByEkj^OAfC4wt!DhU1j4=z|!ibm{%S*uhb}= ze#OAS1a@9Q#cxre=6&$h)k6vKpyv;+)bsUlX*dtk73`}E46Jvgbv_Lkg^GXv^@}U= zUWpCU^?$qW`7U>ijwT!Yk9{<1cVl&HgT#NSdzxhry5@TTzHk2T6TH=KB1U7jdcIMG z_aNrlW`dlEXkCXbY9S}R=jNqS<0Lvwk|0Ts>PI+T3hvh= z9}=teBCotCali#>md3L9^K1Rs-2NKutwgZaRLCoz+k5suC>SiGsL51#rpIQQZ4%K3 zo*jCE!FMN(fPnOezrXl*bBa`r|B)QeLhz{B@H9y&OJ@4Mk|XcFV2M(;jUA~0L(E2} zA!us-6P7NK#KR9n-#7IYp=`WJu2}jfBL@Sj#aXKdKl7}KI`i2CDbvLDbWk=2pc2rU zaK8)){A-H{IEYZl)v)H0$<}7kaH_STlPniv67*OdG^Tx;D%<7m@(eNh1AIkfc8)21 z?u|Gf1%iMR9xviQJITrhi?5s(roJ7Xq*!!#Lt_5cKM#}n#pb0~gakA`z68E?=H+YW z@}CK95g(Kb4PoH+e@|H%GR%qR`~6#(*k5N`w`@v3vcK~T^(JPMwdr=t&FtZy?(Q0j zViJofkz=wZ?2J!6X{kU8u9?p^5VVxBd_`k*zyl;w~2g)4J_wpc`y47%-Nk<<&igGWPj2}F||FhlE z5J#vNk8Haj?S%mR`%ah#+OZ1e1@+_-6`06BbiULYnj=BlZ71eM{Crs)-HlST3srlaZj8JCd;s+#v%iN3|YcXt{>P1En!Jfm=l= zXA?ZSdQaXf$^FxrhOKmLCyt>?A`374(x^PD3$c>*S62@Yfd^i9~iUA5e?)xIt?w8h8Jf!VlRGT&L`bkDwN|blv*8N4KEF#+au+ zU}Ecx$O)`XF$z2W>x&E!Y%_z+&7~NvM)Q;MY>S#pB3HD!t|n`_W#VgWNZbWII&QV!wziF_CezQucS0I2m1qgrmIWc>fr<~UQH5N&MvdtiaPPk`JG3R}^M5Y2i?LY) z9;*KmfqC4lP<65|Lf0GW!tXy$LLJTvHSd=3d))Hen0AxEDC*v|3L<%SQyqtR?WqzY z((X&hnr=;#9bVM++0A>tefB?4VZM8pGo)9E zyy_cH$rUfn{U##ksxd}xzv%l$c8G1?XJ;@_=sGe5g4bv@&-3|Jw2E?;@ya)m{=~?1 zNQ>Jl#k8yY>1EOx)cyGc|K&xfIqN$)9TvSN&*jmxlyukCi6*MM8)$4S$H%D$lp=tZ ztzA4(DV{r)FK@X?qc~|hz($_8#}CN?;r;oi|fq#<;$oxx;p>PCq55E23a~p#$-G&t-5Anf55}R_aGQk!vmq{B#SY{(Jk8`Qg>}6he7wg$pR+qEi zby31<`_>bGG9;b#wW4uwJTu<=XYF-QG{)qC{)g+NCcR6oL^J-?S3_ez)WuY~-1YEC z%n;e4*t0J(**R}y7-T6fTDBgDHimz5bc*GJKw??cZv0n+Ey0WiLsr#g_gv3kEnjs% z>pQ(n@!(TRk^#M125x!v-}7;Gvvp#Hj}bETY7E96Ub|l`xeL^e&yI+>QIpL=0`O9u zwo^VZ6HMW^_k{Q2+b#OC9d#|MF(%}Kc;cL_m~TBT1BI#?{h9nNhaQ4qnfk$vL_(+< zk(%PuQ->NpOB`|`PK9Ug_|)YCNlDE0 ztc2+&>f0_}yc*_a8~Q*g$V{3yw#7vZNlA`MU4I>1XRyMBW}(=}`CJ9(sz>gng&r{H6MV{qw7Bo~=gXv5G%IH%aqAzlq#A2>(to z13aR8ovBu;g|#O7>kaG>+7i7YXRPOl4=+u}D zl0y&dr;ayH5;C-ltJNbIL=<24G%5qC4!<+1BEcMeo&FxWe^29Lr8c>lqskL!!CnA9gucu+D`l2iU`coN{`Y$w`kG_k(4%$ z)c-b10j#ZNuy4{qQJlqcUK{>diAzoh8f!J_P}0!$ON+}-^UIiSBnJdrBC!Wn{2!A8 z)dxtbZ6-bf{O+nGj-mF1%@n(prvECo$kT1p^H^{-t-tSXzM8H!d?fm8%#7LYL#cWe zvg&IoTb@CUl^TPl&*o*1v#CtNOW|KQqR%?Q2$CBds@U^-H5+}}N@Kd>8C5u#D4qVS zC1GCpeBI)Vm5Gyjvv#yu!A31D(@xo>Zyv8_UGT0>nM7mAyqb`CacN^UZa&R_|N43+ zqM?VLp1V+kMJi> zd=MPuFQv+>T%ejm-^33+9s6pRI+LfmeL`4@O>x~fz1rZc;PC6s_Vh`VtcLwWq24?) zq`zpf(fTH_zb1QRHJ6o6A(hj0G!f}qVC`Ce26e-t5HP(Pbk$|iv#2qjbkl=WS9?^h z%Ww1AD;s1h*X&N&4^&Lc8NV}9o)Eg5^Y%bQC-wIwM@PGz-^7)qZW=4xm@1rE#d*0{ zk`R!q)fpwd^%rS-7@=3`@Ns&S<_{I6voKk=P=!lf;QRMejM%2<@-MvS2XVA!{=J}R zA7x|pOJ#m#HHl`?y(gW6o(z7zmv+3#`sfp&@9ef~(W0fk)<}8M3`#+19JYQ=G6h?x z4EsL~?sk1PK&fjhaKSmdeSu)@2iQCnm2A1Vr$O(MVsA!9ieg`Dyj1ZeqsArJ5zALD zR_Nnx|Gp)?bkcvXiy;oO=Bk;b3}%S`oLENxGtFZTS zFF40?v!K4Imy)&F{UT&_buVdtj6%?dST)naEfQ4tfG%F=>4UD$4ie{(q}}z;e!}e< zt0$h!P;T93Gg+z4*-@JCjWRlD2QjD7(r22T0=1Hl>Q8w>LgdbN;HF(AE!s5}s*Re4 zW9NF_*jT`dVwqKcI!XVJ(M{rOWi2m{_a-BhpC(e?y;FA5PF5{e=S=6-Y+o+pPuOs$CC^ffA{&71oqzbbt6LHf|TLKW+~jNjfyh-#pBDf4abS6XikAldMvUD z*B-v-bPk?@D4Q>X0cK7S@^)f|3^{2`l|9FKQmCmfsB-5D7#PVWn3E9K(Vsg z7=a%;PO9$yhhI}!S}GzngoJcmPwU<>;dXX*Kqa&vefGG#yrO_6IEs9Cl4(!s31;Hy z>k{DnAX~xYgGkQIiyE$x3;F`6;?&f%K;TV85%DcdtH#pYD_D?O9?8O?P5E4r-NeVd z%5uk!j!x3dd);0H-@%>gpG@zTA90NFdy|DHW$Yq^EH9QecB&kA_T7r1$-?aXG~8^z zBhUP7#2;hQ(&YjI)9|D{=FOo>mm6~!KJ$AJP)bggG(xPg48{fReXsyn%vg?XL(seC ztxDZGzYW_d0e4JYGj!JOQVH6<~-yyGs!SQI1Bdxc6>vZ*GK>l|R42 zrVzs4U3vfPOJTV4kx>w8%Jpr0+DN^)@tE)E=r4_uMRHy%Hs=eVOb?ar2}HV{ux|EM zwzqexJb-82^cm;JP7y9{ zOmxhc(?7{15Aj)*t6f6Rblh$)Q7?)-yMaXahAnS$_hDhRy{;9~vn^aB!`I7=V}VB6 zsdF4hJmo;h$I6GILaM^Jfxs-p_xuJ_wj$FS*-CGXGW`!qz=FA(UbH|nYy;w()|>Yt6x0w%arzob7~4d<;VuDXv<^I zlgq6q5$X+hOYD-EJ+p`IL`27d{^@xtg~{djI1<{}Wnu6gdLHP)l4D(Gea(}E;y$k% zaL1^>F+h&QY*;E!4}Wsujx_K$i1l>SC%=z$0cBv^(5Vs8l|97r`Zg{RzOiG9$anIT zss~-oA`=`LJ$oeaOxca#16gLP}!k7ko$lvc88C@lMyZ* zYvO$qB<{^F2nmD?qCK?%moiG~4qWKNq`Bj9;=?te*xwtDJ_*FKe#SnYlVKMqv?7 zrJDCgl&P~dz{h?2%;n^WcsN&fUK4DaKWLrFZEsyd$()?DY#-zk7y`*DD41GN znCGfA#0%9|lU=kBne90R87-`Ezs|64qsjzFIFco+Lud~1O5+sDrVuf+m=vbc=C!Bx zy9@20qd=BLrfrYrpJh{?hnjNKzx5pJbhTD5RIPEV zG9MC4Yx&3XgeTJ!7Cau3=SmxviGsNJpo-{c-EYd=?}Rd0S@ z(C}Q!{fS`Qhg&OYS)D0s+m?$`ttlP+!P)Kk*1~1GrJFN%n~x`4_#}+QFk{E|Yo3*B zJ!oSe-uhHRQXQMBa67`kCB3CHXz?S_A0C2sWv^xwC-Z{vgLyg}aw0MT^O1sxLc&I` zGp~Ndu?d!R<{w`pB0-z&Y9UKl`cwAJ7s=peY*}e}XIDqN@ujxjFm)$qXL@bEpBBq# z`KoSvon-5}$g}-FMejEdYD;I(G9&RP9i22$)LTH{j8E2P1WR;!oO1rzN!bIVIG zH}i=xB=9xcJVRy|@(|LmErMI6D3T{nhm%_^nIZd0BsI+#g0)fbi3QipZ?t-=GVTf6 znWP`Db0>LxhOz<#U`)S$q(^EjrX>l;rSjz{6@n@lK)=urePD|qES+<3b)~-+rY!Bv zkqA@B4G-KMkDg{+e);v>IQQxPV%tzx-%!`ibolUd5rz43$1O=ZDW$$in>wdGx6l=FUA>fr z#)z+qQpv)IuA(-+!;8=-2_=Q91+lS}z*=WO7r`ztc;}ZiHbzYg#sq@?_`O9wd`1>6 zi)PIGQzacoF&iN`TQPbIjH1r~yxF+?Y5qKamnBE%PJeOWI@UB}|{ z5^H4;eQen=cfxLv%TcUsnYh>#Tp}Wv*EG|ZCzRiwKcO%6;@ZSm=vjEC@d{XBANk|5 zXZ$GujFQh@z#FA+Now}5JiL*Fr}9#AkDtD=P>*Q`t_oJ&YQKSCG8^oMpXrK$_1v%> zsoxt|n`2cvxjgfbD$9A#-`R}3Nv7ntPmsYuk{tKhOcErC`vPB{ZBL*;B)R#Z-k{eM zDLDs&O2PXv3D-%R%fPl@b9nE2aK%e>8}#aov>?un@|;a+GtE1t9NA%os@t`f4~o?Z z@kr7WW1aTa^?Ob*%4sLwO2F zj##XguOD1NYYr&*e0&fqiy&vBLJev^S8tB&`J$a=Ia?6Ag^3Z>m1&FzmT?49Jh6K~ z{5&W@?>P$?tXbaoc>+mQ0CkBf?H!GS0f6;$<|74#V81&JP_A970Bc1bMdk|OnWq$} zzBX4UGY0$i6d`=i8~dD*25H%lKjOkWWsXOoHT#0y`y*bi1tMO@a~>M;X@1xHVj7eE z99`m%A6|NR?=Mu3CQk7hSx}7S?wr*d23}WMCTUH2oF1ZF$WQ`+_18O!|zjMyFHlJ>HK8GdHL)RBaJ|115VRzZ~tj;~dKoLKeM)(ekRJ zaVD#gO40BfEIFO;seB|z$T#8Cv{XFYmi_i`E zRsfYbTb_LlH;Marv0iEiCCNl-9jJQHgyFMnZk!-(FW1SuF;2Iv&R<}Ma3cJ(Xm24J z7bq1xYjO^5v-aPELLvF^q^;RNFy_}dBgT|sd15RNWYeW zoxKipn=$^xtv=KMVhOPu|EbMg0Eo`lQ(N76Q;G_&d_qRd#V{(%*E!nC28wPZr&I*c zOvII9mGik!G^gAy7z}Y?U8|2Cd`=ND0mGMY2QBd0jpY>qSs50NtfxR&GOVt0S>}&M zCG4wN$CGl7Or_l%?wgZ=GH*`yh$$u0XkL|KS~J&z?L@7(K?Mcjg|tuT z4`JT*3ArI!U#s8M;iyFtfiwTO?s)K462C8wAY7ci{AkjCfm7$<4}HgxDDD(aA@S_o zF+>27)0O0>4rS2}nTPnWoA*Lzr&om_w?Mzq$GEM)a~3tldo}6lBEP&H*Fl+~uUM>I zW4qfeYOBM|E}Y$xQQJk>_xc}&XAe{!b|kN=7V9?qLe2ENaOfU!{9be)nZpTJZ1%%j z-+blh;xcSe>Ao+NDbnWPj&)j7jV6U%?`Czcrz zqL83$+6DJwJDUQx2V~mRciAN3vjI7zQTdw&Gyv?Y^|sbJa&dk7E*tGUvZOusN5;^R@hGeDrL2_Ac{$Kv{ZFI7^Wr(t#`f;V7%{}?opUxv zouzUCH?X4>5rwMKy1SH-zTwy62D>>9Naivwdk!*aqhYv0zD1_Qq zoI%-1qhwZi@`LXsC^dqlC9XUjm|;_Lf1>@or^ERld`!%q#O3>mcYfL@BJESPU+}GK z2Csdc+yr!MU4#TFIjp~z9gTG7Ss2TkbDFd2f)%e_5PLTfa_S|MuN?NpMaa4{yO1|s z2#0-^Iq&@s(l8sgt;5IJqdg;r`+wj$c4`#flh9(&s zoE4?zp-mqV(Vi_yJPa>-!JJzFBK3GIsN+5%lU|{E{`{P7t~^m!BOYq*;$n}u#dDl4f?j$$!-_W>jct4!d&2H5_ z_cbfiWD0$6bmut?NoAp@*8+Hw_kVuw3jFhtvU?v?N1JVA>R zkv`!;lTS#^T^;U^B(wjE7z6msB<~UP^%L9d<19F51EoYiI?Wj=Af znK-44u(AW9m{(sRSlSWSmXCkXDJ!c?mMkKte!V0`^Vx9FLRBZ2LOwcf_s8aQ8Z>*^ z4h;HJ2q_il4s?N5z>`EB{G``#*L#Z&R^-(LttN*gL%=$K^}oweZjD%I5|GqETGw>v z9QDFtEx1GLN}TsOS^r+^?%mEo-ATf8H!5~^%b9O=ymkwyiTmhi4FP=>LNA9~CbOlDE_Sz|F)r4XooLRkDUbM5bb*BI_VYxc2U3KoEWW>haWPXisZ(^PkQ!Gw)& zsS*@!&C40VX~wb%zX;*n_&n>j3D0y*@E;nkgFA1q0uSX8$n37i(h>2H^0&8}54Md+ zuC|}9o(;rYH^_q4eAJ4V89?F?U)^*R?gq~{s~jZ32uGV=gxu+nO>N&4iw^E$Iq zi^%POj(fGme71Hmt;n~Rz+X*5LSm4M-b8u=&U4rI+?eZyW-JOW7r8TS`CJ7k%wuai zSbl~`@n%XSH<|08)^wJ|t7F4o!S#T<7JNolmqJ*0c#X#)t8X#dlFlE~s~y(9Cj`YQ z5L<;f;)wM@gXENG$Yn@5e!)0}kXy8jc&Ql`h(k)RDzj^wP_yPiEv{MiJMo$&OlJjK z??QP2EKIk-uTb^^9lwyrV!pYn#hf$Y6x^0EerftJg%k8ZNg7&ODE3>1I4m-hF*t0$ zl*4ej_%s1~Jg_tpX8a+4M(4tF-0~yz6`Hiyxa9}$9pSE5C)sykv2w_vqK9>m1#vlB zMfHSuNvK%envTqMZ(Nw~^0DZ%`_~snf4abBN@4SRAsrnaUj)FF&gQqt$K7{T9~jxl^K$Td1AA zvTz%M@s#{__vj2#WzD4596xBcGdb2bb`q&~?FSXkb<9G-3)GW^+(WlKKC|kNSa78Z zRL$4l4(&H#7&JS~8SRZ|ye_2>@>DOBP=g7X_v@Cq-Nt7GUWdN_!@X1eC8%Y#((kHA z#oQl-xM;n9ty-dLh|0vjgL2uf)|=i(o&z4E#t3DQ4wv<>4{z!($bmf-;^NSv@j9d7 z;wJmUFkChfFJ0JKG~6sg<^`)4a`7b4@8xWRd4icdNr`?#oyH;sz!x4aauW7qH+yeL z=(K!8i`oGXD6;PucuoMRN~2jfDZ6h{zuu=9=(x0t-40MOuzXK$u4J=i@bT~_K^l`bci}CE=ZyhoU$gM4 z9}+RVY#fMjO7PEvKJ_9_vftaTP;a+`xnI(O5m0xK!GXHMWa$74iqYV*_lB#l0^Q5y z(9#-oZsmquCZO@Kr}rg}Sf(3ki}bViS1W!GL{;Cc%L3TpDsLa*h4&>xbRDwcbh&38^S<~;r4c_DMo`T#u=q+HY93f>;A znuA%u_HeW7VMk#g<~hi80!QfQ*WBP{v*g526GlkJ<`L^CxW8}bZ==&?1`B^df7*6P z0qPpFMbcv7RPN5M?6WY(Hm_N?-F@JapPN2iY4H+D#cKMv@NF&j#phRH1k7_et|vUj z(D3)C3~FK+7xNXilS`t$+Eq4QAlH=F{!cth+E}Tgdsrqhx2=6Lg4Y>2WUI|M=j+W4(4m4HD-q=HWTM`h_q8%FpNjdQCL4(@0-CaTB8500k z{q-I}r?_Qx?QEuy%H|gf>T{|t{lW6H2XnqrXB;HN$Y9H(^K&26B}QZye9Hxt=Qdb% z0jM)SH>3;T1YCEA%~~6Y^Nzg)v}z*A?Xd8l{PHP{4@thk|nVkam_+=46l?;hN;`uh0X zgDr1JVzxechy+3KKSb|#{1**ECT*vPagm(^@F3K|CkSjIC@U}!uCXQsVAr}FjSbWPg;#RH;ubgxuDX#Lq1+bm2f<87U;eu<5xS%?#2Ga^?p z-Q8jmxsq+Ik~@$Dn$5jrIPI;y%>c2QJPt_PdL#Nw4z3hUEt~L|1M4jz3u(6vTmA|v zsE?S!>xAbf1``wQQh}wfBv^r;v|5wNs2=a12b4de=D8Jb7X2wALnEBsb0>Gzt+@=Bm#wOjiGmGNDB{9+7ML}1UWhBb&M0M6e{+#^ zf`#TrhZ;|wT4l6#defxMg5&=N$N#0jSFy%UIXSbi&nSjL@POHtix&?x=+OhTZf{Tj zho}$tXFdc>`_%y4{Kp6~I=hklf#6v4&Nhu7vi`d!Ge%E^IA`(0u7sb4B9U8XXW22L zen>|Xmv+w8$lTnJj#N-lx?WXOv4ZEFuc6{XE?79v7K>Gfhc5I?)&r;(?b*KVJ%6s$ zc^D?Hb#Z!jX68JlG{P?Dt@@(r`LhonmA3|Z`w4A&$FJkzZJWr zdkb4;D{SwNh+#`g&)^P|w+t+mI2ePU~j?iF9;de5tYDqVv8uLrkiWzY?vi{nXFFzJ%AX4VLC-K8OpgC-Uyz z$X&#ZI3sv~Z?1QP-er_&!)2z)*mlxRFG=8wb=Hf^R9$yM-iBv0@}_;U$E=$*Rs)^C zGZ6<1-kKbFwG9nWg%(v+7ED7Ex6Z3?uVhn0b2djJBzUw!jL%QKxPB0(R*WN9c zFEn%C7oKX`c-!94ZQuu;FOwF?moo!R%ArsLYU$_cWXUvXQutrcnpaE#}8<|TQ!!>7+60i2f2x-S}q!c`hu}ZHVzCN zy5hMF*rd?PD2{R`)~rsGUi%W0`aezxFQr^M0n(^<`J-E>)m{MB^9mEvrlwIi2HaYd z_CIJo_jYu4PAe8~>{e4zh-9RQ8~Fd}$>;DFQKTH2ulFrgo3#TJhBSU(nS~2G`?i46 z*!cMPc`*@Y5fh*bEP}N%@mtKG#*W4MDZkw6sCmD{J$psX(7-XQprDXWiX*NB`WS3% z-1QRetRH=dL3KfPDzTEWtwingiKw2@h^99$9s|02EGaitT<^ComkS0fWK@fPt9K1c zER#-_S5@z9O%eP2m=qXJRzYBAXaM>2F5kt`4P~JiAyGO8iXLFOvJ>uydkg=2AB*c7Pm_6OeXbul3ER5w1)3Z zQVLce;OVyeGmt^dN;gof{WO*d{EV2V$Ug-?!lj??Pza5PG{&QmzULHJ{IZ zqLy}$D`1TICEY!_P<`T!!S!}wbFm(x=hjxV0(;$SV`IMUbjn*K(QP8_kD&ZQElqs? zS@35&-86hd?9Z>-SB9=tdnySt4ztk8>BkOR4ZLfh!qk_SD#GEPFvtfQl|FuKrc01@ z02bT=l}SJCh#Yw+0qCXd7n^yFXNIODBB*AsE?R~b;F{> zi#W+XFnS>ce4?R(Z>>z(i6tn0I%bRl~PQ_x^jsnZF;izy)x<^kxFb zEOCa06F%_JeLR#gY#p`4Q79Kz2$Hn_f0VstSd?qq_l<%gDp&~8h)8!g0+JHa4N45% zor5USASKPv-9yKqBHbMW3`lo(%yW3Hb-nlfyxaDEc+W4c1q|EF$#EXX9{>Muhn}vo z((^ttok-P8cBr=}M?Kjw`zj9BtY|kcclvhTZ7xaWci&4aW{M^DRn)QZhz{pJuEd)V zGU;f8_*gY>fZKYw)D&rZq_X?6%lV=uoX(4yseSDv=Y_wh%4K`uN7n6$}19x%B zRGZYsDxX^_p?wfKspq$R@mf1~==V^@I%`v0Lf5c~axtciVbm|6oQc0vEdr#i&VC>=ExqBDy1smn$k2!;T#z!8%eniSifV0vR z14CC9>TnD{aVr?6Sv=NXk9p9q&cS$(U)`FX-eB>#&{rAS7c#luQumCJtcRyc-3@df zP_!ct%^M*}c-J<43H2ZP8v4`=)vRX=r=qfG%M2PFHefCH3Grfc@;chuloF0~Gk*9L zsx#!~$a)=<5tBce8h*Tbu{@#O{_2bLTi0FggpS4I^|9?P_-f05PQHc}O&A53-tp(p zA3_%G<+b_2Vhf4rwj{RoTELY$*+jN>AgvZx$Ywq98k`P=Qk@eewayw#g|Q1qH}JM~ zB&9n_wQKnm81xY)w*R?n9^6si7`q7%xr=^9k>#>+#b8}GCkih20gmH-OqxF0iA%WOhpj7(woA7e_yxSx^QHDiito{d6!DG zm~3@z4cJerJU07(|IQ}Uov5)L3!@Brl0|FJM;emZuU{8C%U0GWMSV5Mu~k^S#}fq<|AEPY59 zCS)Klrf@BG-EfKwNdDazt#H>)YqPbPSL|kNX~ot8Bh%jFk5ySn(7c(+7t<$?bVHdG zT(pO8aFQsc3DMsBb;gZ`^br%iYT>n=p}A+Y@F%WUKQ}0_f=>$2>k~ge17n-@d%)qX zmao#H+}hBW#A7*;dndV1qd+aL&{t-fnA@mxcLa(+&p!$6vz_KTM1I`VU_D;~_v8MO z8whHNdxSOVRvH(7Gw1$>YcGc%v|YE87!9Iqv%%_D(bAga#d)I}Cdg^2Ue&ZmiGiUN z-1bbH0^hY@_$y`5Q&puwH<{t)1;3?D?4>7>!by0q_=TFK&bQ)qSjGhK%{hJ>9VM>g zvEqUcZw8`AmGC~>?fhBA4LcK)L3GlSCPQT~oWiL-<>7fC6pWim+@z&bXMk{Xu9RBL zKCIUhd;DedvfAP95t?oyxV0-xA@KYhHa6EOBCl%C>dX6-P?-L)td!-zIOzD zJUgllYTrJ7AR^^SJ`{1ZiEaJolP=?mnbFM1+flUCf2ITpwsuBBnZ?7T2vw3Dj;H5@dLmO9 zi9N(Q8sC?+N-Yk?d>rz|2Y;?@q&827Eed$aQKapg^UOeh41a+qPfIKM!^`3l*}&LZsq(C9qx(LLKWN*s39I|C0>?}k8o9%!^SdoF() zoOtF-y1cz@aR#&h0wUVCRFKNJaJmrBbA~FvMkLt%#)$j&qD0ArT@R*@lmDjds9Ndq zPr@DtS2v$K;uzzAOs}o*n2Ep&L{t0^Up3~XV|73=W6tDJ#2dhQQ8DuQ)M7|V{sQjc z0GKf7rtAZ+FN`MozB#s(vIjHN^n&@TF{})({l|_IQ?Vp3mi@NYd*Ty$>5*M+ACYjjUu6|sLeJ==yxV=}YUb?WdYeU6+$^cSGkhijue`GDii zM<5mGX3VPuZoxW?qEIz=xd5=&7OC7Q>#$~L)zkhQ3}=};ome=sX$&D`to%4zsl(0u zd)M2isn$;Wxn~ ztTk2FKCjgC=m|wf(qZvdd+0Z|sBgQwt2Wm4m-8Oh-cQ9IyI88(JI201F5h2n-^TWG zu~=9B!F}5P%zOE-xznTR(Q^xod9TL=1Uw&p_z9I>dVgpWf_XZJ59vJbA=l#{FgluA z2_9gtz+n|{B^fXHHPd{$$N$XFm+*OfLab#&UUE^^dYg9EknP3d`-L~6Eb)um>js@D zO}cE+Ct;yV4d}DiVvqIkI*>ihYQev1$k;IaO6>KUnsp+>h12S1`X|!4oY`AR-K)ua zT+Z!r0tRx%EcvYoZWQpqpK;Rq`?o&LB5t`j9g{OR-?W$Su;N0)b6T8CR;dhyXn*r0 zBrT~Ww!oHO?3fL$J6otE7KI+>dCAMVIJj17O#q;E+`wY!+g~Y>V8{%RsBrrXp~&7T zE*!c8q0+@ilT-Y1T?-2f!@XkIcM6WXSrlL23f~K^q&c1H>Iy!y)U*|{cYYktc%30- zki?~*qXIO%DMfhabNT8};&&>VwQ%rM1l}TxHuQ-0#6266+wKx1LcQ~_Lj^%X?=Byw$_@v70 z`x$m97mJCv)c9Wz!R}W~RZ?S)3~?88t%RR$=Hj~Jt9*NbfrAND6xK)P^|pUiIDh`J zK!P}+d=lkQ+K8y%!IB;jY)kl{ziH)EAJ(%K{M{dJ$8d5qs5rgSGh$%k_$Ur`xLii;gHn5L4x#+THucR=f#q-aqU8`Kw1Xc~Ilnr~Er`!5f|_mz`R zWt7#{lHI&Tc)`8eq6k%tcsjzG`k0ysmSBD2T%onJy$)pGZ^Z1P-rHY~XSE-%D=`M# z78y}|{CkA3%tpi-cu)_v`9miUb$8m*$=>m%H~N*OkDK3t5lw@hw(f#Myx&QT$!bvA}i5bH`>-21uI4;HNwKx}t^-~SqNf^pQf<@R40?6m$&^7ru`?SupvzmPJJ`V~EX;Xp z4>l6NFjz+q1@mQ7-LM#Xc)_MhY`J zlG_*`YGdWbqMrSH9dftIT#fOpJC$}oLV=>$b#q}K%8GWnIOyWkR7!1hy*|lGK@VwX ze>1f9rh=!kXnv7=8`u<4hh8&Xr|e-=0Uj-!(irLaJzRs5b^kz~)iF9-Ja=SGO5?k^p796!x<`@oDm zTsj%TmIrieWY3@N{@F5jsP#vrd6V6?H`wS_nSnH0IAV^RD&q|`K0f0g(2mbEdV2rDGelCnLZ&lTp!*vm zT?ojM6y)Wf2V?CAcgeGV6TgKZ#miF*7MEv2b}2`HOSqWd@A3CF0Cs+K!_;kzPJQ}< z;RDkU!u#p(uH4oKx%khsrYY4KzeC{KOd2cVO043)mhPM4{hh?i5SKLdoiR3QXdkF< zN`~m-VELio5ZXch=c~( zGS={oX__ZX?KnH`VHkeu_pFip1E(JkG?kZap4$tR(>V(_{X@n?aIW3b8=J<_p5;XM zuq5wjH*z2|fxT%r>gKE0m}9Tx7fDFXx37U~1O%a7O?2v+<@=!sL_on@8iqth zGU=Hxv!E+Nl!y}b(%63@&^ zUmz(&JdSy;B>110b@a{}{dt-S*Y3>mOLo$`EqpgX{B?}!;1ipu_eEoO?w;YZ5`Q2r z=XnPE#`G>;lfkgkG-mpVGCM5gF~%9*)R?I@gMz5TirfMQDi_ykv`Af>ZVB74-dM|# zjhTw0{YaXLV1u6FC4Ji;hv?`L7QK4o24ALE-0GHBYrrG^Vp~c zI0l%`G_hUc5$QdffYHI*13Z#UoH;CX{?uD8m&o2ne!?KuZ#Y$tc52L0+IjU9XGh2# zC@^UWa2{NE3{{JC|KD7RFxhVGh_t@W_gwj^ZD%w0P2Z(7y2td(*}K`y7WeuP_&(xOI3PA1tGO%Z1v_N_2?02A&p$CDzDZ&`+m4C4jDfN!a?LN0) z6E&tjp^MH=F0M`v7sk7yY2>zect$j)jf&y-8_@#mlutn4(n#`(Sp*FCA{TTC?#Wqg zlDo5{0PLTJ-`9(fff)ON&^JUI2O|_Mi6Ev0bDr3=3)x;tAZ$*R{WDWiNjJxf*X-)b zpJD9_Fj*pZvSJMeRu4fz!{T!ca8{O6n;a4&zoaQBs{!+09AQa&EU4{2GkM?TSW&Sr zpD>YT_sXz29c!jcbm4C_VOSGqa_itus$zUvT78{iDPR}yn;|V+8cG@?t_E9TG>R7O zC;7`5GbdCHPi*dj8Xtkv(E9Nf6HX7o5eA!HTu>+9gf*hsj21l**S!S0w41LxqqdTwit8dH zTeDMwxKwIrBeBzQDF$nrP9{%)uAvi_J!KfEAo;eP=)rei_GqqxTQ)L${k^dj6E+y> z0E|dQ)y%~wheuT_!t|qy`@RPs&iLx=Nt)`xU5kZK*EiCo^(v!dxv+LuqRc1Qg* z21cNSL=#_zG0SS7RYMr*s+$Jp^q%$yNZ)d=F2lPXUR(6|vpXLQWuoyz+lYvWJe%iM zu))ki00Uu!-u_4Owby51IxL7Lkz^HJT-5aF(ot8TlBQx8A@=>?1`K8Gjgl9SmKz(O zwuHbndVz|a5=Gmo0khtbrzNug`c?b2JQq_XQJy6lIa|3p8x^=1 zI698x9X^aTYS0Qlk>7b~G}SBe=E6xhu9%IX6+f5=w%M+hZDvHDZlgX;xt z|AZOL3OJi1uYlzIQ!8yOt8PeQS20*48qBHcaGlo=F!?;Ye~LvP3;yQea@d#wL-e?< z^jPWXbG%xV$BHzVl#BPmk*7d7>Ah4|g7AI!GsXQK;XTInvr<3%gQkDh5HnD)wEwnzen z)wvyO=<6sM_oe~H?h{!dawV#$B};M&j33aaEPqGO)_)q_R1d}}{EdZHoPCA2)8}C( zc1uZ8uXok8!fGJnmQN#(oeHpo<6vC@r-TNbCc__nF0se^H~=;+1Q!dnZEe50I$M7S zLBGtRNfq&`Ko9PNM`fmtoAc_LXKVJy$7jGTIRjlg18of~v0|N;>j57qXJi_m&&QRf zWgy@|xLS1|-D$Z&5GB47f%*7kO^(%2PRT$WmBs3L@%_Uzyo zn74T?$BZZDTIGBEb2e!dQ=Nb>puNOP#OsOU>5XxP%w&Pj1A`zCI= z><;^LX-8QQ6_t@1Yn0&jszXEs#Rk%3dzvb=5%?_Fnoo&@B0RY1L#C@BV(|9kd;a!L zPWwmpO5E};mXBqcZ_Tv|(f$Ym{9J zgw&0}95J)*zo@7JBd>D|;H52ndc{LYWm3LJFzADe3pFM~nm~u?6efL;Tgyx`5~yNM zZ;kH-`cx;gEaG82jHU*S>bF!2hv$ap3qt>c2b$hC0{|0OyuZx|znOV_wZem6>f%bf zgC&~^$ahLf8g{$vBNVXjHV=-s40mezVJ=s|HqNL{XEn`n9lsB3pujh=ALGl4zXr8G z{aRC!bi;Linw^a=KuRA6R=&f}EklSBtj@G!F8-z6+ScqHM)2_*PR`OG3LCqkXTZpM zzh1mRjRRY)XpBRm;!e1Z6YvY4*d&q7G~cY0c)ioG)q`7~j30-(Z438)DTyzeicU&8 zS*?kK=PBt`dAA-CzLbvylVtQO+@)Y?sg)6;3Jl2dmiHSL|0Wp`pFJ`>jQ*t29@yujLTWySs}@dcyV6 zt;EUADfR5ZwLvBw0|&!OA2O(9lhDm_;$R{%G;wT{3GvTEV5eWJ#q{*1-o>=cmaGzy z`(!us{vCXi8qBL}aB|Xz+>Z=O;;~xa`{{GCt4H$mg6CxvUN$gxn@kTZGQ_buZT%Qe z|04;!(q|W*XdWkr5-BpTN5q#GHebL9ZueZB5*~JT4{&yK6Ibodxh=JJ41_ha>Q)zM z)}Ex1Qy}C&RBRSA?c`2u(q0J_c~7Zy+)NKw=!e35)95wnWTKDg<^jqFc*eV%j2Si3 zTdS+BG{S>JQPr!1Z9Tl>HgjWHjMrVjvahHpYwD|3*lVf@9t3bd*sNtJ;OwNr4((!8 zrJ8x3{VkMJ3b7Thas@)#_RXuOVKf89z+{iQ=Th zF3})CiO>31N2qV}7SG+juF?ia*Zn-Zv51G}ep}_ZY@*=dxc&Fx02K?{narc#hOh9p zA51kwa9~k|r!l88?(K~haVJ%&>KXbyJOSJBkC zM7`5;&%3Qr(`$r`(co@A#$x}t zHJEGT3AWRF0k?%EkGIC>hQx;R%sLd1r@)-b`Ks$ev7C=q8+*VgiYf_Ans4$Y@delo zh#ClNnDyu=`CpH9(L1qANn-~~Wkuzf0po0=@^$Zo^YGb1hhj<&T}T>Bt3yKE(bE`} zer!WB_Nv`46{0}OZgaJSdbB;4zz_!!R*jRpUR?VLLZW*Q>D~3M+rg2vRg4)jz@dxwMn$Z%-5*!@@apP#>ykrljs5h~wr_3te zk(`D3Qi+(NgWWt&{2uCJ}x|9MRIxE6l6W z_uAxJnin=u?sR&A#!2yI(_azO|3ZuAy`GVH(=4<(i|=lu2p+%0_g3 zVOmirXG}CdAY=eD8?t`&JqT$7A8l^}K!JWFl`zq|1;!4ZObE0(`MY$daOdb=zus=^ zc@JrP|K?|=mb$~aP z=C~|H*yKVlbP?x4zkx^OWre-09ceuc_zg(W8A8Zs*Tda!@`&M-v=>tM*^UJTV zN%3f3N%RYKd#9pfKw%`{_RsZKg3K)P@u^NfHTzQD53=i;(42nHf6c-3wZ38X`Af&@8l5>F{&d`cY$;%dA!H zdl{K^SC>=A(5`GLR*k|=3EnljNpCDPN(>BG);xmD3f)V0IF*#-6cc%@_AlZN8Dbf8 zM%D|*tjt`0gI9=B>~2L^ILL??q&eVFguDRCZ4WOG-+n&k-e3bIQ?jOYc%d2tz=86Q zd~ReD8qaG3?vQ~#kW2tCdQAR=-)0<4ETYOXUdP{M!92aG;At$S4ZHkVbF~oWBk?;1uY)~*9R!Z{CG-QtOJn%g$Yh-aP7@H zmTB}f>nNOBa?cj3(N0;H#yG8rTbd~eryY_UK65!(BP8{(N0UP-1g}pkMu1^2<2{R3 zgGP=9A+t*U+X`_D3l+#G1W3<-YdK%%Jc}+PN->W_#8nRLWzx55iN_ddNDz94b>Gk+ zL;>+X{(aNEWs>o*FKtHZWjYS44CU zvE#|FxWk{CfY1aITNpRmZE6D;b5aRIC0#7lxr;wY1$Lq&+frKG!zqJ0lng~YE;8lU zDM#|`CrL#q%I?7Pu6(vY{e!oJs00Q(?a?g5y>;;@hUggy;6DQ@ovKhO%Nw;ko_~V=%k=>@xx;fHmZy_;#l2I>EkSgBR4ya+X2 zSz6h?w40Msqth((t{?VtE7q?0Z~^SnW=fY7*CN_%`gD)AMqFH9F&PxwgPM{{>-}#4 zr;va%5*@9gWjzl5BSCylMf;+DzR0v^(5@!>bx2yXy=2MI3lZ)5?$yJD`Nl+kP8wUi zWf5JX3M^4V;W*)48`!vl7Xl5 zyNxC{RUpn{(m{x24UHBXc(i4rw3(ti7E83a7UPK?5He{?E04ya!|!{yu%r+HWmCS` zw(n=Cvx7r_=eL0bfi%h>0tJ$kX8RoVj++3?>tvqN%Oj5!OLzX{bL5xcmR{Sb447gW ztA3?>;_%dp9?4jl>h(N|cG`t3dt}pUBL5c`0X;q&bY&^k3y+pI?`UiM2K;#-MSZ;a zx`(S4hdj2|oUdQoyl=4uF5xs`DB$c&Nk}WQ=+qb#js3-gMBcUq8IZQyoB=s!ZUjuk zYCVmtNQ8e{XN=Jh%*k{L)M)S0Yx2$#FCZ1Ei!6G#B7IN0+HS=9pv-A^#;XqOxW-CG1?7aPtEcU`Q;OSJ>~Ahnir<)AS4v?3n_FY-@5s!rI>k?}e{hF?!CEQ)^u zl=0zqX=c2xu{ICjGR6F=@F6Pu^JkN>=tNjtLFz1Hg3BHVj@PFwfYIAVhliZIxMfN# ziMIf~B`H%Y@`~QyQmYIy5mAEUPp6r?lzuboc|y^;dblxOO7KDD&Mz4{{N6Mkhl`Y) z5eREkP#b5S!iNoIt(2=f@Z2jQn>4ACD4E}(tJmGs=Af|KNeW8ZUS1w-ZYApijk9Oo za|Z#OzSlm$LLjR&ur^(QtGWZ(pD_fvYsq^C0O!~w2ycABAoz%A(CNfKu5Wtybp{#P zYeqtJ+A;hYybzSv@ELTd2WR`nocEkv2rKH$qux|#ne6|kIAH7`B%bkMA;mBkQuM<|MbA5$`&Cr;QUu<2%-6J55CW|7`tK7kZ%3dmY=giRS`r3i zV!9KaA3ElatgDP?aLb{ zd)@JkR#{nk;8B+k+x6ZXYr%tQ)fy@4B#jOY{WSWr?<8HMQG|3Ruk*TOFrHz4&869g~nAZHNmjTqtj$OF`6><)aCrl`W#UO7&^((&o1KKzj8GOmE zVa`hO5l@0u>dkoTY+3#rFMrDYf!xDy5xm- zNl#rBq)Ld~ZglS^qpUUTmN}u>gLkXiXh##=I0#|xLntA)E0(@je3S&0)A-9M>T~X) z)vXn98>XtP9~tc{gHT){*gjNDJv7G7^l0j$6prlsvm4bWtj+Y@CTjqE&M*-opZ~(O_1Kc*w^%TS}gy4 z+R-y&{03DzzPoEUIMI@BXB%-3;5mzXxr`5WyXU5DTz=`X&`Ok6jt%{L|3%{UO0O!r zAEG_l?nYMm)NsfWknzp5cL3dLQN`SZU(Knm?ltajNJX7qjoSB*F-)*VwAoU3j%P z$R~Rq1s3bKZ$)-2PwxTh<$o@I0F4G;Rg8ccoNP2MzW}wn%rTTFKEO#JAFlNt84ah^ z+PHN)KdsWD1}d|W^&=i3rhi`g2G3c*M@1z`i~0>X$T7TOAkFidtJ$_V^w4982R+&1 zadT@glYf5LuXvQ$##@{NOiwsOoU$%fPBBq`xrO1)_?Ix>Kf>|;JnwE*3C@`ic_ax* ze3<9pKQH@MlwBD%Sw~GC$vA(=HYUV^J@o+yI74)@791x%rWQ}NFsFkC79IZwG5qEY zt<>s1?LRNa*n?${td9|gs}y|ii6dnJx`425l80bM&(OxGCGKvc(p_wfPGiezsj|E; z{zBI*c(m|-j%Ec82ZPI*{+z?SO|b`e1P}&UL%BIQRxX~+>j3zBC7LF%0xj^?!Q;(;X`w{o^hyl7pg&6 z$?VR5zYYX`F}G~KTUoO+p6k{^uM7TxGynbe58jenHf2Z;0mlFN;k_}wuSq@f{_L{R z_&)EXy%KE%EzuXM|NV8B8Dkr2mVoPw{_EyG+XcElA(p_NT7v z72eGQGM)cij-L&b=+!NwsjuaOXA~P26XHH_N0%B}@5ywetJDwy_^-Ff=zrf0Mk6Jd@41n_1NIr4$38sS z$TmY9gg}1dQ5z=-DM(Wg_x>N&vY-CFsmgJl3^P@HNeTk+ttbEM*Syi3>l6hIY`=j{ zzZ$e|QU8B${Q)cEFicy>cmK)ay=dxt{<|wIcyuNgt!}4hm90;)GE@q`#)E?DnPYPBTq@7XSO>`kbKN1who021u$7g%mJO;>~0;S3$AmY)!q})m~6% z8fH6nUN$(Nm0-=kxzd0{4iw%+Hu+{RBFd5XW}C5K%AsTGeM0P;}#_hQ=NDuuE_ z7bJ%$=q{6AkJwGQTxj<;D8_XArtoD+ULyLC$7uq_89G@Xr$LE&5P_WkPIeJNjJ8s7 zlyjB7TwSUMkxb3TXp6+@%Sc$$2V&IM=FK@bla3t;;@X{htAUq`{Ss1&pgZWU=B(!` z&AId8n$>tMnQf5?G}miXN;HseV2C|7-`5$V6*8qEX!J?LziBT9is&B{={^6)=V$5$ zl^Sueol!DjkzXk$$$UT5?%PJ)NSv4Mz>sZVWY!I@>B#_^WUSl(7m$)_oX|lIEu?2o z!pVI!2UwEI@vcg-On!oi}MNAP`yu&Ye~{m^mFVR5#@UEzm!cY z*R&RQ1tUjCP!&pO1nouhnRHi>PdWOIgO!$hWv2#Uv-kY@{y+N16%IH~ge7zJ9`#T$ z6w-}C5r9>$f}5ELLOXqwhbmtAUM+Vhe}*Pjum#S7B=(o-<`j)Yr8||`&G}w3pTkDV zAIS$k*Z1JA%|?A1c6I|f4{`wkX-HJza&vHhZdULM0#CQe`#QJ!0p|7fxb2nkbn$De z?|uEARfJ^*toqd!t=%2~sM_Fsys`v#?c-I?3YoLZ8B;(Y-I*?MQBjeLyvZt5FL>Xi zwGca6H8`=*TjtkRk+}1XCQjQ!O7a2r9KxIFaEmLcM*r@2R?X=0JK7C1VpLRH&qLE$ z9ZXgth3)>WY5j2f`v1GROr~#6CGv7T4`#+=K4deQ0HYA~>Dm%C8O;Vj#1jeugu`YU zNiF2=?A+I85YKIb`dzz~p=Wuly(zURltDccwhD=e`3V%^ znC*-OAQ}NQuIt9R1n9eIl+Jc<6^vP~vT7rXZFWI1hFsL8e{vD=xnml{)E|3b1WF4> zQ=w!Hj|zs;uLqUE^p@zv_Rx5{BVx9{v^VIM2%r7r7to*RO{+!^iUOEV*+f-O@i}9n zyvj&KcIDA{DmJLv*Y1i?v-9VG_YFwLjo#biqbSbLaRBf`%;Bg4-pJR;>(?|qX~EfL z1}#~#n+DY+Zb|%h0g8E?+dBY0%xgQ#NrK7QdYt64J?{3qMDUS3NlBt>XgI;@`@9im zt%g$VMv*?`=@cA&Pwer7@1=t0y8%-VG{a#+oSU(r??a0gD6@^}S3n+3d-+AYaJ5Dm ztzTIHGH@>*Jonn}_aK5aMu{G5HAo;han;A3tv?N-3`&?h107+6FNp}?UBaNr(vN@d ztFC^<-PvARqa+BG!rep<$a-3rvM5TQ*zB{ey?gw&AiC}O{nx6}RGWUx9GhH$+PDbs z=2gF;aGm4H>QlB6D*XF5lT}UH#ur%uq+nO7HQ3%b-W+GE(Gq%+1#YA5obOOW#cnS!K_rQ!Gz7znK%gfDug5>}@-=Omf(snQyDiC-5aBm-uFVUC?TJoa> z+Bpd?ISk5NT|iTThFA2px=xM!W3k7!wk&f7X$2O;s%HKq)f*XO7P`)Bjb`Ym;#XYA zpM1=H)5q&GhuFr5nzq`^p&{rE^V+6rg*VYJ0+aOv&>Q%*WA#Rr1|ZHHE_Iba$oZek z8&gp%hk;e^_0bXDY{Oht^HH|N@d-KS^}fYa&HI6yW#8mO?GES(Rh3FWWiB)5ni$fR zryG<}h_0WCf4aeTvol8)t}DermE!wD;B_09kade1jrEU{jL@=D)X zVzbCyi}CE6o6qRM<>=-6IVxSG?@Kg#hB@!~59V`EfQ609o%%VuX*btUYqH$V-2<`H zZ*l+I-kJk$(S2k1A?K)Q*mdvgUE`aknd z2pON&0o{;4B{+eg$<-#HU32MHiu(Y1x+NK;&3E=IXY;Q%;;>*7m^|4jXh|gI-2@(S%%9?!DO7}XR-^NJe_UaE;{?cmlH5HfvN^T!pnUY zqn`!3f$d7rg=Vs<12k+v5AJ7G8(%BvnR0ke`k@sPQ)%LS#;bI#tM~$eo+=_NY!30U zYkJwqbw}8Fdu8_j>NTghXgnel?pk$%qc6SMh@M@MYyfX-YfX1_pZaVmtjXyJ+S2!xqTq;B9Q)k;DfMMFIdQ>km<^YZjQ zYX=>6rN3R=VO%@Sm2l@jM*$xtE)q_x_TPp@+Rjzfdad%{J*{X{gm>@Q7*|+n5}J|6 zU;Y`}Y?W5JV~7~4)Ruq{_;Cs8@1E58)iVN6D+T`${W{~Hm|`v{3N!QLjtwd zIqAt}2e;JoXvxFXPV%cp(QJbgdhnAl4$1z0rlDM8xR}#J!vjj$hT#Bxl<#KnztOf| z)5>g}~p^10-6`H1O;k^ zT1*%jE-SJV+`raY;KEG>q)Y0ClnT%#0uuKUmTz>f697D8wkHhzx`krkA;u5Ubxk?kUbIRx1Qr zeR0D;FAp6Z)Il?xuoPg0-5grK-96o92lByaYDw`7E$XL44TGBnppx_#$qfB(|Cdi- z@UZ+oXiMCe0S#I34I^T_o-X$}R>{2s(^!U4uamCTj9! zpAuh>l8lysJ>%^~bA|o!WE5sw=A$y-e%hz|EE@-L$sKssS*R})cDh?fo%_%@x#!J6 zbdeJoHiuhtJlc&sIu(#j&>YzqE7)1tkOyuBl@JG^uc&(+Z(9QiuAwgmMnAhcJM%f1 zOZRQWX%tUY8ug9qa5JD?&gvBNj5Rozbf`ac!1e)MFE~|thP=SGZW^*Un z(vuB$kj~h-5qoQZ%vNg@k5}@URi9Ne*Tl7@|I0!vrkm!(hC1WZ8ZZz1A0%=oR@V0Y zz%Gt{9jC<1dlE|%2GfV;BLD8>KWu;Bg~`@Av^9G&Z!BUN2&klw5s+|+lOMBO{UFb6 z%d>d5%CWqolmk~N0jc%MO! zSC#GKpU75#hOBiO$oP6}iAOO#G0?%-NG_S#D*&{pNUih4fz|bg=XvxN!y2h~*}@$I zGJQ6CLt63h{%qmpPpFdA>`+bXCXY*z_@3qcx^~OwVZ|=teULg}SX@=~ z8kY)nl3~rE(|lnVTMW<8C@^e#Xj+r#IRnBYpd#Hq4}I_EHgV)!zq0s9v=T^W96CVr6hW^KSHzLSIa*VC%RIL2~JGL59=HkJ#pI@9G;qD4^)(pXdUKU zduWyM($i}H@5Y$r!nm?_JUSy;1Yy;xHs4VLTZMd*&?|cWwjMYJ**Xt3JxP57Uzs7l z9Z-h;)fJ6pg32@V`yb4&ByJY7QStpS4FF257vFDPgFOOZWm!v}?(^`}^N`0TVxo2s z!5^s8t2QhCD}l}9ixMDQM@6;4@81=JBKhA$Tv^y? z*K)1Yqs${u2zEWtO6X${Cc{vqN5F%gLC0H+o59IrWzm~ShuAg0~j%Oi;ZS4Kv@ z`(s-@2yN`NYw1K@T5M8Wf};7*3GO>SQbnn+DITL*gOq0diV@-vR)60JUrYk*jz~D=j)hyGd9~^JkD38EwtfvUPI9~T}sY+H)fB9{an=R`to>^=5iPSe$DYc&NDbD72q0}V4Dzp`E1g2p1=GoM! zVNLvrov`x1OJJ|BPP1s)pd{C;I>}bOFvgl^qKlt1-}z*8k-vpqRGBu?_h%IL>Fz%0 zxPr!O$$Prz_m};1tkf-C0A5WFpE3434G51@S)@sBcK*bXfKvqSj+Ls&>%A2VwinRS z07F*fdAv7U>|dfm&H*5i^!VNLJ-o$4IH7HY2GxK1g`Eis4a#6}`#6U?^`!Y@#7dF3 z=e{yffzGNi1LJ6^?1UK~g*W#M7mEED#%YxQ%PfE2dH%6GqQnS z_iLT=CpfHo#htFd4hOvAB37u#4ESxN{8i6kVb}#u{0L+*P3XO>NNjmCJ{lf`X$Jy` zL&lXFkDWS=qQH9vK`YEasbFm5=c^mH^=<_kFhs+WAHQhGygL>T_)S2yK@>`qlw%N3 z4`f~daj8|JvFY3}yGsb;8mX7)Q9z!6qR6mmBk%6UOvdYHet+u?z4BiXI9>-^>QfwI zQ@E2!ip>3%Ah}k&CLtw}E_;5yI@j883PUYf_lE_OXtHYk(@MSeZn`*G8~uA4DSn|0 z0@%!2tFh5D)7y-K)n_$brJLcpZgx`@ksb~}<=)CfK3OQ4#ktA~-d^F5`GoCNmO<)9 zuI#lG0KS5(Pr@+JqI#NH@Wj)TV2^c8H{1S$ib^*q(mWKT^9RSyv4hL55~3p9b%!5# z1;H4kz0NL%xE{09&Eg4F-I`q@f%&YB0qIECM;Znussof$d_p^BV5F{|0y|0)ri=-= z$p5*vlKyR)vNTU8L~)2H#(ZbM^;kEkhIFwzSLjF`NIbBrUS2z~!Q2bu_gGD9?dqZzZmezr=ZtFA&wR6q6A%!W2pq2-x`T!cL0@9h z?0#x08M4N5xi`8;oA*Rc@dfdq9;8WP1yae9d0YCgbUxBLLhDM7|Bj zM6yr*nhP3Tvq!9pG+0n@-Aj?r?Uh>A1j*d{9UtX!Z9_3@a#cg&8ykOw@}ae9*B!tW z*ic<`2mgrMOH|7wNm{Q;CIfV9W@q)_f>Cv6zkw2*uP&KIx*s%Hv$<1sypbjo$6*DF zd3`#=>5{x5ncZ=CNft6@fC`<&<@+0KVxVLI+WCFgslL1r^(y=Mx~R{0!xQo+HbV&L ztIYdZooyaR*-!affJ%t+-;q_NU;@c(V-+0o1wu^~^_IzY4pF94vNKvL35MxZdNHOw zK!{gr;o=Ii0n-F-sH-lsa+QXX`N$ zz8VWp#7#n*p6eJZLiw^Ws8`SP-&M*crxkm6p=;Ii8lKYk+EFEUCG;sh(?0v8f0JGc*mKugySwj%vdD^b$_j4)zj+JB; zWuJ$>&1KaVH+rgy=2c*@8ba)fV%M6M_!JMBk8pA@jaPAJX%z93mTE8G56O&mIadh8iO%^6CVEGw%J6VwKIX1ZJj9Vh*#3p$>!RtScIkG}$v*ikO} zXQx#NRWQ-OSuonj8c$r`IEGY2lMe@e03+<(MJ6$?efc0S*wU=Z~d_|{|zxBI78VW50U9`tdp~-5%fC0RGb-n)v2RZ#EUKe>njD&!vqzI_ zCrlLh2f3TZi6p)YF+5M&aBy~@#tJF$o(0_PrebM@9*YyKh`U(%;%fLMaVaJ#$^g{_ z)DkFEppI?rR~6uU9_#=prpaXwu4lGlf&+eL99hM=#-{>T)r2QWVbf4-&)WdDFET(h zarv}5mHN*$cNwe1J}${!>C~h4E#*Ie%^I`>>>U z>i-!)y?-m_`t<*10e(|d%4ajZ7yAdm1Q$TeRDx8k#1H+082MZS_j&WT{v!fNaEX1J zV_Ke=U`x1&W6iLJt>`>br?gqKYab3a12^mk*zfj6K5MIud=o&Yxkcz|otvtvJqGhgHDDl0bAA@Yv z9wn76Tm9+d^ZkW;w61n9I(?vwWLSFML`5?jl#A}>0@|GW?GStHwG%`@Nt1H7@FuzM zzP;dWkC%|ypDyBmp%T!icNpO$P@IeQ`<($!Ylt7r_%KD?VN%XJv1IW6^j*>(bL)lA zH}=;PEes!kMw#U2Ujp&UUAJjU(|bG&9L4Pk8z6zX--uN~_uT&jfJOuqZL`FpGD|%T ztI4^l|9nnYKT%1IT}6}qdP0-uKReL%`2xUNvxRZ`KOdeK{7(~Lx-kEy*!|woP4&?f zWA(qEUJ#J~jrRR{;rm;lqo*FAm8E1+!QEnQ%VpW72 zO125ZxtKDpANi6&r7}ioF~0d_Dn)(T-!ZdlBWDZaCrFRnU)lJ+SmNLo3UrwP>*`N) zC*iM)=4(c~qdV;(*fw+ZB$lF#@vm_(7_~U5sk?ei?U1_LyO{1VMW$FvnelCEA|@A} z&q9oWtxgL-iZVtqQ?fhHx@aKHL(0IORtVMFI&BX9H#st=CCY2yC>xg@x2-6-&=r}S z?ahXSh4qIu*Sj5wGsdfaQ|eAiQ4i2OyopG;M+AI4CF6P=xf}9B$n@v6wDBdQ<7nen z>ov`jLchSn!Aa_bA%aTnAK27AwxvBoA=pgzG?#s!!ooZcmi$j1m{C4WD!aOWbV|rT z>dGqZRRli^IMS+poOnjRHC&iDU3~s?fVc9jFA#TMm{Z1dTdKK{@qp$>bsLSreqm7z z?S2OBIE5nrc^*zFC}b#65reKpNU?fem1ze^Lm06UF5GxXVSJcKFb;vvrA~iKYikg% zzRYWS-<~%wv-wwW@v3$U??=Z@s8rs7E~;jFWU<1x^7l%43P-N>^#rIu)PCW>RZ6)^ zwY;rOlvGx21hqF()3Tt-Qo&(z?mox-`v72(VGI;mAp&v>8KcH$x&KrV|Ns2WizStl zy8SDMmN6Mty-DE-P2{=s)qdJle{30OgJ5HGX@c$>6ZEs2fZacB0>2`gZ0E++ZzY`7 zJ5T>wC-Ay+NLO=q%nRBhyh(mB(PJ!!y z04X8me66`-8t#<6gYx)}IutZJ5Ml#~W>Oh6pP} z^3An|E{jP35Y7n+J2^P1>~@7&po2o8m<$@RlQnKfpbjnC3ZxK_3&|%cCnQ=0q*VOr z5kW7y+6mW*ue~&(@y-g@=cG>=I+;3gY72A?;WQ{;)zo^qwAo%cJJX zvT590dJDuRaFrSa=mZQHLA<=Y30R45oVQlGg+9WKtj9$P%Day|s;#ZHJQHaP znfcEGx9hfpbP;dnJ;2S6hK-#sM~#n<@8NmV7k~f*jo;U*Fq0o?TQ3gf_f~q86mM}ekrcMt+QN*Z67uWUNR7*RFEF|e9fQQkfa0+nvb=Qg* z7%a^PKD)rAPl%2N)N<2RR$u#_@l}eaKp>QZUBB2@M8}Kgf7?UHwAR39?^tmk z=;}>%VgH)0-q-7AR!~p~C%j0W9NTiVnyPTJwf(W#Pc|j4Q7A6ES?98^KjnIHXzV8b zq?`Z`@BK>GJg|Wg5fLtquES-RH%~t#^0@3tw4s&59A6x*%RKrqUZm~d;zFmJI^dt9 zSS3Ihty3)Ewj}D|QJy+|_VTE>P>!`?Aln<6D-hk0n z4<%tc_YxI#O=h>M)F@P<1+`J^z0DRsbEDF9o0;$eLPDhP9z06iwVJMyB43hCO;X91 zk(7LCC7%}yyVz!_TaTlaV+#`okX*E4|eC!ysk|D@K2GZ^MNp3SJkA4c%21e&s zThFc_!ajoY>{y~lYyHWvLKrN+$K%P?sECM2P;tO-&HI10 z$PjXasCRqi@?%(v?hX8GadSeH(p2zEU36+4m9cyi8l7EZ zcf)<8H9|0u%GG+sSw1~DSgg}}q=<*xQiNJvm? z*M`1BjPGUGP-P||dGNpt2G8919IaL6kzvNm%bl&QB%@y^1c`t@O?`hqL!<9>=-x%T zkguf0OsE|UWoN(x40^6VjSPFgH_rB@wk+CuH1J_F>JH8z)9Pe;?+*a;;>tQzGgze! zhfi)0CQcS-%xb0fe&t6a)h%*(cu?;RI_U}mG@s;RO0H(|B+c+Hk{lIBt*hpvFo}z; zE%Ot7K3=|gvBqBa&tM1u+%zBzmw?YcQ+ay~=+T&%Qz!3@d=V1SZHj=bkx4@0TA6EI z_N^0N89VPx6pedg%(4TDeROQR?KSiCPtNuVWg1zh2Pdm`ZXL0vE-oPTo>9R4I5KZv zzt&q&&}Y)#w^M+TAtfOpHCeiYr=idLs5 zRekC&Y?u=KGxjH>P$Mg+mvmk%X@@wv+X!e2(MYF6KDVj0BrdOA2tw~vrd19^Apljw zAkQ6o6v3EMhvC|!l`gNLfh!=*{xSysx?7()IwmHK*J~!)bSd~o&Uyxy%Ph1GdRkR=T%}Nhf`S6fj4wfYERN?=+tU^-ej~wq_h4e?B4pev znV0>C01E}A+jFkW ziLY-S0k5nF!jLn*JufE8YBNN-ZTC$%pD}(U1WQ~@JWFy!Dvnm{x#);Vf5K}Z(g1ZZ z#pAGUS+#$5UD@Oi&xi$wj-jMLjd6K_sYH!YX+G+8b6MHsEjX|Y=fl+ca}xgPQ~e^< zj*W7eV4DQfzg@b52ByLC+QB!7LTW`?Z{&Yo_Iop?+*zdi^iiBIp`!(cUP7Hh#61X8 za^J6<1JnWfemii95D`*1?|pvmGY2tDVqaNbU*B4C|F!S{C?b?8Nn+8JQwHRL0YM~i zD{Ek2AZ1@Bp7E6SLLLU>M8`2Iu1%Jk+Le|f}w}fq-!p@djhqPR-(r&qXxpQb}=!5@858=ty_|?^Z6L1GWrn`rS z2SZV~T7}urSu!~lM6pQAZ3K89TnevpGb18EtvZ8dWux=1hMb%UiH#y4!h1%wVBycHZxue8`O&p#fUp=TlfU%XYAK0X%X0x(I5mJCI2$ZmtR!YUb*gc z*U-?A%hGx5>kA|zqBKH2cX7YK_wMenu&^3P3fqp{Vd92koJL)8CLg=42j1%GeUTvV zal_f$+e_hg$yQ7*jERi2U2M517!{tGVL=pm@9GM;cbRBkmAM|Ey?H(v`tHGYP0hs5 z3Z)S&fhJ$jyN=ES1)2nAdXP#2LM#YLJjgle!VEsUn8i)e8MMS^uJOEr)YZLD7xo85 z47Rqmt37ckDJhBy3VXA4<0bkcA&ST_D%rx=bSk0U0aeO3VSPwu!N2KuKAPC4?>hYT ztqFn>P|Wx}uH`?!q$j1Vn=#FBYm(*mI6j_fw}_R(1j9wWzU%PuNa$oUsA0zXbpfQS zd0x`^f29UIaKN`^El`c=LMNAe<)7dH7;@!m-z0uMi|WZN)@@?9I6gQ)MeyHzrH&%| z)4VbbKcLH}BuP92HKe^zqw1CSck-8V)EHQ7-BGMDvFD3CS7@c8q>zLvS2s7jjKRq$ zx|PjWF9Q2%G_woro|up2c3bjr4Y4(*@q2E8#PM7?eW=#$$^n_Tx3{V3`uTYcRRqy! zuKZ0*yEqInPkMU#Xuc{3B(MrId=V7Yy)-txUz0@MRag&g0K3ys_vp%*48Elz%L%de ziI@rixWEhji(LR*&(khP(1!zF>gN<~iD-)F2o4irX)%ZrZcUJeWLk)?7kJ-2=vyGb$L|Ow=*;Aer$$vOP_xSvc;w-UR*|2dkGyU3 z1F&dCuNoNkhfGeVyP(=Mo`96~f3}^s_TT#E2S?Td0V`8DO4{4huuq}AVRH`3D2Czx zlsC|GJb=+#2O?%=bxEFf50E)Hs<%e-y~jp0D|-$rgJyCcFkl=)wLrYc7;rMNhcIrX zk6So#7pi0^ z*buR@N&Fzc{f!L}P+)oWDzyFczvu!;lAa@{@T8u#Mt6MTI0iDKbsSW(cOO0=P#-ft zd0}6vW7EhZhRRI1NAdiy*UvZrr7Jz#C&*pROKj1Tfds2z>nB6K~ zf?POVu1Id%adP+S1IUk##br-+w6$HZ<=oudOyg~gyTAKjZ@p@@01CD4!CEJK`=ulQ z%@-38ybgq`LX)r{2n^kBq2ByqrfFg(d(be5g zAZgeStdNbo+0cXd8-fdDz_L1|2qF}3RCTICit50r1r@$AHjM5a1f#&#eL-pSN{#P>r{-&Wd#N0)CD~-$kESk( zJ_r(H1g{|Uk0VJJ{ebr;{UG>DUE5nG;!k%(;^DV_Jw_7aPnteP^8d&=?ZF2ZMD5)^ z0$3!ocDWZ*R@&4}e?R_Yz z3easxw8_4WS_=u1c^efh>cJQvbF|rIwCTpf2y&yzVzNR+J@_M%XHmfBkBCiaufEvg z51wO7^+y`?5HqLC!EaZe2~xs`%}>yRVE+cr4%tj!!vzmddn0jkiAl-3n|8{!Nr6gW z_-K^9mC+g)82)FTA4rk0^YI@)e(dJvh6?TI?WF^eq9i_nj3*Tm@WJLRlaN}*eDT|P@->su+QxL!=PnCC$A zL?u6_7gJI)4=>P9LW=8m{XrteZ=$nhkI!*Y={U5hbJe<&z{M?c@x{a zs>}5xN@8VikMQ|(J(*Qxvfo!^jCKh4=a&!cZ?BfWHhDF|Um zf?@+S3^8nvs+#^~yEs};6gc-I%ANjXW?y2j?k)*Q86KD0C912jO=@u09hy38o^XmTBL*H>CEjX^ikV{3m>R@u`yS3n*IZ&-f1V?jht7e?!IK zQ0M!LINvmx*}e#z*W4ae-a7Aj5x6+Vz4AXxv zX5}^Lv{r*n3QV#ITQ)XcJrzlXow^q|LM|SMChn5;_(7y zWLodq9>6SYZ_uC!l}bj7J$H}JT&{PVL=@Rv?OVd$ua@-f>WU0$C#?*~8hQD0n+d3N zapJ2;1%K{#9DwR(&(04X(ed0DrGUUWZ-x@BI;>b=>bxnbA_l>J|BQ)O=q^T* zXyT*>u4W7@EMDg1^s3P-kgs%O>M9^u z?(fSB1B<+Hm3)KJ&8%B$+TKEas*v5y%~ypg%NrZHqg%@6g*s`9!LNSLJ76_O@z1=& z)>-}Yehm$danX^lTFi;ypVYeek}aO5C(``Q5KUJfyBO+ZB~XR-^AimcrAK{wf{``0 z;RGhdV$-Ega!DX<308;tCBX#=ASTF(SjF{if&!sq5 z+GV-HG=Xl<9Devo44&jUF;+Rw$I_QLaGh2LZ`^IUw~seJ@3Gjd;jPHfdhsm}WdD%X0SOaGZm#H`qM?S^CE|BKXs1p@ju*{gkbX!Ar9Qe) zPBXhG{$$rz9I~VGw5!{DsDFFuw#k9MMn$y&Gcfq{v;?U&d@{RN3gO3xC~EzfE_P#% z7|t(`3jtew{| z4c8vZIm+u#4O$eD*;xB`+*%;ysxy`2gc2PFFN5t zrr}2JEfWyfDd)ke#NBdKOc9syZvo5n>WX>=4a-S+5x*bh`qRHQFhYJT+HbEB6})cv zs5pXRk)GI;N7}H+-V)VxGs1LI8CQF5rd#KE*N4{`hoHcz)iU7X=&TxxX>6KB=GWM8 zs<^$6D|TcYV2qr2S*WQ7X}FUv_OzBSlpiH3T)Ow6z>O%GALDI=o4sk4Ym2NTRDoxK zh;|P%MWhCh4IK{qezQL?%G=hzD`^tg?uHM8CyhAe zT@r|ms=ZtV<-ggI`*unbeYXDgKF$IkHw7ODUo|h5O*w0A#!|nfBgd4xF#CrALLeDI z%B&TGOp8%BJJ zojaHOt8}SeA-dJy+7#c2J{N5*rS;U1qQ<{Cosxwok=A*8GbH5~Y1TsN-my58_hHe_ zmv}2eB`H)LJ{{^d9&@Xo#-!KX`>p^e>R|e7e|@pG7528go0-KbT}I9q>fY_dUghSKgW zK;_Z+9d5q@L&KhjyAJx8dNx1eDnMndKBH>0(^F)m{0I#%pfzeQwfXd@AA5kKPL=oi zGG2mxLi$*TRW%b-~oH625V%#`6vcYQncV@{laJS7BQ;uU+S zRMrC3U9S;mwLIl?Efr0COy*|=npJyJw6KduLJ;HlcvY$#0*tH`?_#vgnybjWVJi7Z z8&deM^%a5{Dt7VZJCu_4GwjkMp%y`i#WEcQRgml*de57oZ{Ux9u5l(SiD-MRfP+yt z+;E~bX|LW@`||EDa*>pVSOT1AcnD8lH`Y+wc=#fIu~Ix;`pVl_624(;we6uU+59t< z3@aooTsA%)ixM|Kxa?~-I-B>!vOo=ZBwr{xCS|RTHhz$Yhygp%9r&*srdQn8&ji85 zjVS6@wTgv@}r7~`l0=KuAfQ5-Fb2Tb<>NhheQLpu`}eLUNBw3 z4iOq;La)54k|J)EoDkRjtN(duEV>lq4(U@a)G$h zo#fR%n|DLBt8}FRCxRsj(S2N`6zM@ql|+BQg_EUVVw{PIy(-4eZNtFKF{Vl-Kojp0 zby#N5J5z7La!FQ=Q7I8yV#TvOd?=+;B%d>agZzR!EGexq5t6<8p4}w5LNyM1+Yxt2 zOa7eX5HPh)<|@z}_KSD=O0#0cph=MWCE-Q5d*0@~2vkU4ptD2dNh^{~kL__=A8z~k zx!p3h@zQ`5_vZR&5LH;~QQ9DOh9O}5!wm~kGUCT6zLLr#p0^N~J}L1&N`>hyv-gec z{VYjq}2lA9Hd3$%|(w|71v%yPFAb62hd$!QsNz~XdNqgIbr%GO!z9DCc z=LU>5z4-fjFF+Q(yVFhHT3L965PfBZU)le5aG+_3`mpcezLE&?U58nhnwGt(@z#if z6VYwDaUc80`y=9*VpgC&B zW{9qKaS?scJmmbO91BI&80utZG)#mvMmX2(9-vyR==yN- z(M2r_7Z;bL7lyL7@}Z@xZ?Q{i($`V*QHn7Sa4*v4_}2@H=ou>4jv}ZmqkC7I2VnW#fd5_)y# zmsnl^_dphXrK9Xlcps_A@%Z+$sA)+M!*Kx=+>2jsaSUYdu>z>$azpL2c}0EE&X>mc2>- z9)httNiZ;~TztGWs8f6vBg?-yUz}raVPWCk5criEJVnn^jhCA_LP)Gp4&BAp#%nxt z&XwUP7=^nO6~76Gx%oI$6iD;mRurQ#f3O5 z-80kxW8;l^uMoOVIvSQ2w_^>ZL6gH@uRAWciUMyk&{@*;aN-wdWuMGr(2a!atARxW zc2j-Ps2oPt5~9pbdXLB$9mk%|ZCWx;K*~gSA)&sAzpn>7>(J~Gl1Rd&(U07`gb8dV zDUl%-gx9J0E&Ba;+pGJs*1T9Go;CJmEWl-Fl2r44)LODr5PEle$sRI+Z-}LP8A!gW zYVFvw3M(_>^tvbO8TQ}%`8_|EOKZxmx-Q2?El06;nT;YdlN+4eJQsRAimVloT*h+2 zwkO(cTmNmwebZ+ACH~#UGaIl>sS17ET0*9rrR(YNIzv8>rYNCx?v>FNvic@)1j5Nz zSF^-CW|8z;RLr^wDrI!954lOG=6IFk$<@CV(cT=)kwNk)BqaW7=e3 zn6*_Pu7v13SztQ2d}n)gr&gaHtJPKu;+TCp$38P_>*o0Z%*iLR-nGAmO~uUuCdcw^ zIm<%uJpcAJOtG1TWEepfcZ-Jzf_{fE3sSh~Ny+k4Kld@B+6t(rFiU%2)CHAvyy^cxbRBtAmq- zzpq@TpA%REg+_rE9idCW)&Kv^XIxm#TFKyBdC0Lkt6^08vVMh)(JRSL>?d~b6X+$8 zE;C_Q(H4E>+wDAZ+z0}g+1f`3=3Plv1e+i^^e*rk8NF(4rG$Q-~*g@snud;UvP(}rGYgB&bu;(06F+QDFT znV>h&(71PYe}Vt}M)|ruUYy3|V4`{X+0wJAzW!mQ#`X~$h?BG8&XzT897bI=5}5pj z6MygXU1<62>W<>=v3HCN!&_--=|NVsSEM*dVi{4koIT8}y`)GYO*i>hT(JxPoZ`<9 zpO2*YDBgEBXK7xSfYa3MtEZ06v~b~=vB?%lvI#KG7^0SW{Vpl}U6Q^U#8?f>s*%*s z%G3XEhQ>dK`Q?q&%1lN^7SE`CxfH_W$Hr0RcJV62tEqGUjMz^iI+I$eaO|5>td`JX z0#c`Kz^XZGr))4Yekr}G;K$XfBJ7ccb*AFwag3GuJ=_1RslmZ3o~c1rv6q(TneE_7 zlCnQGf0^EO=1ysCZPnJ+28b^}_nP(OmZI*kJtcWQsl|=I|9wT0VsAx@g!O#?2e!5v A>i_@% literal 68765 zcmeFZXH-*P^eu{_AR?e5AYDaz6X{(+KtMXui%4$?9qB4aktWilH$#WedjLV{q4$m? zl+b&JxB1`aPsjc8zT7WwyqDn^dg4jWIeYK5)|_+AogigJ8G@S>H?gp=2xMQrP{qQ+ ze};vH{qn|D@XkcUkti0{Z7kUr&(+^0u1?{4-jix>-D-y&_xGa2uZmF6N@XDn_c#7MT5>n)XVB0qnp4oa1-x?%jTmjg7~7i}uXl^{ViXyiz>6 z$HvAGQxhhRv@NKt z`=8@yJvZ$BImB8bze4!$u_#^Rm4A*?&94dkbBMJYf`$9f@%!XEv;Q1o^>Y9J7yn=5 z@qc*OyIz2q{emL9=jW%-$wA7Fm_#Cx*ZvHBqb=E8ib8JpR)K zd)hkRhV?~AfM5-Qgw%ABEN z?uN8VN4G7q!D@MyBtY&|oSmJmPYGp}$G;-^H8Gweg_?TxMUr;;Ivnbw#e$C~+YU!; ze$V!hQM#6NQwaY0Xi0J&Lay45L?-MlFp|e<`xK6qcpphDwuJt@nz5XF^GIvyYk5v* zw5>eU#C%aNxa!Uwa%yVg4HRm&FFz+XAOVq7V3zQ0)NjLE4`OL_KG~HMv+FX&0oG-z zVxpL9bx~3Frz{UIB0Dzy^77PFJ5+DIV%UEAd1psAxH|vSyM+6E>D}4lzb(9mbA%bO zd(LWXLN(BmL}B%&@0$k)e|B^{rQ`1G8XRnD()%-_?}aMdCd7_J97eGauf91fca*2Z zX_;@mg}*fLTHlciWhL>pgbmzuUqyLk72RX{tjtW)(TOphr-Kkq5DM=* zP^blxd-q7mNP>kWROQ+?DP1at8CqJ>yC?a#A)GyCU{0olTyIxO%^2uYos+9QW@SA& zG1OGImyDJxH|fh_yxQYzF)}{fqVwOa36G>@WW^Rts;jFHj*sLiu+lEJgxwj*;Plr+ z(2yfMhZaVwe%c%Rv#@(Ot=*=KePd}fJzn{#N^Mot&a*YS8T;gbir+o^$;->oCXiCG zx0kc>XA>A7S!=w{LPvK&X#2}{Fh_Di@uKdns)O7RHdVR_ANk2c?32qR_&={VUlzP- zzk_*8x;3&j5_TpfC3P_EII{Whik!k?n5_)HJqy!e){Mr6=sUe(U0vM{cUJjeJmUcT zNds`vXSmzj+w;U~{oGG&^9v^RDD%`==#125Pf&xqhkhnwqp;$PprC!_+m_354grMw z6`!P}?nH1YhOSaZ6BgRhF^KVVHdK2=I>>}Gad0Tg$;vArEl?JV%C+x5I$&X@Sa9>l z8aq1DCv%Kg#5s|Yq4F)k)xeT`TQW%Gi7sUx3&er_kz9SYt{R!JZbIH%1Q};Q{QZQoZQHrA z$pV}C-n=_UN7v(d74(xjyVF(G^*jYpxon5;Jlcqfgj~5!-PP%2a2tl%lPCn$ogN=u zzaGmGpdTD)v%H30nYYxdz4M~KpBwU`)pGb-{I|Aw=831=tS9a!Wp$)t>>?S6CLQq9?B-iPMWvw7f@5PP=0zb_VjDx7n3^(IcC;fqkw^sv*5%EwJ#s(B$8!|} zY~WWwh$!oVsr4XC>S%9QBSp{T&iQ&!=7hX35)74WDx?*1VK_*6=eL@-ziT0sZK#Pn zKQzwj4)`>4V+rkZcsTa4Ng}$#Vt4aOE4D8kG-|hs-yXu_UbUaHNXOW%U*)N=zr`AC zW|n!r=6NPuc9+)yg{ro`(-+TMOO!aMw>mur-$4q)JKUI?=!{WrFqnC+b$$VxhwH}d z+7a~eBX&CLy-ZPLypXPrPMc^a1!s6B_4u*Pxc5u%t6zj^g|cG9x_A8`c zhux?<*c$mk2Cv&0_vyZFXn-)X-V*0-51|n}gqhQD^YahboObA@yqFFg%6D6dzNkG& zey(%U)!FHBn4@W8v`l2!b@X;_Y_?MlQD=4G=78}%2=BEr)YCgf^NYjBs`Qg`i_4y* z@Ex7Y&{8m3VP+%LHoD{B+VhzHcT?M+Om%UR5SvY_;gj(-b!QlEID(rWox&7;8nU;( zYTil6<3P`LI#ek>Aek(m|z}=+rdaU%ci| zv`-p&dWpyoQWjaR7#!U$@3i~*lfKQISZ&^+LH=k}O^ug~`0Ll1gq_gUx-fDO zS!SR7afkEYB&L1c!)6`62SP&QUb|zzTNJ}K5a%JP7p)lfR;45lizcr^4n#@X+uD0#H2gVOh^ zeevR#9wDOMWrwC=c)ETX8J;XcOPTUmxR1AWbku`Md0ji|G_=fW{QK4(rMiM3M5)yQ|l(TI; zoNaAg9D>3DRzylA)*EvJ=A0t$E^f%+o;Z?m&@x`+3l!d`}^_U`gn$QR#Q`xuZ&{y4Uq%X4%F-9 zmj`lEkGE$f^q}EJ{kvcN{Y?#$2{F^j+gZnh%R3`Y83y0Z`btvjqiDDPLlTFKWhy7P zWVkE8)<^H|cKOO+W4pVO48gQ7_POUszc9q#s;&&tYxlSA+P4&j1@pv_1vFvCZCx&ahSMC*0h7d;1|V`Wo#y z!Ur_6J#F!PmQKzAJCNV2gVQ|+dUk;&Or7Z_*9hf}-e45o&o_Pmb#_BD7VX&JeTLdu z9V?X*jZH~`T3NAR4Ju`I>#?w~l$4a*_nCP^pVM2emO!9Ol#Sc094R^+5SGHuL5h9s z1VQf{=#fxQlJs&=B+gFUS=x7#pN(2pWxQBY4L6!92?mse_xrnB%E(~7fCDJv^8g;y7= z9hG{huhhv+7ykZDnhcS|*;Tf>>VDK&$;!a7WzzfWj_X0+c&W%;x8Zi?<>!l%@wK&w z?|7}(haW#?d-_yJv5+^no7UWv^uD~jV{k$MGW+vcfKvYX8RbEykBoHv(YcR&Oo4ud z!$6trL0-VsNHNb7Dd(eNa|7{%o?Z%)Y9}-%cZReroVrBB_}EuT>|#I8k<8~1O@zd1 z{nVL8S+V++@wl^+HV?P>zNhAfj9LBuO8?M&>*V}oRYZ1u@{~|}fU20o>8>N(TiNY| zvd>-;Xa8)rfGq0Q(zhzy%yULwb}xW`iIiyaAQhWgXv<~tgK6%~0?lL%D~52|z27Ue z)FKX6?IpbM1|GGkr$P*3RXm9&LySF`;+~j0ka+@Se}%aQ#NW(V#Q6!IDGR!whKmJdCg#F=jY#89rE zGDC)t;(o7MTmb!}r^gc;vDCtDEqy=M>+fJoIqxowKNmyUua7#udvlRIFHJ;()830s zg-b~FjoUnoEqj2{N-ng-#f4dA#`9#YGMJ20QC8M%^9SzCyLkc+kCPHx4uiTX}@ICdvsX?2)GiTIKB4CCcnVH`-B>A|Ohyy6Xwqgq1} z#)Y?ujg3KRB$I5)n7>bItN|}?gWS9uIopW#a@(1=9i~Bl{O3OEaEe5<&rpiB$dAoPXh8f zx8KybF596Fmy4`NhN7i@{n|b>olCBT9uEqbylDW*ikUH;H09f4Ie4aFLJUT(`tWRo zmTPzZ*B>q5KcKAaulSUTnC3nhiHd{StyITYRC9k*dNf=!Yrg>9{98lv?F*?^gF4UG z=f>w5YOO2?zH}#@$N+|r8XEGXZ&9i)#97jWm|cGqdXD3y2&MSw5mcRKcC`LPSrGzh zbt&+-+Vy?MW6g2^*0p%Wnvj5vo#76~$8= zxZ(UbFT?nCfTy^}{;DL?QKO7sVJ22o1dOFgF5E0WHH-5@FT}^`MEh~M*!^8uP@IL8})hN#rB`D z9bV{#$Mo3hy4CVo=4(R%9s4x{Jt>ql<+og$kgyin>!v>AFsP>>Ct+oAX8-N)S#SRG zy@pqSO99BV2H~HB0z(RaEK`bM6WB3*2yxK7e(joi6sGEoD~wJiOt0a5BR1SIZ{VcL zeqI{+tFiG}0ZyJqK|GhS^z%6F`!&uhW@aw9{z32EbF+D1MlL%qUNSJWutcjE%_&?V zG*ylMi5hHhp&rif>E@_*zIX55XA0&v&ar~x;$jWNQ1cd73F)>d!9z77(T#g0cv~7yk9XK?YWxm7h3L8*Ov~ioR?X|L9P8_ z{`I*5+u*3Ji(>mkm1%2zBlnN^P`JNL?#MKbhDMAIZBf~_5DYhxP7c1%3H8=nS2V$P ze&5{p!+UaR&Zlr{d*DLje806OW}0T&012S{+Ej)klHt=Itt$079v%VQ{$pBB-VSy~ zK!=RF(`uY!tkSjQ@Ssq`1~*rAr%5`sb-2aNlfV`Fw40UN_4z9c7}a$Kj_&b`g_-PK zYeaRmTl!n=F~Kc7+3hFseD~EVZ{5R|-8NgT%ezv%F?OIo|Xsuy`cZW{F zYn{-c$lM#ve2~eiaPf1kv+HN|UgZrEXL}=tu?obJV&DyAT=g zZ*|-|wvC1R=~vxjp#^I;LYyRAglD}tXZ}CjL=XfIU*u0|cN%NvlK~eU^@r*;o9E@1-=g$fXp|%j3 zt#lf<^NY;zYS+MQqC^To$nnleZdsJicuPo~t{9--g?^t>8g7@&!Kdc#s08~MaEO23 z-x$#U6aMdgmP8O~IUp~lX~Jm*X`GHa%0FMFT8D4|E#TMB=*YytV5NIC86gu9$q{iW zhNF;G#7(2zG(jC3%6l0$%x@2E1(_INo?8&mF_i&=C=IEir| zWOCSgB6#Q`ozGginE_!J9-kO~_buYkFG0-Z9vKjg^O_IN(w#c6_t z{$Gtlhn5$Uh0>|4bljyCA$tri#iixT{W(*ELB<-V+piNerb`wY=ZOCUN2ijE%b`gg zVW-t*D@XX69r`PS*(N5zyCGel`3`K>8B*vTWpoyPuDiqP)Y>whTO66O8Wt25%2~@N zB%~RY`eE<$rfpS$ag76X)7BoAEN)AP7@g2{oo1 zSB`lPb4Bpp-lJxfh`_)b$X^`#H8-$u+UuQOW*2Qz#z&7lf<%SxR@X#5zGAB6>C&w* zHPOy&`Os*DPX1za@O{Yyke-koryoDAL=MSQ!x*`XFkAG_ zx|d8@h3K7kE}i>cnoUie>%$!#sxX$LljLtvY!Es()b@OoXEPCvAWS>uYdiyy^Gf$w zyd!!tFihBMzo|TssUXQ|56YM_(2v=a`7^%nkEJw?p(dv08-jK=d;Zj>n(aQ#L?VvQ zNu!`TF`b>w`eFh42=ApOOXP9hoQg~sE?&|$8`9in%1t>>>`--SFZ(_n9bNc>53Ya- z{If4YzkLf=zt_f%U4(@(tBYSzzF}2Y%f2#pn*8TI79H*^3-puk5p*)SopSDy%z1Pa z3H(rvZK{qaRt#dQSYor3>dUKR-Y5i_@Lozk(woB0z@(0)ZqaCm&3EKo`4{q+m_W%{@uNWK>ja zJxqLj!>z4ZuR$%;tz4g~tqesrl#(;!avJJ5PFRl=BKF6v<=pze%Yxgy+nDrg=od4` zL%~ybCo3I)Fc?t3)kZN_u2<)1rh37j4@Y#gwM|UXiM6-K5v3`raS5>vZmn}&`Kuh% zy8PBUk$7L@`Iy_4fKHGMG-+pfC3$?u>dMrehu1%S0;1|jKUbzzb9al-L*_jP3%|$= zuQ8R}7tY;z5yrB9Kw~fo=kUhdmjOI9Xn^cRlB}Wv8GRfM{?2x$Y+gF6(H$VG@2zS$ z;Ic9?ojM{(RUCx&74#^AbwQ#)PQOQbBkr4kQehfD!0rT%XDo0TDc1plHy2n zcc-;%^<@0|(-iFuG7=K@!_}mc+VUs-u_=WgISr0Xm*W@B#PkwSa?Z}ngOG_rY-@hV z#z$ zWMvKAK%s|r4tEk()#C0~9A;5UMBO6jS5N-98nU@DDorl)BDwRR;oQ>7DjtyU$LG}P zhzMVVCm}&ChwG!0ZNE9LKr9*ba;Tu=f<<>?x+2tqaQxvxYPVgRx%RN8KOGa31!gd3 zq)=aNBwxF9VL(aT3zL&2b~uZTX6^e7sFXKgRG44+`T1aBL#Aq8S8%%aU|NvzypbD{ z?(Q`U3(WyUwBp`%lg&STeX_ow!ZX}$t*kJt@VXMKq1?JUk%Fo2B;k>n8AGuHAQG$w zckDwEd&90XURl~X^;GNY>z5$>sYzgoR^N}j@KR6!t_j#JE>9Nkp?d=pC+ngqU3l$X zp7L^qDZI1-oSc_Eqe$7~URWBoyUny4)8;BVux(U2%w?He8!w0%EJs2YzP0gpBdb`e zYc|Jwt4^~Py~S!j7_V{)2#hk&$9COMS0yL7xdhP&9{kt@FF&Yn{s5RAr+$#K^!yiT z!sR@{3K^1~JZJfyQZk9s5{H4gQ%ss)sioSHFw7#^)DXW5m`@fa4hS{;EX$o{l- zK;&bzFS9mYW`kOKARgGJ#J64W4qZ(iZyQrEdALT@kVl5by?P|F7%Y|2bz+dSWjVLi z>6&5zaX8TTVh}r)07M6E7~uFL7D&_7tF|egCh2CBJqwW1WRKI*BXN-f%!$5Gxg%uN ziJnbl*Xo6eN?$4<1TGvtq&3V$(+9)2I~6uFwa$xT#E}gb!@Al!Hu^iIsx(jCYuwX` zO>0s{5B=VIFytI;&gpXQZ%pW`4+Qs!JPKbMZReh+Jy&XVu`MYnMQ7y=mO07e@0cfl z%N;9$_HeKxMA6l+yjOpjtrtQHIkxp*OY4_bmU_+B8~u%ixs`cA&__CAqfK{-uMraG znX4DquoWY@=Xty;wb)WJ)6B;qCL8DZvuX0QFUOctSWu%Rz+-(qHaWR^v9WlqmI%lj z%YBo!sG{?kvm(8Kh`7yy3N?Pu12(kr)6QH|~ zI36w|!W*I&za=F_ev9g#?$M0$WaN8MYFb;tuD~BJE!EoXz0t|g9V$c6kO!*_c=Gs| z$j+kMK^5XIS^7Z;@lei}qNLcpfGv9@25AS-uZ3cpstmxpTvmhGyH0D6wvQh_UdJcZ zL%8o9%=nCS*)0tVZ`5UgK)M7d0LK7%k7aywcXeBn5fk--DZaId5Wz`?Ak8m$?wo8SZDbU6XxWBnDh_}6o4>I+3IUgGnQgv0T;|-{aZMbA@MLnn3*~=X>h4T1NO0V!}82U4B0(Os{ zGR~fZ73#^{hX}QnnXKH|$lfW}JuYr;P{#94_0p5`6-B>BGEp;1uUG^Je=<{0u|FEA zaR?*apYh&WH{bCQaXX&epQ88qin_ADHiT}MVW`+gFsDE6IcSB7#UHG3)*jG?hJ217 zf|Zz8hF!S5)j_8a{$WrS%2tA#{+ZLFLcEUFC01uHN1QuAAl-h*x@Kc*GSj-`fm>ZY z?GEz3vHu=sdRet?s55QEc&0d)pCDAdE6<+p$_$7xH}BSX6s*R%H@BEM|)PGbEt(tk_-tt*RX0 z<0ANy_;wcIn?4Da3*0<1Bg&bS;?yKcrmZz)1w_)@58yz(zD7ZOBvySX2b;s2JWv-SOaAE@+Baj zH7$dKJX~C0pi5mhrsL^8s{d?jds)Am`rJ24>d3dR!N;dyfQz3WI$h^xVUax?js%|u z(urHA@5ORfN=qmuT)I_ zAu%;En;6$xw(iYhN!B#*ey-!5X(`LiYCK=_xjd*p&Qw*En`+foWHKR;!VPs{fM5R( zJvDYgE@tw~`}v2{JkId3YWo6)%=UI9^%Kv}Z25-uMM3iO`T47Dl*Q{11<<{MRvW#0 zaoKTXWR!`19<~BwW)b4!=ZELyb+R|hZcD0yo^@#GYvRS0j{6pW_|4=G35n)KuiBp@ ztvg2-2@Jb3=O=ZZZG|^IYIVGbG=y9qqH1Yl_+4GS)_##oWSKNLf!45tTzoW4%9ydW zqcu5J)D-kRN?PY)YLRVi9mq~cry@-vap;3xk*hLN8P-wyx*(x!R*yV(ko?hp zt$_XTxjCK~#X*8y+6!hfLmvK|h+gH;<0K0}K>oC7*#z z1%8{+A_sIwRh58g^r}lVr`PGBJw1;js_hPP*WcH-8Js5mrV-2SqeJA3_lZJsu=`p7 zt#_68nLBzG;AC2_T@|EpB=n=|=H4DjV^Zg2*I=EKMnUeAr%$a=7K}~`Fx9a$Zv8j| z^{u+DR|*vTC1lR|McGWe2$RhqX~J@^yy)KeoFG~J9y1BoD5k{dXw$qHgV&Z&BS;}{ z*r$h%P@SRP5H&j7ES8J)KeJ+IegltSrp`7+14f8DQ3azoJ@IsL>8{3qI92P^o7>>d zt}0f!Z~M>**_KVw%IwjR`*r$@2{)w*ET%F}44W$cCg6%WMew?P`_AOS|VZ95IH}b zFY(;^Erld#4Wkye8GQm<{r!8pU!GIH+Ci$q5@4#6{k5~x)6c=d(Z1oIYb@VU0f|JH zMi6W8)8wS5hwjQ(@uA_E{|ag2lf&b8VN`r?28I#aDlXBUH+-WK5)S4TgCir==rZ2Q zgx|1)aZ&88?woL?jX_rwtRP2}31X(NQt7CrL?K_Ra{=ku))ag1B_)u@dna}2 zw+NFcd99)V2fq|Zhv9||9tRNTP`&)ejVhFmi`_%7pfB?@;oUtwnw%AoDV>$1)xn$r zc}~P-y2-XaKiyHHZ#05<4+I`eR6={YyDQ30D~We&H|mM8-ZbX3A+1Fm|C58CO_2kO zj;BRvqfr}>tNVRz_};#3>=)+;MDnn4PE8>}C@(}^vzZR)7O3$LS48s!ehaXq^Zc=JdZ}Gh;{*v zPVp^EFri=;LGcC5H7+i$96DoAI<~hmqFZjo>$Z(blMFaMIT02V#KW?{I^X#@SQZk( zSK#Tl{w*%vdwWK^WYz+HV(Ii}MLzSg7iN6b7bGSs?7`=%3zW5`@|BJV4x0DydP zc2_5h3!W7$Gd8A?cUPGvrrWqnwp%eRU)x)vutF0ysi@RRR_c^nId^vW`CU`N6%i3h zOiC(eflgMXRcF8IPKQYalLC*;r%#_c-rC#S>*?v0njwW;Rs}%(0wR~Io0*yEttl5{ z>T7^-553RzcBwbb#l`8_)hc7>E$IKm;nWa3>(BjSWkV;Y;=4RO)7eZ+OweTa1cZ9E z^W|C6h~gu&qJ(Rt$8d1vLa7A%ySpJES(N-ZSB>5MN5# zZjXy&c0zV_<=dFPdKHp=_;Qfa{oT8$+95z>rw|^lD#>kaZPBcnV#iAv;7$$7EFzw= z{9~?5eOOdn{0Nce=zhb_B9j%k0$HFB8bcE98>@UVqBX zZH|oJ8`g#5{Wk(wSjuY0x9l!u%gH0PK>~1LLMj1e2t=~*YXbCKW?Z~u{e^;Kc6f=k z^Y3kRXJx*VlM@eDwF37@RZWc*hrgd+lx?KCTxkn%aOm^#@p*5zGajr@QBqNzHWP`1 zk_#lhWK)?Ft)e$SKtldcT?BWK9WfF0Sb5-;qPm#dXC~^Gl8(`L$8W=$Edy`1@sWh~ zr`>8w%a4YuuIG)YDl7MblG~wS#bMP#hl#JOJSfz!9SlaBv6Zo`t*wD5Rj<$ni-CrX zz7r1*ui_D z;f<(TSqqD$a7UaM7U&?;V@f|}*BQgq#z;J;s87Zj&NZwI`70IF=pC_bXs$TnJ=0Mff z7`b-+dO1*4z#l+aFEe3BN575F#o0j~HV2rr@ggH%_o2&F1;E+|Y+O*^`JOzn14Ur5 zCq)xpURp}YXY)-J2n)NLn^i7r@$Lnlk+se%42B@Z9wiC8lKyk!vu5s;ALe5StYW5b zSH?@h6mjPcH=Bu~n_%*>9hv+jQd=3fbYkTib+EB|6KnW zc_n9K8c8?P#4~OimHA!&sv$O(c!DyV(`*D|isyFy$vUfRGyoOj<9F1MyKqmCzYck9`aOC*J|kSQEcEQbJSeXlZ$F{UXyLkEopS))me8oXKt8edC`? zD*Mx1r6Qr{=9$08s|aOcp*5C7XiO$jG1}LWd+MEUeyX`703bDl1*bM*Zqd%*_pJUD$#9ft58+o0*I(mIadV?Hf}M z6FoglA%V}pz#uxjEA5N8K7izR?%XjmGXol5d^KsRVmqzoQ9g;te}DiB%h&YLtseHp zXVtK=QgcnN#)k>i0(PnUa4n4i)uu)*9i0kx`dp>`Pnxc`?||@W_N4u1NS`oOGB>L1 z&GG+4swMvOKGx(GWZ)hPzz5mx#z`RoDtnsw!E^jrOJr)4po^0<5-T&qu2gg;$g2H3?f1jH`*Yju zb8FxJJJ|14ok?by*x0&&D-($%!P*Q@S3Np90(~^#XaeE>^B?>Evq6>jbc~FQ+}vsi z3(zscnxzHX3bq9+qsq(60pR-QTm2Odu7rVFlb_E9d*y`vOuHlLd62z{nOVn27!3B$ zi8!xXuY@HgQqd!xgVWH1T!d}|Urbx({+`nNCC6|59w{jcch;9_EM=*VHHm2<6v2zX zXFQXHbz;f5xKv=hrQHId{{m)*kxEs_)>)2T3KW+c!vS+@qQY@Lv z(SENp%lFS+{OBLM$MW~n0MwBG8}nFL|A)Q)|N9n;xPR)vv#A?+cw1{0Xo z%hD-7tHA>8|GOmC6RHyK6JH{++s}Nrz=s|)Fx=J2g}L9J&9)dM(00QNGOJL`D{I`D z|ND_tL-`oChlme2FV9B-Ya!njpz`lY%~H5}=n?hh zzGfwk{Q5l@tlPZ2JWotNZTK!@m!pZnHjFebu571#e833chCbb5?pb+ubRHt)Nf9ig>=t z^Ju#_O_J5}LC>X#<$i>Y4Gj&II&%Vg#Z{^&R3U%&=U{5TeE9-c5MHX0umdU(4u?N^ z9MY&F2?{4>w!o9R03^*KEt zFlhjzH2|gp90F!Y)vHw0LQcIp*Z&)*R0m+6B>SK5zhO5R@&k}w6`rVe<$JH=Zo&A7 z;p)LbL9(C??tQ$R1x7l+&#x_BN&L)db+nizTCP<4)vGSRWqMM?X=!OU=H~h`6%uf1 zJ&Ww;6IzV5%dLj$y-rMw05`s527I>Tz&ry$kEfRxTFEh(lpU4Z)zt-b!{^C502Bd~ z3OE{bN+->07ngm2A_0GTFmnZ@;-k-(tw-SSv=Yxy&<5Ke!0eBgn0A6-L|cQaZQH~dd5MX4dc-@MR^ScEU%nK*+j_glLP?nb z`n6~j>Qb~ZGBU!rtEmkDB2GZT^U|>g1U!+*W+O-lWnr7^wHucm-XK}tr$S)jj=^`C z8g+f+0&WJ@i3j517jpr$Vopn6G|s?8FLcGtFDzshMu=-V5N%^ck(=|hXPkj1z@Ruw zjXSNf2cRk2cgt)iGy>T36syUi&-C-i(P58$HvY@Yjce(7$%Lu(YVIqyWc~vd33G~R z>Et8X7Cd1!fe`hG+FB2AGmq%#Ox-r75g05PKqf)2uHZYrjjgS)(~=#CN6?`zD=WJs z>tkcpt8YlMlv04ATdJKC5^_tME(Nre9mk&2kdguwj9$0`AXX_$@82K2fV{UNO9FUsPbM3CrXh!3C ztwTaXqs!%EInDqMk17Fn7dRXWw(bDLDz*HDa{DRbbh}f?lQxx@j6*LlJe&+hR=I7q zUDHWxHih#~^-g`LhS!|gmE8}MCo|mw(F}N~@f&7s<$g*4o2gYW6)^sLnCX>o-|oY{ zL`Chk(S?Jp7eW1fY^dj#9d{a3FlT)>&%2d^$|#GEnScd>^)U}xj*Lplr+|P)cYs#; z+EneqlF2MQt>a z>>KQTXxmdS`L{${Jh{cunD&^v?07-gb^UbIINY*DfF&FfRZE<-v$Lai69`Fib0C`o z;j-k3N!ypK6mOll`k$kthhyd`Yh$HZOrh>zBxJ0`ftdhWx8?7a6GY4i`U1XY6uh`@V-xjpjjLV^8p)?z2CrG(VrpUYC~Ain`;4~s1*f2vwqOio6?xFBcL zmo5d^u$(r{5KtM?qGCA>3-5u%0(3<8-#>$ZNct-7sT3jr*d>@ht&G59skyUSHn5#w zAQ(H8oTbPKo!uq*j1NO8SUEVtfZtb}R9NVw&o@A9IHV z6;SX<6u#Z1rbf8!nAz(x4Y&pNcloIbcpaCiT7dK?A@R{{9$*0)QFnFHLcQwra$0BA z=Y7D>k(&Czlo2BrEk|K;F9!^4ABv=V^k}$HKW|!Y{kb(^ z5k&)0??d{SJ9=`HBC$7@3G~4{u8n$avL^@%jn?wn6E00SHXZg+kC*3UkLhk8k!@Y- z9n0k8&<1hWo$(7i>3*XtUl*i@kL z@IOMG-18(qCRdfHRuMG&MC@Sy@e=#(w+uZ5&qsR9szk_3u$Y+R%U`fZplm zrX8qIrdybyJg{Vhfl2{HjHegNZwg<8&fqR-RFf0-Q&t)}$mM$KRXLe%DK#9dP9IIc z7kHox8Wq}rpvjT0BvJN_w;Im${6&h{k0e*|N2n|%)o;)DekY&$!eW`DE9X-&Sm)*l zOHG!C-PNIU9Q1d;aa&kexZpLA7)w;~?3jAW)uYvjVdh!a1kQmL0*nZ{@s6~kPvn;qH;`X+N7u zCS6z%yy$vhY-vQ(TN&`T&{1GDQ+K7>gh=YcAsO%`epxQ9jgOteC2#ly7byTK18Z&Kxs=&3pJg3y#x1Qv(@s|2}|ZN~i>POIo*GU_Z0O zF3Hpv2?+@rpHq9-BtV>F#RXAkXJ;b?x{Ua9b8{6H73pE+mIKnvdNoeWK!|8*kw(bX zYsz^yjgF3vjA#z(0MJ22MWw2$+CMM=a@M8VDLW4!B@t{<6;Y~0H>s{6O)oyN>r6NmcE=Wuks>{!2WcEsJKm zIa1ElgwQm)HwpCeK_P1w^#K{5nVGpn8VG^&3 zo|``wQ+x_(BrXdSw^`R0#t9&)12`-<3}k$!yfOoKbVoF%WMP%%iI$v&q=Aen7Rg}5 zy8c;t%g}vsmncs$l6NkrQH%o@N1whbrU?4%zI)TNKJHo}OjnZ@w2SlKOj1zz;@iE5 zRqfE(!Y`10%@PDrFAIn#7jnwJ`vNqI+q%1l^>_gh0uHh~GGS*74|qrb6@VIR3><2a z3<_VZOG`>LKu)wC;ZPBJ+SoBRnVQ6BxEWp#LX2ucRKL7i4=z0oXzD5k%FI7SFD<`=^FXts6OR0`gmMD=an+?+tgTu9WnFR?y%Cdk~>odwFc255|5vS83d;ltL&( z7W>7*2(sQc>4n<-5w4Je`mG1!@&K4$vv91;0ojr_^62gSU0}b~OAx5E94b**i6NR4 zFHyr4SE19^9+TWi`mSB-F(IcG>2sm(b+)GDldlIiNW3^Y*=GOxNj_FmJfU*aWHv6F zk_#*ZzTsj0(+Q=x-9|6E01C=H$We`uU{bS;5@fQ@_+Z)>?Bd?u-Z2fWO|WJ)gjT0` zdwJXnaRTO9Ji@8h-@N@gx1B&Ck2gt3Yr9_FE<)R7(EM&BKcmR@Wgh+mv9mC2Txivl5x zJvS$NDHEGRe#JBT$W-jy=11Li@iyC`J@UA?6GEEk@R`^Gom1qbbSTve{ba>=FHqJ{ zukUVg_f+`bqQFQ?&UiJT&QI2lP`>U&Hhzw$Mw0-O6j|QAu0X@e2BgG(*0sc7wmZS@gR=?iA?Q@SImY;c#wZ+;#9w&+8u2Y6VtH*ux7160 zlo@$PVETMx@{{;!rh#5PsxW->_g#7taYw*YN%QU081EqI741DJ? z!j`{(gJr*SCX5l#`Likg2~`bdxyqQwvj2t4x0}rmPD+5FKt=1b;?vLns>EDxzvg_a zl@{dw-uzg76dzx-0s$=*RleZ-PhjZ*+>OJ-19U#YuAwnOj$KxGYpSE+#m>47~p*K^3@=7Xcp`ZSMURgy2Aa%K{ z;tjKVu408Eh=*Rahng3PYb_x)S*y9>VrRKFlh3^;iz`Yx+PVhwL&Abi8Wznr#%fAh zWOPX$YBo(D&F*weT*FDyE!tdMOmVAQ%^gosw71_PR_b9%nBKHmUq_+d9lt7CsCrOr zzXh$|X>Z|`|BvDBb%3^~p1yuL3qC$RQ1n2D<&v+t5QATU0PSF)!QfuMPCzZhBP^^t z$pKh+44ercG(f@AtFefRh*a2&{a#-`2LUK{FzMLzM{Y(5f6Q&REqEbzPqX zh^qc*Apvlh+zk@|#(~(9{rv~nqe{T8_~G+?r}vU+VfIY+1oSOw2G;NU2(Wt7BC|g7 zkWD4je2$k>kT*PTrO@8AoFso=-r4e{q^81>9CklOI1d z+#?|YP=1En=}n5k6iBs(byUZlP@lHgVH*bPWRGL60 zJB{D&&>*LzmMvIo4`|%?kVI%QrwzvW4u7QEnEaPKivjJLw z_}OlxnQ1tUXq18wsOey{qfYm+3OmrbE{W-<`PT3}Y${@gR~FNCCeHx<%WAkdKLKMd zF(c%(R0O(b`)e1}7ZX!cUO>_UJ+B1dAO3(%uU1)UGp33d21>)^nO?O6Y%=I+JdfpX zAf)p=;X8NDc9`nUy)u=HdxcPHQ58oFgM+m+jQ-LqDWhmLJm`HjY`9*`r@+w4XzSqR zU1UP_lql0|ahAb&ky~wzf}X_h67k_K&)-H!0z;1#I^@=49HP~Oh7{8Kloz7n>gE^w z+kNHot$1qYxd~pSo3UIO>s!_na)Y6xRqueo+WP!3M`5Kwy#CgWB~jb$s#f#*IB(k-o52S0XMZevwmM=gTtPNj2J;7p%7|r3DbP{-^-e)bl9irNj{NB z;8&3T*Gm}}bdT9n7Q5o;Ae>O>hTG19pn$+-D-+WJb`i?R$aHp30@da0T4-%zpF zt<-}!*LJs#PfX%0?9kU*O=f4MZMBvC|W@Ec| zY-VD@Tp2U))fuy-*~d~qE)Cpja6bb_dq_ST zji8I1V}VcBKFL~EPF^tBLId!1$$ba#oSwmRk?Owqf6b2n^aK&2?LRk?vPLf1f;u5y1PRW5EM{gfpkfif^;cJ zOLrsPz34b|?e{bG`~9wS{yE>d4*$4yFV=e2^W68m=Nxm4F?S_mAFQrEJQK^k2YTyY zCD^JF^x>o)Y<$yj9PKT!)`K27AWVN0WDlss1j#m^;*oOS%|vr!H{HY6-c+z|x}9IdLmRu`!Rm77SxW{l4xttKd_ORi z0QVZUG*W-5JxA6YU}v`0hmxJ}6PqptI3V9eX3+a-1vj_0<|I=Iir>r&P=w4!K0h&6 z(r|wCoQvI(+w$XtvWL2|&FECmFT>woYgiGo>D|S_mDPvGG&g?y^f~i7$W2HCB$-c2?odkEl?g>JT;VPl(Lm|Kob%fIS4xn>M(ZzJE2{=sIf9qx`pOsK$$tH zw1Gk$L;idLn=nDe8Nh6)Nl(7{<4-E87F$%B^wOwsLNz$?)f?FiEd(kgx`L6D;za@5 zLo$-NZeT!Jd~D(9TX8VM#?2{$C7Y+oE}`!hz)Y< zt~!}K_U}GfTP(bo6ArFK4-LI%rsl>Kf%&(CH_x`@6B&D-Z1MM91rSn_Iz9RCVpib( z$9o)zX4$MyeC2UiCggJ~>9e~{Pfrhp^2Yjlhsii396;J>1NeJmvM%ZRv*21#3EY#2 z`k-QLZq5tK1weNc36lv!#d;02B+?X&4GiuDKLg;^JA;GXSC^A3<+sdc!nF z!H=#jp5IbeR~9w)7HDD3=T>_%o*iuh%kXjr7g*zYt&68|giR4J^9v z1rL8*>|cov@8_$$9Z4vToY{d!IV%AcCT7nJ^sHs%ny4>uut(rZrTIiO#O2(->G>=l z2+cy#(=&5x1BIU7-uv+#*j4>J>?VSeUtV~;uy-AbUSs1@D9WMkZs$LBgS&u6&7mq~ zVHTSebhNcqgHy=>y?fCSYatN0Hcw-@djSs}d>m%LFb2G+>tRfnfK~Y)??5`$SE}(4sE8oMT1-f9E^>Pt=H@UP`J>H+v``ZTp4qoi-jImk>xln zx_G5oPY8kg6W(|miBU1WQ4%dLhP^L?Sy#Kqss2N(c2E4|O*~t2 z5mylrj6_rC{r&!$Jf)EHr6gBUO9uuP#$~G2)o+N5zLH^(j09gfV|*F5II`86FY`Ng z=(Eygt*}_r)uUnc*wcK}efhEW9x6Sb7+Bw}YU|#PSnd8(BEN&+Rp3XN_2Kp~5YFf3C{4q{p|_z0t*zx&U|mKs z>b&6oxCuQZfTm4PPmXtXcA#~!4nU2^_I#(9=0+>WIDmN>5fS~+;x%ZC$(R-b0FMvE zi2#x}LOE7J-Yy^Moq7e0?L5FneW3*S-(&in2tdGDgTkh7gQ1tayU;E2Udc_Z{(gzxhj=&HpY*8NTXTc#J6Ra}9i9v` zkH%(Gx1qxd-$&hE;hZLwF_*P&>)mlvU0vFr>o$GP%*+g^gw@dN)0+zM+(l;_Zfwt+gBCieiO`CN zdgDHxmDxzi2AV$!ND&4$A#~=POLHDP)Y8(Li48M_I4xqm6~+pn&(_XP-;fk2Kh5Nn zl}iBMf~P6O*OH$uFD4f7fCrV$!ASKq@hk$Tv92ZYT27f2)8njE=K@c^sC5f#xn=Ts zvybWRiwAbF)BSMC);BOLW4NmHYDx}Sl~PhuKpgwa+adiOG~?0~1dOFSRZA1o3jrXp zXy6aJ$xlW^RO+^G0}y#B4J)f%&C9ow+x~Z;p+NoFq*rXD8TxXZ z`psAOy8wmXoEZLWtY>Bx10B5WZmAZR6p6SCt#1B9a7xE{o;dUK^Y71E4(88kk})Ye`kL3DVzolc#SMR6+H8sP{%eE35o-Xlk)yQW3ZHakd$+&5djK(x|n zqQiQh`k_Z0)vm%0Dd*(W%FOC44K@;2ijtao=Ez5Uu1za!ZE^2Y^5;H4j;l8oZB6^k zn+^@*xTpaOzdyd2mhtmQ`0|As-_7W692`~GE0*3^6!Cd!Cep4bDF@$rH(X-fn{-hnSfJ1Ei!7#Yz%kZ1g*p1Q2g6nmcP zKUX}i$Rmj7v(+pxnC9h>pk{W`=6B^82H~Fm#(@79j`8E|+Feb$!z*eWsXKjl|h?Vi1%? z2}b|=j=@0i-U3bmK^Zzz%=fnX3?(i#P<2eMfqxYo>GDmurVoyU3md0ogfW~Uk7|b= zmrMcl^JLfpZ?Iury!h4!>OV>f3je48e}9=BTk*V#&E|BOQcZ7wdXl=-GahuD&RcZW)@pSm+3}3nZ zLRd`54Yv)Of!^rNL^QTa!mmnrH#VlNK#HGx35D15+Alb6dBpX-BUbQLexNQWL{2;>5W%k{`KsCmfpf_*iG2twL1Lpd{^=sF9i_Fzz zHc8vA#*zd-m_e(AuKQvW*+4BTBj@bw3@RoCd8#=a8Ew;92B3`HA{xPuJ^$<{WEZ$cVi-%aP?!$T~* zZApIC{(Hl)Y3B>6c#o4n=s?*J19*Mvx5fv?hYXH65r$jl(c%24cqPXbE-D%}yLB%q zewXeXV|<-2CZ607{P^h(CUVoE>tIR=I9}wV?Km=KFb^oSYYX z47sta8p$$_j*ccLb-j=C*%00-- zF9UWqez?9hMd_Vn@y)0;@{X2nhlYE+^WwXmm7!m4UTGR;W*aEI^y=RXmRKjJq|87b z425t;wrZ7I>8#l;Ap2+n>;gQYAvoiqCkoig0Te8oT2s&nI3BTWk9;3y=X?r=HO03< z>^tXx#`58%pxlIZ?=S!??uR?)F)&=6om<~C36h1F$w3QJN^HIf0($R8gcxv4AYQ>b z0A52$J;FqAO!)D+iTU|U1lGdyjjooJAbXB-tKjX=-J`Bfn5d}(&e}(C-OUQ;vpwO{x!4u^NQz;KF#I^ zCc0gp+|~9kvCU{(&W(SHb$iA0LQ=9}XlPN=Me658rIQ1f5*T7C6;7YxL!Hv;Yl|Qk({7+Np0)yi+kbeL-FfuY4ocFzMYilbdCFSV23p6aSO;~gf zx(E~sJUqNX%4<;05D}?(x9vh|WjR__s2UBxR|Ihd^k1dZ)G~EJYy=DOy1n2+4hzYK zf5zruYvCtGGj8JNf?>EdI_BoFk&#V63(kD9&vMU_6ubH-)`pNKzCbpb{=~*+6KW+; zC~$D>+ED8dPKx=fass#n6t&DkQK4E(^%ASEeSM1ZgV6N)3;PZIIg$_vCd)ys;MBsc z?{AGrf5rXW2uKE&q(6f#0%4>La;tOa&iT+|Lw%PJ*KO@3nE&}RD>HKlzu{y&uBt8x zg4Gz8OyAsG!sTbq1UJy`=ES9xDJ#I~4GazM7hLbvPQ8h6d;oU{oPG=>e_cERAtQ1I zSJa_-XkegmY_OuD0s;>t7~o}kCP4?hGd5=-$uu!A5VrgE?g@#5pY;5|8H18-v;q8? zu!GM`w1tAcB7S9g`El(%{sZ;D%TralGgFFxK1zgrE!t6jFRi%E>KkQhvmr-+ea*+- zUdSjBmGCKd*?+y#%jF@(ufM>5Bq*Uhq<{bXpR|YXI0NjkGptTWcX|l_lo52Cft>h% z`uFEvUWotk-vMt>Lg0{9Uu652H@@AM{(eVbg#N?L^*R!|lz#b7o_7Ks z(dqZ5f(JVC{LdKy(mfFfjNb%l^o9RFDj5F1TNO|^|M$d#U-AhsUT^%Dd;%XI|Nlll z(b9tdQ$DeIq7AwuV`I@bzcv;E@tE{HCqO0e4(Ac_w0UUJL}_X1?+5AiAJK&DSw!Y7 zNMO^`8@sxGHA)Z&fpe)>xRKG(;x6X|3LB$+E9`$A;}A-|*b$*+9M5L2BG_(Ol5Sr3 zV}&FncIkV0e*z@~A;%xm51dHQI6#zw)blLD^=Y| z7$HDsMf^L^bZA4$`gH^YVd6jh`>MPyh#Q^>LPr}!;g^3aCI0_3asuC4gwt&gfbNg9 zdmw{Y9aa1NOc02kn<&07*3j~U9moPTw?;RBULc`NfVA<~E`eW2;QMC}l>v43u0=VJ zF@tZg(LkF%9O`j$G_?#O=n8b*M+SgFmq-p=-42&z$ax?tKYiLP`UUXf3OITJX9eiP z1x_p>(ooAs-~a@y3dq2aQLy{a*j?4%XfOmyWW-`H0Kq__`R^@@5UBk_a8WHXv3Io9 zE+;E{gTvy1=gAR(H;qw(ez?5AErO1uO)v25Uj~gpP=mFgiUgz#n!EE|DJ{vte2dU{ z%muH)W1t`C|H#U#Iv77ap+20vpRO?1hxV& zW}yIpW*qbxDq5lVX%cf5WC8InvcTm6&K$4r0VGOC-UkJhvP+>X~Ad8#xvjW6G zDs|tKj*f0dqHyGLuoVwDZA3ga3usE z%%*9yw8jC309G4lWuDI0Laug*TB1DUfu(XDK^V8ay$uaG8um7NiZx>(0iHd$Rlb9T znRWH7bYr-XkWc>M_&4P`1kHi$XjZEK{hwRUOOsIDOOT~fW*>0{x`C9EF>igqk_3_^ z`$~0rOzySCg3q7P0IAC-X!<~()f21>K$BnvoH%a`JTwyp9=rz!Wv_P?*PVKxTDK6g9-cHaPhD1^n=NA-| zpYxq8xpMu}MqZ^VvYn4j$hIe)jo2{`6LYnv3RTi6C?rw$jlyl~m|4YXW5EwS86@y3 zaDA>`RrD+mxg?+|lj!gN$y)G6qt4gKlusM}j?i65(ArgFr>BYS{P1k-ibk~%Ta`)F zjoE8ISrG!k*jdC+W5=ATdgzA70WXI%8Cvu5Qi*q(g!TbnGsM8akZFK2B_1TmU_H^e z38`=xLgd-AY52eT4;`E{$w^_sn?NZGv_f?14?7UjJ9w6g4uWXh9O(Quj*bkDr};BC zJ&!J5zkaV6g+c+|oAqEutqlvUY6s?D1;|9A*kE@p zu8mZ$*I)se8Q#U-+PbN+@h#80@+)k}_;`lkhf6b=g{5xx&X(xn7o`H`j!(^ADC%#t zo}&Ptywo&9gSlzN{CF@^lTh1js!9LhI5-$?YfDc{8^UurrJ(E8jd!k8RM|g@0zwF% ze`+2m!8K$pkDca;42fEu*VgL%c$FwpWs|qPB}?}4!lBk_g%$Ppyufz+?gp&UjAMmv zJ3ozwKX)*8q|SNt4!)BaGxj#lWibQf!8TAH0pX;*BavcUW(<1!b*~AK3X?_B!A)RX z`QfUpoE)0}Dwd`$gTV>?vAc(S`fGZSM4fEKpH9!7j8Xz%cLE(X=emGvz!mKo+5(9F z5MaJcg5aC{ARF!i{#j!)6q-slPoR0xdHZZj~?lYrh@iaZ9d4Nn>c`H>Q@-j-os}4BD4RUItqB5J7D2Z30MY!c*c@`3OAQb z|1+sHSu1<{O8qHN5k+Xah^ENm0I3!zC{U<_4^n$mlQTf-aLd!U)|vp|fC!siv6Nd5 z1QZ)+lYj{$#1h_(Z}<=k3O|0l)LRTmBm}n402l$Q7e-4#|4cwGHAAeTFrtQt2FJonQPVpuxh-%*@WN$S^xMXJ{C)eP(#@ zm`9?XPGm_2>Nr!JOc{~ES3m+$P35?1LusP~px_l$YuB~t7i}74`UMuT!@R6IVd*cD zJcU=Ny6pWbrDrEPeo*1sC~f)`jkSHV-u@QJuXsw~xig)Ilq2{1_93j`>+Qt;JMnJQ z58G$iVhU*aZgas%lMZg6Rl8igrDhk!BWY~6e7(EVT zj#y|d(Jl`aijz*f9sL5)Tj@XqBo<3QekAr_T(|&j2hAP)7T#>l%CZ3WTEt>anCxO5 z^nyKu`3};-q!bh%lXj&gcDP=^4z2DxA z;bgM*m(Va}yZSPGa&j`npT$mWRa)P~?3w)O6~sH4Pc4e(?<~cXJgYH;@e1=lKLO|5 z1y9pl5n+Y{=Q`Jdcy_j&rnHPojNtn|M@KL0qa7v4_+@(}HPqQ8P`ketuC!LqA;Pbx zDy(GX8Qvtw`p|SBvFZiQy61wxfM#iB2;zr80rvrJ$TEcKXI`2PMAs3Hb!pl!g0Wd*rhMmMo6Kp*aIZjS^7!R`wh^r>!+T4djW1P3J4D6prq zUme*8Bc3B@WJ$*JkzT(114s)9!VCIT2_qvT;Gsf;EAj6AdneRluh@;xMxFn_7LNd` zg*-_?6-|U75_>$B9TR(B{B9$us;X*Vp1=GB)LO<>a1U;aDYt`ZL%ig2Fb79ZZ}fYP zC^!+CnPq1d@Lwjy&%2tGq{riEmK?Ub%o^`uCE9ULr+gH+7@|p zG%AYl^?||ZkILqU@A}GbWiJ^m^k(akdx2p{_&|*ui z)*FM)EFg}8?ExEE3sNvhk@Gj9d%UT#+VS;k;>Yz=%Wg0Wis!Vx15LpH$Qb11VC@!~ z_~MctKm@)VXb4r3(@haq*_Pe7L?jS=Q zM5p3q4?%O#cMrmkE2s(X56(fZ#ckYmHxWxg)bcI`1<+>2$&mRa+FxIQ9MaMtO|e)Sj8@jegR|N~UZh;dUugJ%d|Xo5O>4lm76FAxyIDufEdj)lvUlapno4cU6m1c~i1Xt_h&JL`1@NK|~_ z$tDZlIH6Z2sHmt0z;2g9&DqH*-BLaOrX$cu^KTW~TUkkSTq=_WvmNYAnZKP)k-JA= zr6xmaQw(V>%Jh*R;C}r579c{s!FH5OAA3ZyyfS?l8WZ9&y%&kLu+%&XT2YHM!M=aR z0afNkHPg=TRyVLWUVZDi;fp*GVKwFVEjutbsCUxmS?1{RZgdn#Nu4g%b7ngA zelRb`T^+GirXC(pZt;FsodWzdItYc`EcaT-OJ}fp^L}qMUR^74t42Q9W3x^9o9Y_v z5m)RDfWIR46)d6vGza>NMR#i8tdh-rrPcRD`RAZ%MoIa)D^dj#BV<&*FF95)9MTmftpCVtJmY z!?$X35x5>zsj2ri6Ir1I#P5|?r_E%3EBNr?S3GgW=Dy8~YKKLfPSauOH%e{yub`;x zLqno8H*b=YW4NyT&uuh_@`aPqsMvtCUC}W6DPO?NL5w$_q>9)34WsJ~WxKWM$eIPKoaz6$RQkD$DSykr#COL1wD1 z0@GF6z}aqELhoRE0VGioP}Nt2rbnx&Deah_fUvI>jXt?_;ipuWva_ZcQz=9?}9*;^JFa5jAab)kj;WeIuT0+JiG%(K4a|0a>hX1)JK1 ztgT@-ibybt8~a{EY^a=;742VijFsy5QM-H<}fCa~G zKE$fR2LwC_d*EpX)_vn3&8JzNJ3v)aE}%W6-1=75Jm9RK!I{=r1ril0m};ea#}X$P zhYCBIjW2%7*n+Wn`j(Ycq>YKm@s_*vE5nC{nQm%>D36KtjA{px#^yFA4i;ClMP&*O zM)OH`@$fu;*OSdm)G!{|-)=^e=>`g`hyAj3cfG{)S!ce=kPa)M44)oSEK03aGslSP zJk%LfSiH%PAFAdSWis|1bxIaJzdEaHuCLhe}6(BtKsuirf@wY3`crV-WH9iSc=HYbTt+Ej00A3?ov$CmEA| zm+L==J$%tha8*YoEqlTu&Y=YpHxRE=BY_?TX?|;4n`VX62At|_9B3IIZP;Ca$d$~D0sAreDm&C?W3Fo|%F1YywhW-oJ<`!hO!rZ< zpbxGvSP0Bq9zkTt3u|!iH;Dkj^Dv%1j18tWk@NHvM%cGtYY=CIGV{l##N3WWvr)X`csA;O#9HP^l+82{$#5sA|ofHKx_*f%o6nbSHFBN zZ6FDzsjck{((Mw-zzmni1Yh6c5vi>3xTI#<@2zU#xWO_)3ZCLfgh;Y5uIjk}PM+gq z7JPz;dHbx1C;vXH$tKdz*!v0+k^#^Q!o;f0=KElgAOLc`V)Nm9<=RNxM#%qFMwfxm ztyXF?19V6}p!3DV#9Ss92G$Qqgd9K|4$tFS%5g0Cx4lg#CL<#Q=I_e~AK|H?!M)%I zo3E;?s~^09mL<9$sG_0*sa7=j!yytVfh7QF;x5>e2`%)9Lj?ythK&47ccc zavKcWh3YonzQzJuV@%A=ty8jU7``X|`Nr;w!pTJ{C}gYcW>mqvl-v*1A7v)A*jK6n zHxVimAlWCS1}s%sR+Yq^=QKk;GE>)O*^RDelc~7`M!N>7smSHq+lwf$P?RBOR}6=6 zKc260ZCrN0;9ZC+vr4d@F^y1Ya_u4U1@39!vPvB>xD)BQ|#x3}F^3i}^xMDe;7 zE$4#`>CCKbRGx*o`7xMQL@5rboKKJh@giFF41||c@H{wyRXaF1+Cu;+a5tRjKs_yj zo1H&Hw_D`2F$wrD^kAEa!;V(aD!O9O^&e7NmQ4)~sfskz!&p;%d_6gQd^tIMEaD~M zpq=pRvw#NlDTep;g%`2+!Tc7OQKT4toxV-7iZ3pgK9J2(SI?a7u#U(E?^y^^@)K4=bl`*B6>ax`W+l2IR=p7f#=RX{1PCD@1vu$rYVG3{9C+5D zKRZpjfIgHvs4ephw)p6q#;y@WfS--?l&;K3wWZR&G?B3sG6gvXGY>g!Pc~t`58Mj) zaxBaR!0TNxgDHPid}JEO!|o?PXrHS}XS_MsUal}+8iNxFY^W`lp(1`9k*ALJH%^3) zM`gKum7nB_T6y_#^wC@5`g#g>2OG2DA+-XPjzMu45!X7Z!G`h0Xjy)1(5l%6+>A5i z0lCXC9-}hg?qYU*y{3kw^5Jafxr3Xt<%q1Ca8!S(x4>aR7Dx72#;U=P)Z3=__ zF#Zjo>zAu9eSH-xt%0=<%So|Q6}(oU3YviO2|1^)t2;R}qpzbQV<8UH9)Vq~9tV(e zKRAE!^729pU$$rv)@Giq{Te4iOXzC%M~W3vRZs+ zLW;Ka$!YgfA-vgeZRVTk&UgH zdXlSL1jZ_HlFChca&|i2Wc#e^yST)+7JWZ`YR-5k=mvw6#iIH$r#(%;UGtBX3{!?^ z)k~!LcGt!|K}Rgs3af_`;vgj7O$rKsgEs?(9qB{|7idpu+OYJ%*APmZM9NK0wXiD) zY*|PQfSw@4#aIZCaPu6!#tA76+P@GG87T?CH+Hpv#4Ss0SpakeaOJEA_8ahMK?Oi= zBC%gzolcBmQkd1Y>@U?DR%0)}ei^Br8llm>P(Tnts|F)mmzSmnt1XNB=qkT|KZzR= zQxtwI9M4T!vDVQf*dRGKGsiD)jrkZo#$-gjC&h&${&iqrZ-Er=HcYI%awQZ7JZICSH&e2%HIm+5x73 zsW`!)3f85WN%YRj1gJ0ay}ZMh<^kd)J9-2RkQYP7rcvL$dzXz3ZB7GAx1g|4pwz&jaGqjcAJn(hwwi9vtFa%N?;nJwdEYm-T7QzTTwvK>G&9vr z*0CrZ@j9+`bh@_Cf9qyeF$5>ZovPc4;l)q(spN%)ee6jlquJz-ci!vo%x?Ll!J zrMw1;yKIh*DC5ow+lHdl)C(J2nTtxTmByjAUvGnb8w~m=-Hj^`YhHTSX~^)h@rC%5 zFytEw&RoBGmy2F!&U1oi0`d_c%dAViuc2FVNkIVk78asol;}bTHU=}Rr6qZ-sCd~O4^Q{zN4GfA>e;GcS*h)ye#rS6L%P(Ny!T()x> zo~QFdVgZe>OCwKzVgY6{9Mf$=ydPe&KvXl+wRwH{aa4J^;^#~srGhPj+?WTXBgtwQ zTbN^hwGA&Gi+-;wQ7OROO%_tv{Tuh%@oAYNDhoQ=OghW!KpJMCr5$lxFL6s(f(g)b zue)0yZ#QjZ!CBk93)D$P9* zfvv8oIR?bCtS%eiu>y8_xmafKGT&lL+tQFb`D%W8-3A`^JdB0$pu1zTs>Hv$*wXjjxE$Bs($fC@J8redlzfK|OrRB7_=sts@SZ?W=h@v;5@H};g1xHE-1q84+ukx0 zbG5?<8;#y-jwBbMM9Y9FR74$lt}s45)5iFB%dv;F_J-R@N`&SRq_2-2)qolZ-N-cs zhB8$=DGA9mjZ8fF=3ybyi6N*%x|Ao@GBTnrLkejH^kJ-^6~IQp;|d+cEY6D!C9+8- z(-uqiQk#@p9X?G0{mpN1VH8SM z5y&PZ=rzzL3NTiQrV}Rv@*g;LpQ{50hl7~g4wzL&y~E|DrT&Y1Kn3ra0WvNi^j}+A z#N|VgNCl1WNp~FYFW$Cg=?3MwVx>EUx1p1BN#((jo=m5;VY`;3q^LL$yc)k3F>(|X z6c!a0ZlHFI;0RPWUUfh=rw3j5A-zMpY6PO=rrnX$$tN#kV*_6ogjQDOC{`vXSBe`H z1={0yW|~^{0;Uqp$>YChbnzGDj^Jgcq3@HxlK^a^BNqCL(6MWI5g)Gw-azNQe9^|l zj|i^d;|qz3WW;*uJORCDbMuulh|~JuK_SgCZRlNbWP)8IBV>?T|Fl}hadH07uI*yR z-Z%OE<=G)+LUx#ph%kB&Q~JJ6$NNK#l86OSqU=ECp%CWl04z+q$O|9>XE#{)i%NX;rBR#tt@1^QH}*TXAFc*eoem2WD@ox0`d(hc zUI+}tgaf>#wUt%6zOSGK%o1{>kluY0sK70HE^Palc*}W;y|Y)L``a%RVq#|^ehNOv zA4r4%#JOE(lWl30IY(iPz}J((qS&(N*!6VnJ^Aw+S`Du=Y$Cjd!MgDS+$=z>lcJ{Y z*$CE;l^nlO5Qe*wxhNH%NHhA@nPWSt{@>U5CXNyDWyQeM)YRBG5?l^rW8GWo^HY$> zYn?c}(651kL9ln}X+r`m2Q?jzh#^_!K0#%c{rN74$^?FFL;?n6bigTsG!XbMz&3$4 zl8+AsX=~DlEoFT(Gg@L$i~zB^#lz^#xm)F1Ge~Os>rg>>ZkE1u$*Fjn8FGrH(Byd@ z`|-@b-yBWc=^!4|GLsQYhY^2(G0V_5Sa zI=mt;YJ|FjJs}M^up++XfIc#G?DuaYMlm=aFL08;-3DCzA68GZ-aj;?rtj3hUv_Je z>dWmWNfqEO0~ZkJCqRQxp`xL=g1Ets6r-@jh2MwYdd%_rR|Il$K^{H$5SGFpZv?*Z zO#iRi6@z0iV&ppX+t2#aFfqye{`>>9I^~ZamwNQyU%~$Ub&Ml4tQ_(Q()olZ{&*dt zg9ZNXHGKD9?uYJV*=A=AaB+7aT-Gpx z`mdqBzU2jk_q$%cfgt|-^+QGYJo#SFLg0<|=Sg?@S^YLT{H6FJm4H_a4cfLM@d!z9 z8@D<1+*v(W6}WjawddUIy5>~B@nmv2R>0xWl}EQOJ*qJ?-e{O)M z?pghbM=ugev3-~~^-hRX=+8xjO%u*`)(@8L{-B|jY?}1KgfxkXqTb37s*-ewQL;r= zT|FcwCMqNZ_yGewJ=>`MB`|u)t*|NWqOiBOpP9KPYh-5jOBn>0^W~PF{~25)H?ALd zjPH$Eqk^C=lMgro#Brss4Z#~6%+1KZFBaPJX$^Xkv1h~Tch za*o7t%sI>YF^;_i2BiX1(7?uW0Ry$W{zysZeMR-1g*4L-N4-j>YJYJ?MMX_c;l=aC zsw*ph=w1NtMv>qkVwQVt;5U|IHQ(`0&@X6p{AS*m`{BwiFqZ+3Qp`OvX2i=;EVrGD z`~KZ*@KsJuPJH~@2QVKaCm$Nj0^&7{uVbd9>>nJYrZE}VUXUXpVa>_1cWc4H!NI^K z35m*=$RN6U^%6clubY$IQj|?&LvZ}7V18M7c{58(Nw zjfG?Jc~z?A9>@2lfKQJ9;bheDw6CeD^RsG0G0Yj+JXl%-^MD)uckjlGeAL;3hL}=r z#Yo#~nx~LU1Ko8DPGMsY0^yG{YTW-DIPr7 z{^lFUOb@2LppvGX%1HI6Yz>IICthH7jYkZ|zoBYmfnV|2@BFn=cN3 z<}eYLjgz*vS8}qq3kQGo`bsf>&w^cFUmreY5Ec$jZbk;L-TV_t$+55AelS~rzVw;( zYhEswZ6{&j@T{!YW|8;8|MfIg*u+}elXn1%5bufOibA9UjJ;-Yh8u;UYsK@2Dr@Vv^5f<)S|G`u|x?^g8 z5yyGe^JGg*S9f!vTNFI5RV$nx8Ww}dAR=Ci%BLxmQr&Ts#y*9lv-$+(CL{Cdfr;A! zof=Hf{UkEl2E6Q~T=goq1>in9ZyVK|9B+i)3xt{GB|pi3=m+N!gb-=Jh|7mRk)E9` zk5%i}aD>X+jR+5Sb}EVPd-Iz3@=edjn2<+VThEEI(5iDfetp5EuRjwPM^=x-#f<{0 zFR&|sAyHQ5Qfhi|72LL$^0f405OqUC2M0?^{0H;=OG`^q@si9JIJv84mY3C0GH`t8 zNenK>I*u7|I|t}q^dTGzxDDb)w%jn@cce}e&qY3~j>7f+i%V_Ps`^l>!=%vU>(GIr zWky<>ACtI@f&%jW`wGXkGbjt-6n352w9~79l-Cc}54z0d?S;Fg!#zFEzP~2)@$)My zD=QlCgN7hA2zOfKxXWkWzSTxuVmI5{Sjy{%nm21n?E}X&HRv&9K|hrqhPuakBal1i zsf9(=pSMi))3?iG zrP8|V8g8PODG1ASbUtb3foZaUm(~*U`SX)}%EChXx;hFzzOmS${Oanpqx}NUy&nx_ zWe023<5aInraBTY>(zgQrP~Ec+Z+SJ&&iUQaDIlSv`U~!-mbb&Kck=H&mSbk1x~OJ z%`@NxJJx{=%I1QeIU4si!in{r9a${ZoSm77acPXt(xoLOFt!9PdTrP-!8@9cipp)Z zG@=DobvY#4Kq343Rd8`}@oBMHGteJ$kU=JiWo4>3R(2*WK)|wo{CEHyJEtpqmrxM@ zH#YqA-=&Q>P1ysHM{LXM4u9Zzo7`8vlKs+JdFD)WzvS(3l^?$${B&RGrW?OWPk&<1 z8e|*Tl-MW#ops$;EU%yP9=jh|c23UJq;J;!>b*%~w!beE6Z6`AZiD3QKYjt0W6SI7 z(jpDBMnaEjMA^P{zI#q}ayVWLm!2}~Lm(Od!1hH^C4q zM+Qd5kEUv5yxfxELqlaSZ{@>>FmU}vMkoPpRJAh%(`4-8D=RggG+uHRL)$_2 z#=c2L{`x2oM)uXgiJK2pl<(P%jTgaGNJ}gJ#fzFZZ=U{n{@eM&WAC|CA3}i@$o0lS zm!y7!>y4iM_KY+MtS@Mm)UJ*melRmMbgaA9@&*qK^O|z}{K}1wA^8C;l(?lH1^i}1 z4rNny6|Fo4EZE(t#89nqSx?F@1*UIqVS%|5pX-iKJsZrbfnfFS(UZov^kynSt6!cA z!bnN5NRQsIdggcT>=E3zYl4}A8boAds?yS6+?dqnr8knTnB_i$JgsH@CO?wENe5$BB$!?j!-vYsb=%l(^(J^17NVMwE%4@nNIkt|u=0tBimGy4 zdoCJU4{;qPMu3NjW11vI(O7<7Ua%@UD}+KbCnqpIJ})@9xVTu!+S=cYlHTGma62^f zBHW!$kAuM_rmZj(syh&ym}_Vpzh|eQmgMKt-2O2g$9vezi-*b0LihTpQZj~9Lq%o3`MzbYvb8a=+Wq`oEiA@hZVZJ8 z-Rp|C{|+DX2*2|OkjJRy+1cA4!yyyo@6W8kWj-_w&%(H{%yDcVM*5r@T3V(VkkglF z5ACd!tD5P2d!@|5(H{`dythZ5Z^Rk}M}s9Cj?jr$E|^_{H3DMQwx*_x#KebLy>Q5Y z$Aiw=*g5mnACq-h4yz*|Pabd5RW}AHm#fiJ)mK55&PRJpFd+Jgs3?y+_d@)sngbUW(b*?EI6H z1+}%m%y*K5kMvOW@yhe-3pkgFh=7k#y|KF+nlG7_m78nr;83xR~PD&GZRc{p^&k5@T5 zJ8R$IIlH*1dmd*3LJ+06v==))P3el#SPTKkgB=4Mx{%CbF)|#?g}XJqR4|kj@GmU;3Y<~} z0{fJn>a8}lYY1-z{@6z;sYO*~sgiU&oC7@EoSfVP_kS%=ul=4rW7DOVij_;t(-YI_ zG6%>LW}g84^PKYaGOR<-ux$yaZqV5|Z{s4)30GrTv9kJIH|_mfj)atrUNXqRA)M{e zZ`scU77an~ZNuI^cD%cmhNe@K%SNWA$=mpUah8dcnO1g_}|1P``*^blT2C zh-g&i=4T2UpJW!;+uC;-5!(N*zrxe2G}UBOl1+`?=4ZVQ^{$s(z`JO*eOJ%7)-L4g zRPsx9#OIFSvm}M~D23kE?o?37IhB-B{r+nD_p{P7GmKY%*jPJQ+0A2gXP_l|1q%#k zaP?ejTYCrV24#LN9>jrn=HgI5vq?()GtL8XuUgeJi1&gTm68&cCFP|sq~_<30RNp) zwN>BFnUq@bvdXL5e}NuQ`vMM5AX0%XKxY}pkP_o}1fN&>5Gr0)_Tkp3X4ig7!Z6yQ ziAY|dzd0u~^qk&rlqexSB$uADwy@b`j-bpRki_l6s38{(!Q|MS96ufP-vAA~5SL+L zC!~#G;jCN-FXVv~AabyxwZ&O9@Gkq*c0gVdq2*{{j!F{Hl{3T*)^Ym?QZkRZkdT)7Sf^rx=% zm`2O_0ZQOdRP_5(8E=7opBTY=n<5@;4M7+Ib0FznDQQ7UN^b^@P8hlSG*~7GL4Kn;#0QimI|Oa12Gf&slCTD^hIC$0ro#{ zGl6aVuAhjNjg5L%Zw9qEk}@6=8zCqS z|I%UppLhRw>7S>>NC;UX_3;RT6TMu;zeFbbn3|ZNMV($>(K`*^g490WDkVNtaK1kx z0Io~%dyG&)s|Fo82ad88(p4oTK1odbD5>+W;5}QI=g+7wHuy< zKposJVt$97L|%RpDNZ)aRUh<+F<$&fJASKRp|Ccf~Uv3(hV*1qxN z4<@j-`Wv%ideR58!xOCkalN?OB$|FSJ_Hd8I_A$~w_zXpbiBQtkN(@232o~$K?es1 zU{R9d3O>3e*q7n%9Zpv&@txYlmX|M0`q)bJ-+aR_E9Yv^_d|rNY%WO6Qr_z%6_P|E ztLcQY!KXJp_Xfa~hR)~X$F~@($L3-t_2oC+Xzr(o=-G{|YaQ#_J1IX|GK6BYa-&V; z5RW7`CySWHh>m~UG z67$&9ZKgo33O7MOYU=w(iF%gWjVa+#n{Jd}5Q*nXD_#(Z#Kra9^8Nn)HkJ=Z(NR%j z#}fsuYK}0>K9Gz}cQu!#g#Cfjm=7OUDDXyY>!KvD}MvYK{~!oUw6{ z*REe7!N+%A=z8rdB#geR0^|7!2oZPpV;Ji&ny>HIg>TRr^~r27eDF#xf8MO>&~uN7dz$agyx0`_@a6rS4NX!I~Z?{_Oa7;Tw#8 zjns*LW9V!1i16xFt1ZhDWhE^J$6zx4{o2%=waSg77?o~M`H{I<@t*W-wO6i}9jGH89MANRsZ?$I(F)rywqGq!!p3ZbIWI?ilp``D{4gmE8wx({1e~__j(Ig+KiD>yH-;p=y@58S*BSYeWkl=sMX+YYVu$SCS-@8Px1CEnaY39$|iBlKColwtT(lz86==)A6dL$&hGI z+hEqd^77K=-ABeMrP*QO8(E$k(Kx33?6{g5vcLn6I%P@aP>+cP|17N60c#b9?SkYr z$hPi9yVnerso52enm4;PnYthf-K1qJw0GTU7~dH_?DyD@gMi(U%*kRFe{`i{_qoVS zT4h9<-^RDK6TcIWDO6S!tT8CWvtGY;DWi(>SVd;Y)wjp<$W{W#EOXzU5(1yk zFCLXPJX$9P*t7IWl3?`VoPSDt2Tgb%&~xgn-M1=A^Nj{tAWrmeNM62mM*W^nG%^EP zB7^io<#>3{Ys0sO?3}07131`)9)Vq0Yt^@1xnsdzAR90ni%5AD_ zem}Et0|L~Y*bB%tk6r+4k*;@}^7Uysst6%+(JgcBEg^VYPQ4$=v!H;u-1@qg9?h0p zP;fp)b6vKazoW%1$*Nzqn%i+r$11%(b@STiLov*L?Xh2d69Mj_WwVlNt_Q!`A{yCm zqUwwNK}sB}=h4@~Z;nW%Cb6vlceA?O(q(H{YeVOj2A3{k!3M-apWSBX~mdK19 za?afBwdI@HO-w`#VON~2SEkN7lHJwFGln1dpV)B}#qzCeUr=ivj0hsTUi?C3!meo$ zo(IK6JXG&6hXyn7EloGRYW+#)>~TxjL2%c?i07lf5ta?gEx@e^MYsw?l7H%zl2z^6>^=~-4J5V&jV)-dbQ;} zQ{rfcJY7rL+$?IQ&NlY^-QwJK6=KD0 zS}!?(mcj9Nl8n;zlS$nD~!7)XEw+(vI=^x1fR2;sXbAzzI@kz zA9Ntp*o$U0J$M&d;Zj`dS+(7a)6v7~5ppe2x6ScvTz*g=Fw>WBr#hRHPkY#l^)q8q z5NCZ5$YsVeP`~9ig4&X=_8!mCUb`^yN*v?bBq!bSnh#5o;gbzn{#Rjwk=!+p7U&B1gx^ze?Q7#gPD@ zTB-2>dI7A*J=ayzDx4=KCK8LT*Yhj4zCu6-Rhj*qPUZo?W%b?XRGBXKLfyXk;Z`dj ztPU*{Hy+Ci5huIPKQ=dKy!Y!xiRFRoS^&B-Vf94CXkV_mmXTB72nxqOj`@J3oL`T4c8H(}*j6_DKUzk|CZ+RQ+Toi0Dn`9?QB zDx&H#kD~cv{fcDaqlxK?9(<&@{NapIRt9=+s3T>n)M>_lrzzv?EcX3{T5&@G5{X%N zwr-xtiD6ITY~z0xz-^#=&@&OdVD(&86(hVG+X2x&*cxY_wsq1fEko^J&|KD!TaL?3 zc}?8X2x%5Q^#|8~&XPd6neg%MRr6J=uacz>K}dAc18I1DIN{{Vwwi#rif2l9dODmyFrKDwaui#J=jf z5~M`Y9|0qV^mPBqvqundpLa%}*T!70S6jivupKF!wy30dGb-4u!`^0c>A{YujA3HqrY7ZtpPN%c3&QtF^}R84QYEGn{qqqht_e*Sj}21T@i$CntpuU#eue`;&-b4k`Nh9` z1K!=sji=CteJEHT^)IPkb;nIV7Z8T+i61Q1uORfj5@V(t@*#FpXS4d$*DDZeB|#hP zWIU?(Ww4y>_T@6GP!DrI!8bZvbE|jLBicJP>T*y(XX#D!{_I=>+S4nLi`FmFCsKe% zL>0}qk_x$MI_kMPD$SPZ>0Z(_{umquvH01npXkYBBKgbPZKmiswx<2FQ?aH?ZNdvO zh+PzFtD5S$0RZ*13dqJ0jxzcE@P?d4^fJ*2R<%iJv2}MbHv?!i_Q^~ySL?S|%CW3k z{2hHGBhG^isc4>{#Im1#m~*o}p*cfZ=>rp4b9v=ZN+E}lO1|s)I)IoWSLe1}r^yPy ziD1#W7U3e;J>d}{OB8iUBcJ^qKyC&5_G?mrH0M@GSvfj4=hCauRIz7Y>M-&@gh*M+xN!OtVaol-764}PVA?|@S=yhDLoK?Q~pA?m7K z&6Hse2q7PD5EWFqnPtzDGVk(hY1dbsy`Fw0L-LyBCpc8ei^)?g62bO3hT1eIGqm= z*GK*f9U)3IbyqR^Y&EB^D>tr|)Mq$x`N4xk1Sud6i%+o2%lbK{Yd@Opw@qu$?iK1U z4TdkAT%GM$X~Isbp_eUveX5O~BLOm|c#BUftBSS@-9+KL*!n0!^v02OGlXmZPm2fF z$WK3`RVD&_d~8SLHJJe2_}CbL%oPdcVxrYqE(TLlt(V? zn+9q%kCuLoJehIopg|y(AMAq+rT!+1Z{*Pvh~4j&eM0bS10%;gE$l_>$;>$dlfP7t zKx_nz@Y&APs&|8taryTJd}Vt(&pBxGGCG#sdvBzAV$x&b#f<=>hfVZ=_^jJ{r|@jO z_dJ{CdgBO_v?klQ5t3+kJ#}XXaabF*G*z>|FXPuym6TCXQQ);Uf5v{j^5eL}Fv7d$ zgs54OK)v;P@3X{6^vRTWz2$@KM5xeUu~fR3l~vt1_e|aA=_u||iiwStzQjxoY6OIa z$c+!pvyV6#{LbMrU)U-U8X6EN;X{Db^!GtkRaFa@ zWdIozxh7UUvoAANO+tVFzv?daLg=6kGehA9Rsz%f_qxh5No#8=_I|ML1aUUf&VOu| zPZ3n4nxW%j?%;o94PX)?is~Gf#jDz-tQ6d&!M_ubv%kKvIu5>+Yc-|mR#w)6)U%%m zNbB=&g^&nA1rY(84GyBSL=eq%k{GsRs4O%m8Gf1SG6Ri>VLD5+`&&`z;zR%X&3vDF zN;sq%^|bDw>dsYoMJKT0&Af6w8&%*O1@WZ^V8Kj`Z(ZzWxuG&Ta@5*xvpl2oC}}Q(KVM%IlLlDJc2c%M5t!m-Q6V<8Pl?wLst5m z46gWSuC{irr>mSoFJ09L%EPfWF4-(M4U^lnyIo7o&<$2HsLsOo%V7ms{hFk;qr(%G zaUaky$%7j|raRb&H3AF^pCh+oT3B%CAm`_&^@Bgs*W$- z_DUi&g3i*G zIg0M5fs%63h&T=QD%gV9Tbv~O&cLfvv#R8&VHZ~l+4Auv>)kRpFgiY$&j3OFrh5yM z@vr%So*13Vc@#jjfSpCB?o1dzkI~S)gfqLX4*aw0qQq(qr$Y+j5@xA+wk?8}!MRxf zFmXxM#9LkuD_1?`ZLo5p``=#fXE`_skBLp+l@oLeoIm6%5QXx%q;>ezgx{e=K&P-)N|>6IFqi^1qOoGsx8v4XZ1> zPkm!pqV>IRwgU1mjBmJ9FWQOUHV*sqTS=Hfri9CxE#CQK%b)6rnBWXnJzEo~li&f# z*3Np)c=s4DELyATYs@)l%TL85NHV(N1$ zc=_xZ39~M!ZCk6W9D;T=EPT@?T6#v?X~emf@zPFj?HO+%Tmwto<9Nf^t-qBD4>feS z5u?`ZBDOk!)o#)7s3nb;jRL^0`-k>G7^kC2-Edu`u8-K6#-oY!U)13ip=TCm`S4#0 z@fEZX!+O?)CVoyzjB`g(b1a@r@9NUa#-<;#`hIDQ_UYGVeF|gz zN?pRLCGR8Q$)6U*YO|I6$xlI!6^RD6zy1S&%%tSg8e>nw}OFglTLX0bYk=TzhSA{pG=ZpKp;06qR9#u`@9D z%Tcfk2wEDhIP6R{WPP2HWm=&@Pa_QiJ2L&|zN64w(S-JHZmivcSiojPW``Mq#|G_l~vUOapoO#p(&@ zC!_i5Z0dC#E1MTgK&zPZ0f%WvY5~8Cd*)?8)l-dW8L(p|&w5 zVV0ML#`?Fi{62oo%HTy53Io&^^)KY$izRUP+~BhrE8CJKfQ_L7Z+2NSZ)QPdw;8>M zrdCakZduXy5`x=IZpNble%Yj3y$4}$Om)^CuoGs0X{fn|B%!;@&g-;qkogZb!@tEO z^gR!HFSDJ@^$l#y!H>f^_W?!V{d+&)e`GLKM>D?=+L?BEcg(=v-i>{@ysC-}IDepC zJ${^;~cuZYs1xTDj11UHyQT!g_XhCY~?dnNK<3ynn$EBsR98-^@>S>t% zEsoioNX>u!fH{W}%Geklv-+C7n1$ta042E{CMzD{gS*${Anq|K<&ero| z@}<52kU(8k6@fTL<&2Tab0LW{t%G*5QNlt}-M#o(RXO&j7A?Dfa}ID#`%RC!dxmj3 zrtkPK7MJgJ*sh;jDl^1|Op%*7zG$UuE!KdS8re0TSKTqgEN?E0)Hsy$q5b^`YAt?m zg1P!4enp>4_ZonHhJxPii-RQ!5O+Woa3iq7)zdq$UjXV0EVfS!2XOf@!^24%-#|iv5!l8WJOTyDzXn)^ z-@bDvgi0nSCr7Cc7_7fyv-@+pXB=f08R?Ezc{>nkpGnfey7*vTvXIB9(7GeR~MjH_yWkO;c&)ncptyG;V1jf*K55>-pM`w{D8;+OpP#vSo`II7X zr3Y=VGHI@N^7GYLxV#VhA(v+zg+ji!FWH-Ix@NHZ5}B=5)*BhL%d2}&yO`Ecur#;| zFvteQVrIO1JwZRY_FrKzUL0zIHsqhflb$~IK^|_fEcI;7;v)M8E!xSJ=rYGGf#*M7 zC)l=&)p0u_&Z3$1JZaOf*tGJXSoqj3dNE8-FY)JJx`_HNPT82v5KhA!Ff%b&OKPkBj zh0JFiA-N8ws6MnpBS@bg4HC%fH7c!CB_-YbFVN)^6;zxdu>9zdS0>hGAI0$tX5IM5s^h@O35^@PE& z=a^$w)?p;UKRGF+Di==-D&p zJ|0XbutZC^v9yyu5RWq-t*}4cowJ=tpcpXkjZ4MlU$nEbTCdext=lNV|7Z3=*Sp_f zRYoEYN`xX+xM+Hf*w?s(GO6D!T-KRMNS@(VrC#PThmTUtm+JD9d@ZDm8md;QOr(8=q* z@=O!#T$4Wy;_#M>;9pyzyeRSoKLD>Gr>C#GyJ2t*KMG%<*=w8eJRHp9F z7R4CObX*@ZYDPKLxbHQLvXActyA774&RL7X#o$8O<|csN3V6SHg){(TK>$W>HrfwZ zKLEw93r7$MNWd)veArPifQTZKli|SRqe{TwqxrqNcimyIZaZL?3Y1DUwUxs4{4VQJ zS~q!hx8q8F;&cGR(Pq0TB59(r`jfYStlCC;@>gZ7T@wtYEngi(p3iZNcL9G13#P?Vq)-p14iJBlnmP z7dJSVN@;pSFT zQPbntDVyVLZ4aXMI6UoIxNj~mar^432w34 zkRqfKC>p&FTtN}jy(9_^=Xqd5VF19Y^#o>i{k*kQhxX*t3tuKnvN9qi_*NnCNnH#C z8v;Of(yrQ4Vb>;gn}iw1>f8PAx^>$?s95sA>LB*B@}7YFmcDyk1>! z8INcDd~ppRK-9E_*V*Q2*u13E>z1I`Ks_)%i>{_P&y1Kf$xM;G5kpxLMRI@kF zIbk|XGz9p=f&|TB45qrEKvoS{c@;D@Vao?Z>-X9zMyvzun$FA?ZU&@jk8F>i10WUx zo`n-NP00LE5PMI%(!L%dmn=MXmWHF5w!t|yuBn$(&JG^+p82~`M z+{c#{N_d~Zed&yGWa!=b$D4xnEshTw!{X>#ZP>cZ%bZlbq-)!u-Z8fA)_3SObud^@ z!;M%57yL#s(X3ZRM&Cqpay4jJ5`6OZ2*kG}-iEWsOJu2#;@fg3&=%RA60 zd3e-5qobz>${aKrt$-Bd0j6%~+K~*Wn?z?T58xaGT+pq?CMG;Vh9ycI7;1)t#4C_r zV%X}(1R0RcX^qeSMrg+5M??cJ`ptC(IG8u)B z|3Uy|8hDYwUIQeD*kf97U3`7T@pP9{6C4ReMF%JzzqCwGve*8YlgRkr9CaLm+pWgw zP1wz?o3$j^pW0aPALPC==a3;CxL(+S22zksq+yHUrGj+Ai=~XoLI8HFYwtlXeD*|m zE*xk(>BOoLIxoAO*J-O)J0VDWogX}ZK~k&d>uGXxD*eR?2N^sFqc z3{|72Cq6yUM(W}woB9T!Um(=dp#nNA% zT2gznPJFdBP637P<#;(XT%03Lk@o=yjGLc}()X+v>A0Iy-2;meIii?VX zoq6E*Q_Fw@;MSCvw=5G1Y#0D6o(?1^D@#jKsU;rxHRc zQu|Zr9$xgOd>LhV^$TpK{_VRnGsYzHVJfO_jC!w=Ug6oZXRmeXn*R*j_*WQB@RajR zj)N3kV7FFRUw?Lf4x(n68ryq%oYse>{HRLo;2zpSo)^nhAc!}XO@xn69kk`i$b)-6 zufUVMIJO=D?8?kcb7EprJls=%|9jP3!mX2Iq@58!=@uSOHM>JfLS9gWID;s3Iu@A& zYoTP8d-ufSH3h&rVgCv3?{`z1y^)~>*(s-iETDzXeyY5v?Cjpl5&RL2Enmb5Ua~H- z@}&Gu`|g&l{8GMFg}uB`=()S6$lmImP+@0PVsMwk%}qU%anfO;*knyo z&I5|Lpvd(yR&%v;l`qnpdG?fQZEI<)&g=p&Ul7y#n{UcJm_-`TdC?XRmtaA5rF(3H z0Z$mBzcZ!X?0uQLGUI+BW=#2s)8vRvi{oNOK@_D-<9o9zA+K=C{nvN@zlXL78p2`8 zuc4u#hm9Z!%x-^_WD1d*Ns(MUxG%)^` zp#>b$w#?$<#;;4|0Cutd@uSb!(b;4&u<03N{r859pPEZk)Sd`){A+_%Z_w3WX98g@Q5zL{vz5 zb2ryRJD1aknYAk|3Tsb+T_VWC1u6s}KK;u1YY2PEG!OJFHl+;0!d}?Rvj@0%JrC`L zFE(WyFD?%hm|{%M519Z2sC*vNjL7zsRo&82Ai}vbjlBb;qm9)z6IW-X)+0Q8I-aJ9 z^h!VR_Q0|v>SOx-e^$GR)PoznWt}rvZpKuq_T?#85Mz0w)VKYj6_ih(CI?`iUipa3 zBP$$qfmXl?UaOFoiK#0t63AE7@qxL$bc(&JD>y#)@@$jPXfhV_o?e%sc43?SGVD z-@(Dbe%u@NypLW)L`0e%Twhi7Xjqwb#q}oHxUdiy&8x`bP6M;ue~5^njkyU46l^5@mBReNgqD8z$kX!z+>%}LAjDo$zg&>q z9{{BVDn3;j(mwPY9B=J_y%CV;f`c%HC`c8d3SzMvdNNy4XP6BA>z=YY**a+nBAaM&=iShzV0Q)%w^t)B( zI*{6#zeEkursg#Ix+w-s*MK894CZ72(oRtQ{qncQjljhoPVXN|!6zt+?F2Eld52+f zafW4@H+1RMd#DDszzWPj3Pjs7x%y23y}Djr@P0-A9UPy}w!0a8D*yXZ#f^-NZZy*% zl?8-kn4EtyFqj1qCxAc;qEUN#fJxMp=@PITyUBQNZ*K?IIi$qI5C7N2f_yPiQ6RUH z4#ox@WdHf|rveU`*lHr| za*~p9ytWC?fV(u1e4~I%*vI@4Gm5y;SSJi{EM^kv1J)?VFTrO7_v$u~Ac0uaYUS%5 zfZjAZK1$Xi(js{_J7~eJu2<_dR`v?m6iJ_eE3hmo2TI~78$<_oT zbEQ_H(LWmQ9v+~1_W*sH^bVN$+`YUSv_OV&6`00+oWS_!FKzr2{Hr)Ia<+!C+Lk8j ziJK#-Bowl?uwEdNtt{8S%&3nUV_(ZIGD1Spbm znQ;iXS^xK;a902MpG4&RbKbgEq1wvQ8rTQo1m3ue-t%p*3$6znDUv>9-p&7XRp5W> zlf#UH$=iihw8Afc0TFQDgKur7K+}|E{r=14=H~c?t&*DFSywDYCWrNTO`M@&z!Fn_ z&TFQ^-91M)Cl|Hz4>Qel;G3}tdHHfn#NMl|td@Gah?P38u&}(WN(uH(UQba?9`4f| zTB&+)yu>mz)&+k3?#>I2jYOv=jMt@XYco;X0a4(8DyBim|0E=Xk*+%s2G%t`oyrgC zrO@*CExA$3Qe;`yYI?jgtwoIj5)>3iR;j6_ilvg4WCET<3_2X9z2D>h$y7MJV!jPD z8Cjs`n;9Yew=Bvt=M&z$r1g`KF#*08UzM5e#ooPR!pgJ0nAimWQV?o8e8Y z92s8`0pU=1Dz<6b>P+&zlBUO!N6P%x5`3ww_DBoaTpWAD3%G^b8lNg?rR5=BnJwX; zRT}u?0Xjv$bvw(mj_!{xmJw==ftD|P+CE?W4U+4OGj5AWV?ZyZ+2K9shrZEs(HhI_xz$W zEhZ9OCirCb5!EK|&2gddo$D>hsCaLOA0XW-c1K7F!scor6xyvh6TTotbvY#f`@^9v z<|C%6UwmbU-i|t?yqNMglc&I>Il4<4SlIuHXADsR{ue|LefDVP*ZJ`_Hwu<3{F@8Z ze=`u`@RHW@d~s-tuLI~L$;r9O@ek$XEXiuO@c5r7zagR&WeV18=aC_iB_cdj#z`6g z#0@#^^${LvfAFe)^sq$o#mMm)u{{h9zF1HIs=y#}>i9_YsEA}%xy4)XX?i37gpc(m z-tP=8ZJcZTClt`gB>DcZn5&w(aJK%CtcePsV`j>il&r@jD0}35~r9+#lz#W zzhzu!=I&fmuT2qI*okMLWoGwIQOZL+I4*cJ3>{MK)i$;i8YsKO0PlL(RgNWm7PIZ#RdhXq)DFo_*73_A47 z)hH;m6}(mvPcLn@*dAub*b2nQv1R9ibG)Te1#-C`IFiS!f06~q>i>OAIJkssk%=PS zI%e|kh6lr3^Q1^;LnnwNe*-(n-*d8vJYVl@A+^uHr5edme?QKo*^DbeDOD$O+H}(s z?dpCvq?_>Zu4jIp=s_3$%;A2;stwztAg549IhoWhrr`%oU26*5Lm5$1E}E0iO7`^1 z^>hXk(4gpkIlN)=KEWEVXQ9gX7q?9V%`0=9^nm`8^)}^iu}dvHe&CMbmgp*Tr!fi$ zY%-v;f7U9%*L|6PTaIo=hQ)W!kl&R^c_~3(mUi|%Dk)7cvH3? zwa{JieRhmgmIK#8o*@(L$TKp`)iJ|J`Tl>Iivgw=i@;H}tOTss1&NO5e6J8!audg0 z{rPU8$WM#3+8R6}-SfJ**$OaPwy&iR~erbqo9*5!^5f^LOGlm!H9C%VDs;*FaQD=ezXkR_L!oYL8}nZUAz;gYP)h9{sj(Adfuvd=DBOJc#phpqZ)Zc24cwhwN9J8ZJ4n50|4->C!E7<)Ae?KmV$7O7}vBf zElRvZ@} z2_>HmgHj$@sX*C@I>rT$m`Bj9l{p!`8jOtUu1!+d?+&f>#I5es)5*rlT#kt+A22Uw zT0uGH;0)_02n^_{+7V!>b~MW&bbidk{inShHnA;6Q=|!T8s|Ua&gD6qYBbystz>Eb zv$bWjMbI<$1*q!vEKf4F8x|=)!pGHnibr9EYpdjp^4YnJ?@|1pwA8}&HON+Ybra^eAlbttr>~Z<7%?`QVJt6$UW4HwC4%B452iJ zrc>>2b5WJ$#yjDEqGYGW2w&>cgpx&eQBNr7h`};A~$N zcm9%@@%n=1L^3koxovA4p+eQ6r}fiJmfBXUTrb~q2fZVk^7ou|y=I4Z`}J$46drG# z-VzSrKh`5e=*N>NvAvuNgAUx@Q5Gq@9bmlA41ULj6yWzo5eBKR_g)M-P$|apj)qoY^wBFagC1Z z?g<@JbE?JhIi(5K+1NOr9#8ozyfTg3{;{cH1v~h|yn?iRUShw09eC-f2GiHC>Z$%` z&P6kD&tQ>x+9o7lo!`LTBg&1a7bWZ~|SDDGDA1q`yO2ha;3mhDLPJ%ZgD!}(C zLBjZaj9Kt`opuF;<`~T8*g&q<(Z!cmzc-nxcx{6kz}Ac7q~*t!u(~|&IAlP8%OW!} z9rbWs^%1Mmivu(Hh?u*TEW!8J7riyd?txC)oaBb3ddLpO8-qsz&Mb<8k+L11|7Byn z-rS%GMM{!!y%`@{>;2Xv5yB|#1}yYglKJEw3Pwe#UG8kiu~w<+C?zL^(<61%^_xCz z4aEy`+FdP+fS!F%LSZ0@S8Xk$qIWsUm%ILXD;;t4$b>76l6jY^M@_x-f{flf2S=Fe z=9v3C-9}#K?6E1%ol^~6K9^OU-)pgSo9 zf&Yv(UdJ`$G+eh2NxvyO*r){g+AcebstZ1uYvpF=O~cB!2nlf10-_tQ2H;D%NU}@% zTR1;?`UxgXY$!hg=c1PRGSK}4D>!W-ZAQG{#Kb`V#GZU-$q%^;wCIe|~D6?96&~h;ms0Zl6CGskg$K;C!j&nV$k6SaeY;}>A za+ce<);x~6NTh8bv)S;5pIk8}95*(QwAW(q&)m?Q$Gx`f$Ty%NimI^jR#yHX`F3N> z);PT-s8D_1QS8g*oAQGtgWy{s$s!LFi1-xTFrbS=l|5j}XIAD)#4CD!en5M;1f_-U z43?xUlkV;v+dH}Bw^4f5 zCVdOXz-P9%#2ero^~Y3wo&A`NBXUon;P#@_clzr3#TY)Rr@w0yhxU6)l_|hI8Zpy2 zs-_D`?CfUxMBr4JRBfhV@3ZLyH~is1B79R)^>3_5e8oZc*QmC#ygp1v$$?nTAmITu zW~r*}@c7*=Q828$%IrIEj>Em}1oS;Bqq;Z_x z?TR`~x(_txu!ByzaE5f>90WcXCoMJ6RxS+nE1HU$^gB+0&Eeeg@l||h7clS|zLsko zAd6A>_IA-e zS-k$IG^o{^V>|$EK*yW(MJ=_xr1Pyd)&Y=Hc%sQkaHOK5!$8y4-c@2U(=<^blW$w& zK1ZP4%JOnuJ4#*S37;_P^v`9>a&-@PHeF%_VQ5mrd$dR8F|}}Vq&~Ope2#qIE^1Fb z3KS0%-0ZiWKkAN;)0xX4NH>v=Hjh`J79x1rMl$J!^ zHD&-_HHzwOsD*`%$X62~012)2hcVWkiPs;~M9&PhrqlOp*8+||W>8q|CQSYR>ShVQ z(@24;L{Xb%k)`cbIWOUcnu2is?*qPXlGmEOB{6FOqv%2T6z)9G!~V>1Mjzh^Fr@sB zgGl+CQ?eVD68wY~X|5fK0jxE$q%qX!!Dkkz%LHOH$A1rmiQbuqFp@($k~1du2*2;2|z{ z+Z!~a%S%OOlu8rc3Pfv)urFTNPKgarDTeE%ay0{J zwap4<7e+1>V{Nn+VT zzG?&wvV4*}lG8M(j)8}skE{OIRNvU~=EbI|BuA%fg%>t&U(;n&7w4_bDoWy+9I(7LjW%712EgiCd@YLnuUUB%5aGpzw*t(0&rzM_ zt&K`tMF>(_n&!!BzU%xO!~XJ)McSnmd;P*D@I*z^~_ z zP^SCfL4e6s)Sg4TAjm`d{kh3;bLV>JB6aQ^YK!oG3LZTHf%kk!Ar-FC=^p&&j zht)?&`RtIl)O^Ba<;u-&yTl7d^h*QPE595-xZ&X2GyE*`SIXV@(TO-CE>)xSVG8GsAU?R*a@Z0_U$Nnp|uyzj>BIo zc-rp|(hSKW%@qXf7l*^YzHHQEr>Ww~4zcB&{G#&Ld-il~@eq93#I3zd%8c!m zWXg%Wmcw(#KkjEMSB&EdX-{-L{YYSIP0j!=B=LhRYC)Km=*Uu}zAhQ5kP0h!wQ{+T z6vW6rr+=o#&JAfl2QJG;7YEJH@3*8aKlqHDMl%H4Iq?<&6b?+5jZL|ImZ^*Gv8;9W z8%3vIT2KI~d1#%)5E^Pdq{`v8{4$rGCL%lHO$O8eRr7dXHNy6L`SY>yzo6Z;y-02) z(>%+LKoPexHV@lyHM;3hd58;4%dpkiPZXUtv^?SAruXMs`Ep-TOz4XBM)xu_nG0^r zJ^;a0%QV$`HHv%;4KiY5#rcKP8b4Rt*){MxJ)75d24Z?CiDps(E%w>HHvbT0QBFa; z$U?R?>mq^lnxeIupyPQl&8(iR<27-i-m`;swlLz6H6Tw0n9iuJgTmW0VZ^DqU01*Y`WekZw(!- z?S-wmwYe;3DJZ3Q2JNr#gk&xNyRT_Q_Lq~`%C66(RWy_V0db?NPUZ-YWN5DQPHyRw zg9ul)weV>9dJ()39v+^D8&{n2KBDy3fq>6M6chs!2&2CI6SnNGPcs0TVyjBQGZ4AT z!yGV2yan)k&)-o)#Hu{|@8bxgKd2DHOQR(WtwVA4 z(SN*q#>36qtsWOxo<3D;j)=9w6zUW}hbizbEq;%*0Zka!VtO&CGt+ndtAO$KxAN>& z=Z7vwTE?;_Hug3?)9ESGQy$A)? z7VbU$?q{j5C!ip@xfs(el^z;adw=U)U9E^AwJUNKUDSem;XBMTiEH` zHGvL!hJiR?EhGt_Q1u`O9qhogvfXN0Z@cUb=PPiKCjC3 zydJ*%dU#AFC23`0vDxzS1-M>rDr%iSo4(*goMjj*W_VO4HpMBQy0~+f7Br&Kt%`Mg zl@bHg-=qa6ghg}$WqK4|W=Rd0CX#05BLczx3qZ*^){9iw%|x0^fz1Tsz>G}UQk+sn z!yioXOjGd4Tlg767S4jYh?E^2(Z)^OT(aK5D_GdAV_SGOiLW1N)|-GmPT?Ckd~xKl3>$FkR&Ln${c&7Rs1{ zzmc_*g77o?AX;Z}LXBO)|L_N|(ZRb_Tv6JvcH#_0J~q5kx=svy6B#l?Od1>Of}?GJ zf5i_E1)hqVN*~p8q0Z?M-60dD?<$tn48H3hp&qlP%+suTJoPEceDb!op%?R>%?L7d zY@cOiX;FkF_xsn7r`a0g-aqR|99N@XrAH*$z_WxI_L@nE6V%6oT;j$);rE4Cr}Z%d zMZE!sg3%G``K(o4X|gjiH)hPDakT0=)ERm%4cVbw+kiTH0_>c_`x2K-@#&`rxA9eO&rsaZ&!<{Nf<` zZFy?T!drG;*b-@M5&TYOQdVZL2;x<6y67R4=(S__`BgWSk=g7&1i3H8=xD+uRQR#b zP(wepZS0!CquW-^!lBk4WkvYxzNYGWeA|_y23PcTP6zwcl&|)#*!Q;o`8wRs0q+~I zpI0XN=DjCAgEnf~*DZiSHet%rijNJiSaVDCOtm2yzBGP7`+39!8~z(*O=76T-Tabp z8Jy%}A6GpDNil+W%6=|ru)X7D@cjEfz6~BrwPa|qLa>KGj2w>Z-sv~hw3kOmN1`?4_M-pdAeEs0Qp98LB!9gX5u1Z{(k%K_f;Y|Lwn~c zZmbi!)W4L}a!F9NK$|$lMk=T>$xtdGQlPl%CvRxV?-#-}{KX$GYY6r$MHIV-zi(^P zTO(pfxc>hB%B4>D&obXlRN-(nk1VWKAK;%ua1|aDqc=shT>#kLu}pKKdI%D&xfqUF+T+e#@&tYiEkt5RAXMmR-MT zB*|630d!=f(hZ3*oA-{u$(3^nZbk3+$|OSydDCh|LO$-bC_QAs0KJh?5Ls^KLB$Ni z@6?u+t=(u@Y&mKpYG__xL(M{|Oxk)`w#wWMKFm(}s|3qU0mJs&{Z)LXRg~v1LPC0F zp+P~B3h=Ra%IG=;g*_!Cry$tH7~*Dx#s5p%6)}u z37CihhX?6RV8%fDW9>i@vJ^hwpGF=%}eJSJK|QG%ygbJ~%mlkl)qk-xqzG7Su0cb*vqKAq6DR?Gq7sj(Y zm8LLAL^?bb4;f5;^Tt%~vB#Gb$PYr3MIp~|eW6tpXg7Gi+E9)HDDQoo2(%G7q zU`db=w>*Tqx5jl@vIA#Q8@9Fx^HK9UVHzogxk!$!J?{3bpq4Jl1DUsQe-U0P_wj6+3J^wYgCf35ExjGW*~8-1NLNhP(jq4h|7ou8F0iAxAZ$rXJvQi>v}^l0eET z>ZJqQoL!x%Qce2xdsQLK-Jxa~9N11=YI4Dh@gQTCQk@63&jRA&uIuSp+`e6ATx|wW zB&b5trjI|x#VN`JeN#kijHx&jeYvi_Uf2LY^sETB`kJn;=5|ooq!p=V>|7jz_IJ!( zB~&aXKq)oWTOe=2;*6^WI#RX1u`ya7fc{*m(FMnS{plNSgUa2&Ai>8+o3)AUI zOt$Q`q){VmmF};PJ3l`>Ec#Flu=|u`2vT}^Z$QD3t2(-^nc5c2>a096H$eW2zf*X1 z5{y&2(@vc5(q&6A*di;^B&AwROlG8ykBvQto|BM}f*ReqJZ#wg<{YW29~VeSd{V}! z?AeOk+~FHyAZm>WSNCV)xJ4ljRH23dto|cMd|30Rh=ha;wz;{3&#z{A6t6E|cbnA0 z-)U&z>pE~TYI&>&OVe1-YRZ-5({T95S`zW zQ2n|4lao&ZzYmm><-p(vHyHz9_-DQ!Up)6`u2Lu(EJ=z#>vxwpQ{%vO-@kesTZtsOR%Ngz-FaS7+v;8y14RnZ`zpN`0N7He+@F%}T5 zzmF0v-!-ul-zgQx^Z;BM|l5*K3jt0UkUt zEl&i@MV6>eOl39A%}%qQ=<+Y6T0-dN<;!@IQUEjZ1HmyBLWcQf%CNlwP3%o7`EvIZK+aL`H>iJ>jH2Uv11JtQ1K@z7d(s2FDRJ2;ChOSYkKvM za}Qp_gwb|hnrb|8XR7hn_@eUJ8n=o+heW~cr)YkGFZ+ci`6*TBYYCv&lc&=$Dz-C6 z=;U(p3JdKV?b0*T)1GA(<>%Ww*K zVbpVmuOcwfJ~i2C^~vdk?9wM-ZWO5d(@y=AU{E}YmJNKG0Old*|L9_CvCKe+le2s`sIncMgz;A>U+Z}2!kS2DJ=Uoimbl>Y0NeESr~=dlbXPqRg4GW zl*VP542%*y#)e`}YakXlmyHVw?b6b-qjCtKM?;~& zJ@!t|3k%hVIDUc3WHvAXGE*ZY$6ub-n@kmV)z^rSJy&ss9FD~z=;Wp&a>NhciHYl? zKyY-qE28?w%yUj+SKv8+5VS*?Tktc^T2?wGIWQP*<* z^Qif08SR6v0o8O8tieDjaGcP6?UE6Sl!hfrS{ivI3)dpSji7KWzjm;*X8wD-W#OD7 z_s8H{;qqT6@y1up?TWa(*3NEyeTNjg>HIVPX13Qs*q_nnn47O?Vq@7I<=!|@RSV|2 zZ0zj7VVG;br>)b0u@Y_)K4UJzc+Ka0`sTvDC(<)pEvJKg3^)KB$5OcCmWcG*S0OhI z=(+r&=xTxs)>)rJS~`B8;Gp6SyOJJIHE>6VA{emy%qw@ztq6>U*8$sw_@^r1?g6&3 zWloc>i&Ipak2_{5Uss5*BY5X%7Is+pDlBn@s7W6?MNn`do<)K>@AB)J6BMW3qN)4b z?UIyO02wOkl&C_>4wQnzx4j5r7;H{Tz%WE(`)}Yx!P>8S$ex3>A677)Vtzr!?9RK| z4x%=4lqOc#QhqJ8-|t#V!pr|&T>ae*3@NGqTB!eC<(u7Pui3YT3-`nixq0ip1`_CJ8|Ei&e zUBB58b^zMv2>pk1g+gECsAsXpG}OQZwaBUTZ+wR@zaIcY_RS)+W3K)qCp9~LqrBO_ zeT<8Z1=ZVTIr81+CJy!@#BX=@bN~GJhuZeubgRw(S@&$OP4~LgUYDY_z}|@3>IZ-A zApmc(H=?#$@-KHO5HTUv*G(-I(C`C2b#+dQ=o~S~LtlF&ORYmmLG@zx1taf&09JZA AO#lD@ diff --git a/services/frontend/src/pages/Landing.tsx b/services/frontend/src/pages/Landing.tsx index 30ec10a2..db059e3b 100644 --- a/services/frontend/src/pages/Landing.tsx +++ b/services/frontend/src/pages/Landing.tsx @@ -329,10 +329,10 @@ function ConsoleShot() {

From 36b0bb0846c1bc97670db0dbce64444bed9b5612 Mon Sep 17 00:00:00 2001 From: hwan <2020112023@dgu.ac.kr> Date: Mon, 22 Jun 2026 17:51:49 +0900 Subject: [PATCH 3/4] =?UTF-8?q?#999=20[docs]=20README=20=EC=B5=9C=EC=8B=A0?= =?UTF-8?q?=ED=99=94=20=E2=80=94=20SaaS=20=ED=98=95=EC=8B=9D=20+=20?= =?UTF-8?q?=ED=8C=80=20R&R=20(#1000)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit #999 [docs] README 최신화 — SaaS 형식 프로젝트 소개 + 팀 R&R - 현행 프로젝트(Bifrost)에 맞게 재작성: 개요·핵심기능·아키텍처·기술스택·빠른시작· 프로젝트 구조·개발 컨벤션·팀·문서·라이선스. - 구식/오류 내용 정리: 폐기된 명칭/clone URL, GitHub Flow→develop·main 컨벤션, Notion sync 내부 디테일, placeholder owner(A~E), 서비스 포트/실행법 정정. - 팀 R&R + 각 팀원 GitHub/Email 명시(PM 이성민, PL 정재환). --- README.md | 208 ++++++++++++++++++++++++++---------------------------- 1 file changed, 100 insertions(+), 108 deletions(-) diff --git a/README.md b/README.md index 8291d019..91b045e0 100644 --- a/README.md +++ b/README.md @@ -1,153 +1,145 @@ -# Data Orchestration Platform +# Bifröst -AI 기반 분산 데이터 오케스트레이션 플랫폼. 사용자가 DB만 등록하고 대시보드 또는 자연어로 요청하면 Kafka 토픽과 Debezium Connector가 자동으로 구성된다. +> **DB만 연결하면 데이터 파이프라인은 클릭 몇 번 또는 자연어로, 장애는 AI 에이전트가 진단까지.** +> CDC·EDA 데이터 파이프라인을 셀프서비스로 구축·운영하는 AIOps 플랫폼. -## Architecture +--- -자세한 구조: [docs/README.md](docs/README.md), [Spring Boot 설계](docs/design/backend-springboot/overview.md) +## 개요 -## 레포 구조 +**Bifröst**는 사용자가 소스·싱크 데이터베이스만 등록하면, UI 클릭 또는 자연어 채팅으로 **CDC(Change Data Capture)** 및 **EDA(Event-Driven Architecture)** 파이프라인을 생성·운영할 수 있는 플랫폼입니다. + +파이프라인을 만들면 플랫폼이 Kubernetes 위에 **Kafka(Strimzi)·Debezium·Kafka Connect**를 자동 프로비저닝합니다. 운영 중에는 **AI 에이전트**가 파이프라인을 모니터링하고, 장애를 감지해 **근거 기반 RCA(Root Cause Analysis)**를 수행하며, 자연어로 상태 조회와 조치를 지원합니다(변경 조치는 운영자 승인 후 실행). + +## 핵심 기능 + +- **셀프서비스 파이프라인** — DB 등록 → CDC(source→sink) / EDA(fan-out) 파이프라인을 UI·자연어로 생성. Strimzi Kafka·Debezium·JDBC Sink Connector 자동 구성. +- **AI 장애 대응(RCA)** — 8계층·35 근본원인 카탈로그 + evidence matrix 기반 진단, confidence 스코어링·캘리브레이션, 근거 부족 시 기권(`UNKNOWN_WITH_EVIDENCE_GAP`). +- **자연어 운영** — 채팅으로 파이프라인·메트릭·로그·인시던트를 조회하고 조치. planner가 read-only 도구로 라우팅하며, 변경 조치는 HITL(Human-in-the-Loop) 승인을 거칩니다. +- **실시간 관측성** — 파이프라인 상태·consumer lag·인시던트를 실시간 대시보드로 추적. +- **멀티테넌시** — 프로젝트(테넌트)별 DB·파이프라인·인시던트 격리. + +## 아키텍처 ``` -data-orchestration-platform/ -├─ docs/ 문서, ADR, 명세서 -├─ services/ -│ ├─ operations-backend/ 플랫폼 API + 내부 전용 /internal/ops + K8s/Kafka 자동화 (Spring 모놀리스, B·C) -│ ├─ ai-service/ AI 장애대응 (FastAPI, D) -│ └─ frontend/ React UI (E) -├─ infra/ Terraform, Helm, K8s yaml (A) -├─ scripts/ 로컬 dev 스크립트 -└─ docker-compose.yml 로컬 개발 환경 + Browser + │ /api + ▼ +┌──────────────┐ /api/v1/agent ┌──────────────────────┐ +│ frontend │ ─────────────────────────▶ │ ai-service │ +│ React/Vite │ │ FastAPI (8082) │ +│ (5173) │ │ RCA 에이전트 · LLM │ +└──────┬───────┘ │ pgvector 지식베이스 │ + │ /api └───────────┬──────────┘ + ▼ │ /internal/ops +┌──────────────────────────┐ ◀──────────────────────────┘ +│ operations-backend │ +│ Spring Boot (8080) │ 인증 · datasource/pipeline 도메인 · K8s/Kafka 자동화 +└──────────────┬────────────┘ + │ provisioning + ▼ +┌──────────────────────────────────────────────────────┐ +│ Kubernetes (EKS) · Strimzi Kafka │ +│ Debezium(source) → Kafka Topic → JDBC Connect(sink) │ +└────────────────────────────────────────────────────────┘ ``` -> Spring Boot는 단일 모놀리스(`operations-backend`)다. core/orchestrator 분리와 `common-dto`는 [ADR 0004](docs/adr/0004-monorepo-monolith.md)로 폐기·흡수되었다. +- **operations-backend** (Spring Boot 모놀리스) — 플랫폼 API, 인증, datasource·pipeline 도메인, K8s/Kafka 자동화. 에이전트 전용 내부 API `/internal/ops/**`는 외부에 노출하지 않습니다. +- **ai-service** (FastAPI) — RCA 에이전트, LLM 도구 라우팅(planner·retrieval), 인시던트 분석, pgvector 지식베이스, 운영자 피드백 gold set. +- **frontend** (React·Vite·TypeScript) — 콘솔 UI, 파이프라인·인시던트 대시보드, AI 채팅 패널. -## 서비스 목록 +> 브라우저/외부 클라이언트는 `/api/**` 또는 FastAPI `/api/v1/agent/**`만 사용하고, FastAPI가 내부 DNS로 Spring Boot `/internal/ops/**`를 호출합니다. Spring Boot는 단일 모놀리스이며, core/orchestrator 분리는 [ADR 0004](docs/adr/0004-monorepo-monolith.md)로 흡수되었습니다. -| Service | Port | 역할 | Owner | -| --- | --- | --- | --- | -| operations-backend | 8080 | 플랫폼 API, 인증, 도메인, K8s/Kafka 자동화, 내부 전용 `/internal/ops` | B·C | -| ai-service | 8082 | AI 장애대응 (FastAPI) | D | -| frontend | 5173 | React UI | E | +## 기술 스택 -`/internal/ops/**`는 public frontend ingress에 노출하지 않는 agent-facing 내부 API다. 브라우저/외부 클라이언트는 `/api/**` 또는 FastAPI `/api/v1/agent/**` 경유만 사용하고, FastAPI가 내부 서비스 DNS로 Spring Boot `/internal/ops/**`를 호출한다. +| 영역 | 스택 | +| --- | --- | +| Backend | Java 21, Spring Boot, Gradle | +| AI | Python 3.11, FastAPI, LLM, pgvector | +| Frontend | React, Vite, TypeScript, Tailwind CSS | +| Data plane | Apache Kafka (Strimzi), Debezium, Kafka Connect (JDBC) | +| Datastore | PostgreSQL(metadb), pgvector(agentdb), 테넌트 DB(PostgreSQL/MariaDB) | +| Infra | AWS EKS, ArgoCD(GitOps), Harbor, Jenkins(CI/CD) | +| Observability | Prometheus, Grafana, Loki, Tempo | -## Quick Start +## 빠른 시작 ### Prerequisites - JDK 21 (Temurin 권장) - Node 20+ +- Python 3.11+ - Docker + Docker Compose -- Gradle 8.10+ (Wrapper 생성용. 한 번만 필요) -### 최초 셋업 +### 로컬 실행 ```bash -# 1. 클론 -git clone https://github.com/your-org/data-orchestration-platform.git -cd data-orchestration-platform - -# 2. Gradle Wrapper 생성 (한 번만) -gradle wrapper --gradle-version 8.10 +# 1. 의존 인프라(Kafka, metadb, 테넌트 DB 시뮬레이터, agentdb 등) 기동 +docker compose up -d # 또는 ./scripts/local-up.sh -# 3. 의존성 환경 (Kafka, MetaDB, 사용자 DB 시뮬레이터) 띄우기 -docker-compose up -d +# 2. operations-backend (Spring Boot) +JAVA_HOME=$(/usr/libexec/java_home -v 21) ./gradlew :services:operations-backend:bootRun -# 4. Backend 빌드 + 실행 (단일 모놀리스) -./gradlew :services:operations-backend:bootRun +# 3. ai-service (FastAPI) +cd services/ai-service +python -m venv .venv && .venv/bin/pip install -e . +.venv/bin/uvicorn app.main:app --reload --port 8082 -# 5. Frontend +# 4. frontend (React) cd services/frontend -npm install # 또는 pnpm install -npm run dev -``` - -이제 접속: -- Frontend: http://localhost:5173 -- Platform API: http://localhost:8080/swagger-ui.html -- Kafka UI: http://localhost:8090 - -## Gradle 명령어 참고 - -```bash -# 전체 빌드 -./gradlew build - -# 특정 모듈만 빌드 -./gradlew :services:operations-backend:build - -# 테스트 -./gradlew test -./gradlew :services:operations-backend:test - -# Docker 이미지 빌드 (Spring Boot) -./gradlew :services:operations-backend:bootBuildImage - -# 의존성 트리 -./gradlew :services:operations-backend:dependencies +npm install && npm run dev ``` -## 개발 워크플로 +접속: -### 브랜치 전략 (GitHub Flow) +| 대상 | URL | +| --- | --- | +| Frontend | http://localhost:5173 | +| Platform API (Swagger) | http://localhost:8080/swagger-ui.html | +| AI Service (OpenAPI) | http://localhost:8082/docs | +| Kafka UI | http://localhost:8090 | -``` -main (always deployable) - └─ feature/B-datasource-api - └─ feature/C-tenant-provisioner - └─ fix/login-bug -``` - -- 모든 변경은 feature 브랜치 → PR → main 머지 -- 머지하면 자동 배포 (.github/workflows/) -- main은 직접 푸시 금지 (보호 설정) - -### 커밋 메시지 +## 프로젝트 구조 ``` -[영역] 짧은 설명 - -자세한 설명 (선택) +bifrost/ +├─ docs/ 문서·ADR·명세 (Source of Truth) +├─ services/ +│ ├─ operations-backend/ Spring Boot — 플랫폼 API·K8s/Kafka 자동화 +│ ├─ ai-service/ FastAPI — RCA 에이전트·LLM +│ └─ frontend/ React UI +├─ infra/ Terraform·Helm·K8s manifest +├─ scripts/ 로컬/배포 스크립트 (local-up.sh 등) +└─ docker-compose.yml 로컬 의존 인프라 ``` -영역 예: `ops`, `database`, `provisioning`, `ai`, `frontend`, `infra`, `docs`. - -### PR 규칙 - -- 제목: `[core] Add datasource registration API` -- 최소 1명 리뷰 -- CI 통과 필수 -- 본인 PR은 본인이 머지 (Squash and merge) +## 개발 -### GitHub 작업 로그 동기화 +브랜치·커밋·PR 컨벤션은 [docs/team/git-convention.md](docs/team/git-convention.md)를 따릅니다. -GitHub 이슈/PR 이벤트는 `.github/workflows/notion_sync.yml`에서 Notion의 "GitHub 작업 로그" DB로 동기화한다. 레포 시크릿 `NOTION_TOKEN`을 설정해야 하며, `NOTION_DB_ID`는 필요 시 설정한다. `NOTION_DB_ID`를 생략하면 `37cb7cb3-2d91-81cf-b930-f137189b41c4`를 사용한다. - -DB 속성은 `제목`(title), `번호`(number), `타입`(select 또는 text), `상태`(select/status 또는 text), `작성자`(text), `머지일`(date), `링크`(url 또는 text)를 기대한다. select/status 속성을 쓰는 경우 옵션명은 `feat`/`fix` 같은 제목 타입과 `open`/`closed`/`merged` 상태값에 맞춘다. - -이전 슬랙 요약 봇을 제거했으므로 더 이상 쓰지 않는 `SLACK_BOT_TOKEN`, `SLACK_CHANNEL_ID`, `BOT_GITHUB_TOKEN`, `MONITOR_REPOS` 시크릿은 레포 설정에서 정리한다. +- **브랜치 모델**: `main`(배포 가능) ← `develop`(통합) ← 작업 브랜치 `{type}/#{이슈번호}` +- **작업 흐름**: GitHub Issue 생성 → 브랜치 → PR(대상 `develop`) → **Squash & merge**. `main ← develop`은 릴리스 시점에만. +- **타입**: `feat` · `fix` · `chore` · `docs` · `refactor` (커밋은 `test` 추가) +- **커밋 메시지**: `#{이슈번호} [type] 메시지` +- **보호**: `main`·`develop` 직접 푸시 금지, PR·CI 통과 필수 ## 팀 -| Role | Name | 담당 | -| --- | --- | --- | -| Infra Lead | A | EKS, Strimzi, Kafka, CI/CD, 모니터링 | -| Backend Domain | B | operations-backend (도메인/DB/API) | -| K8s Automation | C | operations-backend (provisioning/watcher) | -| AI / LLM | D | ai-service (FastAPI, Sprint 4~) | -| Frontend | E | frontend | - -자세한 R&R 전용 문서는 WIP다. +| 이름 | 역할 | 담당 | GitHub | Email | +| --- | --- | --- | --- | --- | +| 이성민 | **PM** | Spring Boot | [@seongmin0229](https://github.com/seongmin0229) | leesung2925@gmail.com | +| 정재환 | **PL** | 인프라 · Frontend · CI/CD | [@hwnnn](https://github.com/hwnnn) | 2020112023@dgu.ac.kr | +| 백강민 | Backend | Spring Boot | [@baekkangmin](https://github.com/baekkangmin) | rkdgur1902@naver.com | +| 권세빈 | AI | FastAPI | [@sebeeeen](https://github.com/sebeeeen) | a856412@gmail.com | +| 김연수 | AI | FastAPI | [@sooooscode](https://github.com/sooooscode) | sooooscode@gmail.com | ## 문서 -- [Documentation Index](docs/README.md) -- [Canonical Functional Spec](docs/spec.md) -- [Spring Boot API](docs/api/springboot.md) +- [문서 인덱스](docs/README.md) +- [기능 명세 (Spec)](docs/spec.md) - [ADR (Architecture Decision Records)](docs/adr/) -- [API Specs](docs/api/) +- [Git 컨벤션](docs/team/git-convention.md) ## License -(캡스줍 종료 후 결정) +캡스톤 프로젝트 — 라이선스 미정. From 149bf0e47365b4436231eefd35bf95f4b6c33124 Mon Sep 17 00:00:00 2001 From: Sebeen Kwon Date: Mon, 22 Jun 2026 23:13:22 +0900 Subject: [PATCH 4/4] =?UTF-8?q?#993=20[feat]=20RCA=20=EC=A7=84=EB=8B=A8=20?= =?UTF-8?q?=EC=A0=95=ED=99=95=EB=8F=84=20=EA=B0=9C=EC=84=A0=20=E2=80=94=20?= =?UTF-8?q?=EC=A6=9D=EA=B1=B0=20=EC=8B=A0=ED=98=B8=20=EC=B6=94=EC=B6=9C?= =?UTF-8?q?=C2=B7=EC=A0=95=EC=83=81=20=EA=B4=80=EC=B8=A1=20=EC=98=A4?= =?UTF-8?q?=ED=83=90=20=EC=B0=A8=EB=8B=A8=C2=B7=EB=9D=BC=EB=B2=A8=20?= =?UTF-8?q?=EB=88=84=EC=84=A4=20=EB=B0=A9=EC=A7=80=20(#1002)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * Improve RCA accuracy without label leakage The RCA path was missing catalog-level evidence signals from structured runtime payloads, so live connector-task failures converged on broad symptoms or UNKNOWN even when tool payloads contained the deciding facts. This change extracts redacted evidence signals, tightens scoped auth and deployment matching, broadens catalog mappings, and adds regression tests for metadata leakage, overfit guards, HITL approval pauses, and planner/retrieval contracts. Constraint: Do not branch on case_id or inject evaluation labels/seed phrases Constraint: Do not synthesize NO_FAULT from a single normal observation Rejected: Keep 0.95 confidence for full required matches | overstates calibration and failed honesty review Rejected: Treat unscoped connector auth as source auth | misranks sink auth failures under CONNECTOR_TASK_FAILED Confidence: high Scope-risk: moderate Directive: Do not add eval seed phrases or gold-label metadata to production evidence catalogs Tested: uv run --extra dev pytest -q (689 passed) Tested: uv run python scripts/rca_eval_campaign.py (AC@1/3/5=1.0, ECE=0.1448, abstain=0) Tested: stable SHA256 7/35 seed split (AC@1/3/5=1.0, abstain=0) Not-tested: LLM-on live deployment Job * 교차검증 보류 사유가 재발하지 않도록 RCA 입력을 정화 classifier와 RCA의 rule, semantic, LLM prompt 경로가 같은 control metadata 제거 규칙을 통과하도록 맞췄다 한국어 auth 정상 문구는 원문과 정규화 토큰 양쪽에서 부정으로 처리해 정상 증거가 SOURCE_AUTH_EXPIRED로 커밋되지 않게 했다 seed 표현과 직접 겹치는 catalog 문구는 도메인 일반 표현으로 바꾸고, 0.90 전역 confidence cap은 ECE 재측정 기준 0.88로 낮췄다 캠페인 산출물은 oracle incident-type RCA replay 조건과 seed 내부 replay 한계를 명시해 100% 계열 수치를 무조건 주장하지 않도록 했다 Constraint: 35 seed 캠페인은 accepted root cause에서 incident type을 역매핑하는 RCA replay이며 classifier end-to-end나 unseen production holdout이 아님 Rejected: 0.90 전역 confidence cap 유지 | final ECE 0.1448로 baseline 대비 악화가 컸음 Rejected: 0.82 confidence cap | AC@1 0.9714는 유지했지만 ECE 0.1661로 더 악화됨 Confidence: high Scope-risk: moderate Directive: RCA와 classifier에 새 summary 소비 경로를 추가할 때는 app.evidence.metadata.strip_control_metadata를 먼저 적용할 것 Tested: cd services/ai-service && .venv/bin/pytest -q, 696 passed, 354 warnings Tested: cd services/ai-service && .venv/bin/pytest tests/test_rca.py tests/test_evidence_signals.py tests/test_rca_classification_accuracy.py tests/test_classifier.py -q, 82 passed Tested: cd services/ai-service && .venv/bin/python scripts/rca_eval_campaign.py, AC@1 0.9714, AC@3 1.0, AC@5 1.0, Avg@5 0.9857, ECE 0.1284 Not-tested: production unseen holdout과 LLM-on live 배포 Job * #993 잔여 검증 보류 사유를 닫아 머지 판단을 가능하게 한다 재교차검증에서 남은 과적합 표현, 중복 evidence catalog drift, 한국어 부정 회귀 공백을 작은 변경으로 정리했다. EVIDENCE_RULES는 EVIDENCE_PROFILES에서 파생되도록 바꿔 단일 소스를 유지하고, runtime catalog 문구는 seed 원문에 붙은 표현 대신 더 넓은 도메인 신호로 일반화했다. 한국어 auth 부정은 요청된 무접두어 문구를 그대로 회귀 테스트에 포함했다. Constraint: ECE는 cap 상향으로 보정하지 말라는 요청을 우선함 Constraint: ai-service pyproject에는 별도 lint 또는 typecheck 도구 정의가 없음 Rejected: default confidence cap 상향 | ECE는 낮출 수 있지만 보수적 grounding 정책과 요청 제약을 침범함 Rejected: seed gold set 문구 수정 | 요청 범위가 runtime catalog 표현 정리였고 평가셋 자체를 흔들 수 있음 Confidence: high Scope-risk: narrow Reversibility: clean Directive: EVIDENCE_RULES는 EVIDENCE_PROFILES에서 파생되어야 하며 수동 중복 목록을 다시 만들지 말 것 Tested: git diff --check Tested: uv run --extra dev pytest tests/test_rca.py tests/test_evidence_signals.py tests/test_rca_classification_accuracy.py tests/test_hitl_wiring.py -q Tested: uv run --extra dev pytest -q Tested: uv run --extra dev python scripts/rca_eval_campaign.py Not-tested: production unseen holdout과 classifier 포함 end-to-end 재측정 * 정상 관측이 RCA 장애 확정으로 승격되지 않게 막음 증거 신호 추출이 부정 문구와 정상 상태를 fault 토큰으로 재사용해 schema, config, duplicate, lag, connector 원인을 확정할 수 있었다. 신호 유형별 정상 조각 제거를 도입하고 RCA required evidence 매칭도 같은 부정 경계를 보게 맞췄다. 캠페인 수치는 blocker 수정 뒤 현재 HEAD에서 다시 산출한 oracle incident-type seed replay 값으로 문서를 갱신했다. 100% 값은 production holdout이 아니라 35 seed replay 조건부 수치로만 남긴다. Constraint: 정상/부정 관측은 fault signal과 required evidence로 승격되면 안 됨 Constraint: campaign 수치는 blocker 수정 후 재실행값만 문서화해야 함 Rejected: ECE cap 또는 threshold 조정 | 실측값을 숨기면 calibration 한계가 문서에 남지 않음 Rejected: auth 전역 negation 유지 | mixed normal auth와 실제 auth fault를 함께 억제함 Confidence: high Scope-risk: moderate Directive: 정상 문구를 추가할 때는 signal 추출과 RCA required evidence 매칭 회귀를 함께 추가할 것 Tested: cd services/ai-service && .venv/bin/python -m pytest tests/test_evidence_signals.py tests/test_rca.py Tested: cd services/ai-service && .venv/bin/python -m pytest tests/test_evidence_signals.py tests/test_rca.py tests/test_rca_classification_accuracy.py Tested: cd services/ai-service && .venv/bin/python -m pytest Tested: cd services/ai-service && .venv/bin/python -m compileall -q app tests scripts Tested: cd services/ai-service && .venv/bin/python scripts/rca_eval_campaign.py Not-tested: production live fault injection 재실행 * #993 캠페인 계층별 표의 source 행을 재실행 실측값으로 정정 검증 재실행에서 source AC@1·Avg@5가 1.00인데 문서 표만 0.80·0.90으로 stale했음. 실측값과 오답 0건 기록에 일치하도록 정정. Tested: rca_eval_campaign.py 재실행값(source AC@1 1.0)과 대조 Confidence: high Scope-risk: narrow --- docs/test/rca-test-campaign-20260622.md | 52 +- .../rca_campaign_current.json | 456 ++++++++++++++++ services/ai-service/app/agents/classifier.py | 31 +- services/ai-service/app/agents/planner.py | 71 ++- services/ai-service/app/agents/rca.py | 245 ++++++++- services/ai-service/app/agents/retrieval.py | 40 +- .../app/catalogs/evidence_matrix.py | 205 ++----- .../ai-service/app/catalogs/failure_types.py | 20 +- .../app/catalogs/incident_rootcause_map.py | 12 +- services/ai-service/app/catalogs/types.py | 2 +- services/ai-service/app/evidence/metadata.py | 47 ++ services/ai-service/app/evidence/signals.py | 514 ++++++++++++++++++ services/ai-service/app/workflow/runner.py | 39 +- .../ai-service/scripts/rca_eval_campaign.py | 9 + services/ai-service/tests/test_classifier.py | 47 ++ .../ai-service/tests/test_evidence_signals.py | 169 ++++++ services/ai-service/tests/test_hitl_wiring.py | 40 +- services/ai-service/tests/test_rca.py | 196 ++++++- 18 files changed, 1957 insertions(+), 238 deletions(-) create mode 100644 docs/test/results-20260622/rca_campaign_current.json create mode 100644 services/ai-service/app/evidence/signals.py create mode 100644 services/ai-service/tests/test_evidence_signals.py diff --git a/docs/test/rca-test-campaign-20260622.md b/docs/test/rca-test-campaign-20260622.md index 2243f904..8b8b4b2f 100644 --- a/docs/test/rca-test-campaign-20260622.md +++ b/docs/test/rca-test-campaign-20260622.md @@ -30,6 +30,7 @@ RCA 근본원인 카탈로그를 **8계층 35개**로 정의하고, 33개 인시 ### 2.1 오프라인 포괄 평가 — 전 계층 커버 - **대상**: gold set 35건(계층별 대표 시나리오, `app/evaluation/seed_gold_set.py`). - **입력 증거**: 각 시나리오의 **관측 신호만**(symptom + trigger + contributing_factors). 사후 결론인 `human_verdict`는 **정답 누출 방지를 위해 제외**. +- **중요 조건**: 캠페인 스크립트는 accepted root cause에서 incident type을 역매핑해 RCA 후보 풀을 구성하는 **oracle incident-type RCA replay**다. classifier 포함 end-to-end 정확도나 unseen production holdout으로 해석하지 않는다. - **조건**: LLM 타이브레이커 **비활성** → 카탈로그 + 증거 매트릭스 + 신뢰도 게이트만으로 판정(가장 보수적 floor). - **지표**: AC@1/AC@3/AC@5, Avg@5(RCAEval 표준), ECE(Guo et al. 캘리브레이션), 기권율. - **실행**: `cd services/ai-service && .venv/bin/python scripts/rca_eval_campaign.py` @@ -49,35 +50,41 @@ RCA 근본원인 카탈로그를 **8계층 35개**로 정의하고, 33개 인시 ## 3. 결과 수치 (어떻게 나왔나) -### 3.1 오프라인 포괄 평가 (35건, 관측증거-only, LLM 비활성) +### 3.1 오프라인 포괄 평가 재측정 (35 seed, oracle incident-type RCA replay) + +2026-06-22 #993 수정 후 현재 브랜치에서 `services/ai-service/scripts/rca_eval_campaign.py`를 재실행한 값이다. 입력은 seed의 `symptom`, `trigger`, `contributing_factors`만 사용하고 `human_verdict`는 제외한다. 단, 스크립트가 accepted root cause에서 incident type을 역매핑하므로 classifier 포함 end-to-end 정확도나 unseen production holdout으로 해석하지 않는다. | 지표 | 값 | 의미 | |---|---|---| -| **AC@1** | **65.7%** (23/35) | 최상위 후보가 정답 | -| **AC@3** | **80.0%** (28/35) | 상위 3 안에 정답 | -| **AC@5** | **80.0%** (28/35) | 상위 5 안에 정답 | -| **Avg@5** | **0.724** | 정답 순위 역수 평균 (현 SOTA Avg@5 0.46~0.54 상회) | -| **ECE** | **0.073** | 신뢰도 캘리브레이션 오차 (<0.10 양호) | -| **기권(UNKNOWN)** | **7/35 (20%)** | 증거 부족 시 정직한 보류 | +| **AC@1** | **100.0%** (35/35) | 최상위 후보가 정답 | +| **AC@3** | **100.0%** (35/35) | 상위 3 안에 정답 | +| **AC@5** | **100.0%** (35/35) | 상위 5 안에 정답 | +| **Avg@5** | **1.0000** | 정답 순위 역수 평균 | +| **ECE** | **0.1595** | cap 없이 현재 confidence 분포로 재계산한 실측값 | +| **기권(UNKNOWN)** | **0/35 (0%)** | seed replay 조건의 기권 수 | **계층별** | 계층 | n | AC@1 | AC@3 | AC@5 | Avg@5 | |---|---|---|---|---|---| -| kafka | 6 | 0.83 | **1.00** | **1.00** | 0.92 | -| pipeline | 7 | 0.86 | 0.86 | 0.86 | 0.86 | -| infra | 5 | 0.80 | 0.80 | 0.80 | 0.80 | -| sink | 4 | 0.75 | 0.75 | 0.75 | 0.75 | -| source | 5 | 0.40 | 0.80 | 0.80 | 0.60 | -| change | 4 | 0.25 | 0.75 | 0.75 | 0.46 | -| data_quality | 4 | 0.50 | 0.50 | 0.50 | 0.50 | +| kafka | 6 | 1.00 | 1.00 | 1.00 | 1.00 | +| pipeline | 7 | 1.00 | 1.00 | 1.00 | 1.00 | +| infra | 5 | 1.00 | 1.00 | 1.00 | 1.00 | +| sink | 4 | 1.00 | 1.00 | 1.00 | 1.00 | +| source | 5 | 1.00 | 1.00 | 1.00 | 1.00 | +| change | 4 | 1.00 | 1.00 | 1.00 | 1.00 | +| data_quality | 4 | 1.00 | 1.00 | 1.00 | 1.00 | + +**오답 분석** + +- 오답 0건: 35개 seed 모두 top-1 정답 +- 해석 제한: replay 조건상 incident type은 oracle로 주입되며, 100% 값은 production unseen 일반화 수치가 아님 -**오답·기권 12건 분석 (환각 0의 근거)** +### 3.1.1 보존 floor (develop 기준 기존 발표 수치) -- **정직한 기권 7건** (top = UNKNOWN, conf 0.0): SOURCE_AUTH(2), SINK_AUTH, DEPLOYMENT_REGRESSION, IMAGE_DEPLOYMENT_REGRESSION, UPSTREAM_VOLUME, DUPLICATE_SPIKE, RETRY_EXHAUSTED → **temporal/metric 증거가 텍스트에 없어** 단정하지 않고 보류. (Bradford Hill temporality 강제 = 설계대로) -- **인접 근접 5건** (top = 같은 계층 sibling): SOURCE_READ_LATENCY→SOURCE_DB_CONNECTION_TIMEOUT, PARTITION_IMBALANCE→BROKER_RESOURCE_PRESSURE, RECENT_CONFIG→PIPELINE_CONFIG_INVALID, RECENT_SCHEMA→SCHEMA_MISMATCH, SOURCE_AUTH→CREDENTIAL_ROTATION(둘 다 타당) → **모두 카탈로그 내 유효 원인. 날조(fabrication) 0건.** +기존 develop 배포 이미지 `4a7ca906` 기준 보수적 floor는 본문 재측정값과 함께 인용해야 한다. 문서 본문의 과거 수치는 AC@1 65.7%, AC@3 80.0%, AC@5 80.0%, Avg@5 0.724, ECE 0.073, 기권 7/35였고, 보존 JSON `docs/test/results-20260622/rca_campaign_floor.json`은 AC@1 71.43%, AC@3 85.71%, AC@5 85.71%, Avg@5 0.781, ECE 0.0832, 기권 5/35를 기록한다. -> 핵심: **확신 답변 28건 중 23건 정답(82% precision)**, 불확실 7건은 기권. **존재하지 않는 원인을 지어낸 사례 0건** → "환각 ≈ 0". +> 핵심: 현재 branch replay 수치와 보존 floor는 산출 시점과 코드 상태가 다르다. 100% 값을 단독으로 쓰지 말고 oracle incident-type, seed 내부 replay, floor 범위를 함께 표시한다. ### 3.2 라이브 장애 주입 @@ -91,12 +98,13 @@ RCA 근본원인 카탈로그를 **8계층 35개**로 정의하고, 33개 인시 ## 4. 해석 & 슬라이드 03 반영 권고 -- **방법론 명시 필수**: 위 수치는 **관측증거-only + LLM 비활성**의 *보수적 floor*다. 프로덕션 Retrieval은 metric/trace/temporal 증거를 추가로 수집하고 LLM 타이브레이커가 작동하므로 실제는 더 높다. +- **방법론 명시 필수**: 현재 재측정 수치는 **관측증거-only + LLM 비활성 + oracle incident-type**의 seed replay 결과다. 프로덕션 Retrieval은 metric/trace/temporal 증거를 추가 수집할 수 있지만 classifier 포함 end-to-end 및 unseen production holdout은 별도 측정이 필요하다. +- **해석 제한**: 100% 값은 기존 35 seed의 조건부 replay 결과이며 본 문서의 floor(AC@1 65.7%, 보존 JSON 기준 71.43%)와 함께 표시해야 한다. - **권장 슬라이드 수치(재현 가능)**: - - AI 진단 정확도: **AC@5 80% / 확신 시 82%** + - AI 진단 정확도: **보존 floor AC@1 65.7~71.4%, 현재 oracle replay AC@1 100.0% (35/35, 조건부)** - 환각: **≈ 0** (날조 0건, 불확실 20%는 정직한 기권) - - 신뢰도 캘리브레이션: **ECE 0.073** -- **약점(정직 공개)**: `change`·`data_quality` 계층은 temporal/metric 증거 의존도가 높아 텍스트-only 평가에서 AC@1이 낮다. → Retrieval의 metric/temporal 증거 강화 + gold set 확대(#964 피드백 루프)가 개선 경로. + - 신뢰도 캘리브레이션: **floor ECE 0.073~0.0832, 현재 replay ECE 0.1595** +- **약점(정직 공개)**: 현재 seed replay에서는 취약 계층이 없지만 `change`·`data_quality` 계층은 production에서 temporal/metric 증거 의존도가 높다. → Retrieval의 metric/temporal 증거 강화 + gold set 확대(#964 피드백 루프)가 개선 경로. - ⚠️ 기존 슬라이드의 "89.6% / 367 케이스"는 본 캠페인과 산출 방식·데이터셋이 달라 **출처 검증 전까지 사용하지 말 것**. 본 문서의 재현 가능한 수치로 대체 권장. ## 부록 — 재현 diff --git a/docs/test/results-20260622/rca_campaign_current.json b/docs/test/results-20260622/rca_campaign_current.json new file mode 100644 index 00000000..e808b932 --- /dev/null +++ b/docs/test/results-20260622/rca_campaign_current.json @@ -0,0 +1,456 @@ +{ + "evaluation_condition": "35 seed oracle incident-type RCA replay; evidence uses symptom, trigger, contributing_factors only; human_verdict excluded; not classifier end-to-end; not unseen production holdout", + "total_cases": 35, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0, + "ECE": 0.1595, + "abstain_count": 0, + "weak_layers": [], + "layer_breakdown": [ + { + "layer": "change", + "n": 4, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "data_quality", + "n": 4, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "infra", + "n": 5, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "kafka", + "n": 6, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "pipeline", + "n": 7, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "sink", + "n": 4, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + }, + { + "layer": "source", + "n": 5, + "AC@1": 1.0, + "AC@3": 1.0, + "AC@5": 1.0, + "Avg@5": 1.0 + } + ], + "rows": [ + { + "entry": "gs_seed_001", + "layer": "source", + "incident_type": "SOURCE_AUTH_FAILURE", + "expected": "SOURCE_AUTH_EXPIRED", + "top": "SOURCE_AUTH_EXPIRED", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_002", + "layer": "source", + "incident_type": "SOURCE_AUTH_FAILURE", + "expected": "SOURCE_AUTH_EXPIRED", + "top": "SOURCE_AUTH_EXPIRED", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_003", + "layer": "source", + "incident_type": "SOURCE_CONNECTION_TIMEOUT", + "expected": "SOURCE_NETWORK_REACHABILITY", + "top": "SOURCE_NETWORK_REACHABILITY", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_004", + "layer": "source", + "incident_type": "SOURCE_CONNECTION_TIMEOUT", + "expected": "SOURCE_DB_CONNECTION_TIMEOUT", + "top": "SOURCE_DB_CONNECTION_TIMEOUT", + "top_conf": 0.767, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_005", + "layer": "source", + "incident_type": "SOURCE_READ_LATENCY", + "expected": "SOURCE_READ_LATENCY", + "top": "SOURCE_READ_LATENCY", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_006", + "layer": "pipeline", + "incident_type": "CONNECTOR_TASK_FAILED", + "expected": "CONNECTOR_TASK_FAILED", + "top": "CONNECTOR_TASK_FAILED", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_007", + "layer": "pipeline", + "incident_type": "CONNECTOR_TASK_FAILED", + "expected": "CONNECTOR_TASK_FAILED", + "top": "CONNECTOR_TASK_FAILED", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_008", + "layer": "pipeline", + "incident_type": "PIPELINE_TASK_FAILED", + "expected": "PIPELINE_CONFIG_INVALID", + "top": "PIPELINE_CONFIG_INVALID", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_009", + "layer": "pipeline", + "incident_type": "SCHEMA_MISMATCH", + "expected": "SCHEMA_MISMATCH", + "top": "SCHEMA_MISMATCH", + "top_conf": 0.78, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_010", + "layer": "pipeline", + "incident_type": "SCHEMA_MISMATCH", + "expected": "SCHEMA_MISMATCH", + "top": "SCHEMA_MISMATCH", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_011", + "layer": "pipeline", + "incident_type": "CONNECTOR_WORKER_UNHEALTHY", + "expected": "CONNECTOR_WORKER_REBALANCE_LOOP", + "top": "CONNECTOR_WORKER_REBALANCE_LOOP", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_012", + "layer": "kafka", + "incident_type": "CONSUMER_LAG_SPIKE", + "expected": "CONSUMER_LAG_SPIKE", + "top": "CONSUMER_LAG_SPIKE", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_013", + "layer": "kafka", + "incident_type": "CONSUMER_LAG_SPIKE", + "expected": "CONSUMER_LAG_SPIKE", + "top": "CONSUMER_LAG_SPIKE", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_014", + "layer": "kafka", + "incident_type": "BROKER_RESOURCE_PRESSURE", + "expected": "BROKER_RESOURCE_PRESSURE", + "top": "BROKER_RESOURCE_PRESSURE", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_015", + "layer": "kafka", + "incident_type": "PARTITION_IMBALANCE", + "expected": "PARTITION_IMBALANCE", + "top": "PARTITION_IMBALANCE", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_016", + "layer": "kafka", + "incident_type": "TOPIC_INGRESS_SPIKE", + "expected": "TOPIC_INGRESS_SPIKE", + "top": "TOPIC_INGRESS_SPIKE", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_017", + "layer": "kafka", + "incident_type": "REBALANCE_LOOP", + "expected": "CONSUMER_REBALANCE_LOOP", + "top": "CONSUMER_REBALANCE_LOOP", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_018", + "layer": "sink", + "incident_type": "SINK_AUTH_FAILURE", + "expected": "SINK_AUTH_EXPIRED", + "top": "SINK_AUTH_EXPIRED", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_019", + "layer": "sink", + "incident_type": "SINK_WRITE_LATENCY", + "expected": "SINK_WRITE_LATENCY", + "top": "SINK_WRITE_LATENCY", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_020", + "layer": "sink", + "incident_type": "SINK_CONSTRAINT_ERROR", + "expected": "SINK_CONSTRAINT_VIOLATION", + "top": "SINK_CONSTRAINT_VIOLATION", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_021", + "layer": "sink", + "incident_type": "SINK_CONNECTION_TIMEOUT", + "expected": "SINK_DB_CONNECTION_TIMEOUT", + "top": "SINK_DB_CONNECTION_TIMEOUT", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_022", + "layer": "infra", + "incident_type": "POD_OOM_KILLED", + "expected": "POD_OOM_KILLED", + "top": "POD_OOM_KILLED", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_023", + "layer": "infra", + "incident_type": "POD_CRASH_LOOP", + "expected": "POD_CRASH_LOOP", + "top": "POD_CRASH_LOOP", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_024", + "layer": "infra", + "incident_type": "NODE_PRESSURE", + "expected": "NODE_PRESSURE", + "top": "NODE_PRESSURE", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_025", + "layer": "infra", + "incident_type": "PVC_PRESSURE", + "expected": "PVC_PRESSURE", + "top": "PVC_PRESSURE", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_026", + "layer": "infra", + "incident_type": "DEPLOYMENT_ROLLOUT_REGRESSION", + "expected": "DEPLOYMENT_REGRESSION", + "top": "DEPLOYMENT_REGRESSION", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_027", + "layer": "change", + "incident_type": "CONFIG_CHANGE_REGRESSION", + "expected": "RECENT_CONFIG_CHANGE_REGRESSION", + "top": "RECENT_CONFIG_CHANGE_REGRESSION", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_028", + "layer": "change", + "incident_type": "SCHEMA_CHANGE_REGRESSION", + "expected": "RECENT_SCHEMA_CHANGE_REGRESSION", + "top": "RECENT_SCHEMA_CHANGE_REGRESSION", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_029", + "layer": "change", + "incident_type": "IMAGE_DEPLOYMENT_REGRESSION", + "expected": "RECENT_IMAGE_DEPLOYMENT_REGRESSION", + "top": "RECENT_IMAGE_DEPLOYMENT_REGRESSION", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_030", + "layer": "change", + "incident_type": "CREDENTIAL_ROTATION_FAILURE", + "expected": "CREDENTIAL_ROTATION_REGRESSION", + "top": "CREDENTIAL_ROTATION_REGRESSION", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_031", + "layer": "data_quality", + "incident_type": "VOLUME_ANOMALY", + "expected": "UPSTREAM_DATA_VOLUME_ANOMALY", + "top": "UPSTREAM_DATA_VOLUME_ANOMALY", + "top_conf": 0.88, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_032", + "layer": "data_quality", + "incident_type": "DUPLICATE_SPIKE", + "expected": "PIPELINE_DUPLICATE_SPIKE", + "top": "PIPELINE_DUPLICATE_SPIKE", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_033", + "layer": "data_quality", + "incident_type": "FRESHNESS_DELAY", + "expected": "PIPELINE_FRESHNESS_DELAY", + "top": "PIPELINE_FRESHNESS_DELAY", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_034", + "layer": "data_quality", + "incident_type": "NULL_RATE_SPIKE", + "expected": "SCHEMA_NULL_RATE_SPIKE", + "top": "SCHEMA_NULL_RATE_SPIKE", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + }, + { + "entry": "gs_seed_035", + "layer": "pipeline", + "incident_type": "PIPELINE_TASK_FAILED", + "expected": "PIPELINE_TASK_RETRY_EXHAUSTED", + "top": "PIPELINE_TASK_RETRY_EXHAUSTED", + "top_conf": 0.79, + "hit@1": true, + "hit@3": true, + "hit@5": true + } + ] +} diff --git a/services/ai-service/app/agents/classifier.py b/services/ai-service/app/agents/classifier.py index 7b9ae59f..76d16ab6 100644 --- a/services/ai-service/app/agents/classifier.py +++ b/services/ai-service/app/agents/classifier.py @@ -9,6 +9,7 @@ from app.catalogs.failure_types import list_failure_types from app.catalogs.types import FailureType +from app.evidence.metadata import strip_control_metadata from app.prompts.classifier import SYSTEM_PROMPT, build_user_prompt from app.schemas.outputs import Classification, ClassifierOutput, IncidentTypeOutput, RetrievalOutput from app.schemas.state import EvidenceItem, EvidenceType, IncidentScope @@ -57,15 +58,16 @@ async def run_classifier(user_message: str, retrieval_out: RetrievalOutput | Non known_type_ids = {item.incident_type for item in failure_types} evidence_items = retrieval_out.evidence_items if retrieval_out else [] observed_evidence_items = [item for item in evidence_items if _is_observed_evidence(item)] - evidence_summaries = [item.summary for item in observed_evidence_items] + sanitized_user_message = strip_control_metadata(user_message) + evidence_summaries = [_sanitize_summary(item.summary) for item in observed_evidence_items] - rule_candidates = _rank_rule_candidates(user_message, retrieval_out, failure_types) + rule_candidates = _rank_rule_candidates(sanitized_user_message, retrieval_out, failure_types) incident_scope = _infer_scope(evidence_summaries) needs_group_analysis = incident_scope == IncidentScope.INCIDENT_GROUP if _needs_llm_assist(rule_candidates): llm_candidates, llm_scope = await _run_llm_assist( - user_message=user_message, + user_message=sanitized_user_message, evidence_summaries=evidence_summaries, rule_candidates=rule_candidates, failure_types=failure_types, @@ -105,10 +107,10 @@ def _rank_rule_candidates( retrieval_out: RetrievalOutput | None, failure_types: tuple[FailureType, ...], ) -> list[_Candidate]: - sources: list[tuple[str | None, str]] = [(None, user_message)] + sources: list[tuple[str | None, str]] = [(None, strip_control_metadata(user_message))] if retrieval_out: sources.extend( - (item.evidence_id, item.summary) + (item.evidence_id, _sanitize_summary(item.summary)) for item in retrieval_out.evidence_items if _is_observed_evidence(item) ) @@ -131,6 +133,7 @@ def _score_failure_type( ) -> tuple[float, set[str]]: evidence_ids: set[str] = set() signal_score = 0.0 + strongest_signal_score = 0.0 total_signals = len(failure_type.signals) for signal in failure_type.signals: @@ -149,11 +152,13 @@ def _score_failure_type( if score > best_signal_score: best_signal_score = score best_evidence_id = evidence_id + strongest_signal_score = max(strongest_signal_score, best_signal_score) signal_score += best_signal_score if best_signal_score > 0 and best_evidence_id: evidence_ids.add(best_evidence_id) signal_confidence = signal_score / total_signals if total_signals else 0.0 + signal_confidence = max(signal_confidence, strongest_signal_score * 0.85) context_confidence, context_evidence_ids = _context_confidence(failure_type, sources) evidence_ids.update(context_evidence_ids) @@ -161,6 +166,8 @@ def _score_failure_type( confidence = max(signal_confidence, (signal_confidence * 0.55) + (context_confidence * 0.45)) else: confidence = context_confidence + if failure_type.incident_type == "CONNECTOR_TASK_FAILED" and _has_connector_task_failure_context(sources): + confidence += 0.05 return _clamp_confidence(confidence), evidence_ids @@ -187,6 +194,16 @@ def _context_confidence( return _clamp_confidence(best_score), evidence_ids +def _has_connector_task_failure_context(sources: list[tuple[str | None, str]]) -> bool: + for _, text in sources: + normalized = text.casefold() + if "connector" not in normalized and "connect" not in normalized: + continue + if re.search(r"\btask\b.*\bfailed\b|\bfailed\b.*\btask\b", normalized): + return True + return False + + def _needs_llm_assist(candidates: list[_Candidate]) -> bool: if not candidates: return True @@ -249,6 +266,10 @@ def _classifier_model_name() -> str | None: return None +def _sanitize_summary(value: str) -> str: + return strip_control_metadata(value).strip() + + def _parse_json_object(raw_response: str) -> dict[str, Any] | None: if not raw_response: return None diff --git a/services/ai-service/app/agents/planner.py b/services/ai-service/app/agents/planner.py index 8eeed1cb..5c90332a 100644 --- a/services/ai-service/app/agents/planner.py +++ b/services/ai-service/app/agents/planner.py @@ -109,6 +109,14 @@ "logs", "default-connector", "default-group", + "show", + "check", + "please", + "확인", + "확인해줘", + "봐줘", + "보여줘", + "알려줘", } _IDENTIFIER_RE = r"[A-Za-z0-9][A-Za-z0-9._:-]*" @@ -139,6 +147,11 @@ async def run_planner( llm_selected_tools: set[str] = set() else: llm_selected_tools = {tool for tool, _ in selected} + keyword_selected = _keyword_select_tools(user_message) + if _should_prefer_keyword_selection(user_message, keyword_selected): + selected = keyword_selected + selected_by_llm = False + llm_selected_tools = set() selected = _augment_hypothesis_routes(selected, user_message.lower()) # #988 SIMPLE_QUERY 단일 데이터 의도(로그/메트릭 수치) 질의는 정답 project-scope tool 을 @@ -246,7 +259,7 @@ def add(tool: str, params: dict) -> None: seen_tools.add(dedupe_key) has_stack = _has_any(msg, {"스택", "스택트레이스", "stacktrace", "예외", "exception"}) - has_trace = _has_any(msg, {"trace", "span", "latency", "분산추적", "지연추적"}) + has_trace = _has_any(msg, {"trace", "span", "latency", "트레이스", "분산추적", "지연추적"}) has_event_summary = _has_any(msg, {"이벤트", "event", "인시던트", "incident", "장애"}) has_pipeline = _has_any(msg, {"파이프라인", "pipeline"}) has_pipeline_list = _has_any(msg, {"리스트", "목록", "연결"}) @@ -285,7 +298,7 @@ def add(tool: str, params: dict) -> None: if _has_any(msg, {"consumer group", "consumer-group", "컨슈머", "consumer"}) or ( has_lag and not has_pipeline and not metrics_requested ): - if has_lag: + if has_lag and identifier is not None: add("get_consumer_lag", {}) else: add("get_consumer_groups", _PROJECT_SCOPE_PARAMS) @@ -304,6 +317,60 @@ def add(tool: str, params: dict) -> None: return selected +def _should_prefer_keyword_selection( + user_message: str, + keyword_selected: list[tuple[str, dict]], +) -> bool: + """Prefer deterministic keyword routing for explicit lookup phrases. + + Planner LLM selection is useful for broad incident prompts, but short runtime + lookups have an established public contract in tests and UI behavior. For + those, keywords are the less surprising source of truth. + """ + if keyword_selected == [_DEFAULT_TOOL]: + return False + + msg = user_message.lower() + if _has_any( + msg, + { + "incident_analysis", + "active incident", + "root cause", + "root_cause", + "근본 원인", + "원인 분석", + }, + ): + return False + + return _has_any( + msg, + { + "파이프라인", + "pipeline", + "커넥터", + "connector", + "consumer", + "컨슈머", + "trace", + "트레이스", + "스택", + "stacktrace", + "alert", + "알람", + "이벤트", + "event", + "로그", + "log", + "메트릭", + "metric", + "배포", + "deploy", + }, + ) + + def _augment_hypothesis_routes(selected: list[tuple[str, dict]], msg: str) -> list[tuple[str, dict]]: """Add deterministic read tools/metrics for incident hypotheses. diff --git a/services/ai-service/app/agents/rca.py b/services/ai-service/app/agents/rca.py index 9a6e6620..2838b316 100644 --- a/services/ai-service/app/agents/rca.py +++ b/services/ai-service/app/agents/rca.py @@ -14,6 +14,7 @@ from app.catalogs.root_causes import get_root_cause, list_root_causes from app.catalogs.types import EvidenceProfile, EvidenceRule, RootCause from app.core.config import settings +from app.evidence.metadata import strip_control_metadata from app.prompts.rca import SYSTEM_PROMPT, build_user_prompt from app.schemas.outputs import ClassifierOutput, RcaOutput, RetrievalOutput from app.schemas.state import EvidenceItem, EvidenceType, RootCauseCandidate @@ -27,6 +28,9 @@ # #962 근접 증상(task 가 FAILED 다)일 뿐 "왜 실패했는지"가 더 구체적 원인으로 입증되면 그 아래로 강등할 root cause. _SYMPTOM_ROOT_CAUSES = frozenset({"CONNECTOR_TASK_FAILED", "PIPELINE_TASK_RETRY_EXHAUSTED"}) _CAUSAL_DEPTH_MARGIN = 0.03 +_DOMINANT_CAUSES: dict[str, frozenset[str]] = { + "CREDENTIAL_ROTATION_REGRESSION": frozenset({"SOURCE_AUTH_EXPIRED", "SINK_AUTH_EXPIRED"}), +} logger = logging.getLogger(__name__) @@ -48,6 +52,15 @@ "스키마": "schema", "불일치": "mismatch", "역직렬화": "deserialization", + "직후": "after", + "이후": "after", + "후": "after", + "배포": "deployment", + "이미지": "image", + "업데이트": "update", + "중복": "duplicate", + "레코드": "record", + "소진": "exhausted", } _GENERIC_TOKENS = { "and", @@ -73,6 +86,7 @@ "감소", "변경", "정상", + "지연", "존재", "또는", "단계", @@ -160,7 +174,7 @@ def matches(self, rule: EvidenceRule, item: EvidenceItem) -> bool: if not self.enabled: return False - evidence_vector = self._vectors.get(item.summary) + evidence_vector = self._vectors.get(_sanitize_summary(item.summary)) if not evidence_vector: return False @@ -187,10 +201,11 @@ async def run_rca(classifier_out: ClassifierOutput | None, retrieval_out: Retrie return _unknown_output(["classifier_incident_type_mapping_missing"]) matcher = await _SemanticEvidenceMatcher.build(candidate_ids, evidence_items) + incident_types = _classifier_types(classifier_out) candidates = [ candidate for candidate_id in candidate_ids - if (candidate := await _evaluate_candidate(candidate_id, evidence_items, matcher)) is not None + if (candidate := await _evaluate_candidate(candidate_id, evidence_items, matcher, incident_types)) is not None ] candidates.sort(key=lambda item: item.confidence, reverse=True) @@ -201,6 +216,7 @@ async def run_rca(classifier_out: ClassifierOutput | None, retrieval_out: Retrie # #962 근접 증상(task FAILED)보다 입증된 심층 원인을 우선 — 마지막에 적용해 LLM 선택도 덮어쓴다. candidates = _demote_symptom_below_confirmed_root_cause(candidates) + candidates = _demote_direct_effect_below_confirmed_regression(candidates) candidates.sort(key=lambda item: item.confidence, reverse=True) if not candidates or candidates[0].confidence < MIN_CONFIDENT_ROOT_CAUSE: return _unknown_output(_collect_missing_required(candidates) or ["required_evidence_missing"]) @@ -242,15 +258,16 @@ async def _evaluate_candidate( root_cause_id: str, evidence_items: list[EvidenceItem], matcher: _SemanticEvidenceMatcher, + incident_types: list[str], ) -> _EvaluatedCandidate | None: root_cause = get_root_cause(root_cause_id) profile = get_evidence_profile(root_cause_id) if root_cause is None or profile is None: return None - required_matches = _match_rules(profile.required, evidence_items, matcher) - supporting_matches = _match_rules(profile.supporting, evidence_items, matcher) - negative_matches = _match_rules(profile.negative, evidence_items, matcher) + required_matches = _match_rules(profile.required, evidence_items, matcher, incident_types) + supporting_matches = _match_rules(profile.supporting, evidence_items, matcher, incident_types) + negative_matches = _match_rules(profile.negative, evidence_items, matcher, incident_types) negative_ids = _matched_evidence_ids(negative_matches) has_required_lexical_anchor = _has_lexical_required_anchor(required_matches) has_positive_lexical_anchor = has_required_lexical_anchor or _has_lexical_anchor(supporting_matches) @@ -305,13 +322,14 @@ def _match_rules( rules: tuple[EvidenceRule, ...], evidence_items: list[EvidenceItem], matcher: _SemanticEvidenceMatcher, + incident_types: list[str], ) -> list[_RuleMatch]: matches: list[_RuleMatch] = [] for rule in rules: evidence_ids: set[str] = set() semantic_evidence_ids: set[str] = set() for item in evidence_items: - match = _rule_evidence_match(rule, item, matcher) + match = _rule_evidence_match(rule, item, matcher, incident_types) if match.matched: evidence_ids.add(item.evidence_id) if match.semantic and not match.lexical: @@ -330,8 +348,9 @@ def _rule_evidence_match( rule: EvidenceRule, item: EvidenceItem, matcher: _SemanticEvidenceMatcher, + incident_types: list[str], ) -> _RuleEvidenceMatch: - lexical = _rule_matches_evidence(rule, item) + lexical = _rule_matches_evidence(rule, item, incident_types) semantic = False if not lexical and _allows_semantic_rule_match(rule, item): semantic = matcher.matches(rule, item) @@ -393,7 +412,7 @@ def _has_lexical_anchor(matches: list[_RuleMatch]) -> bool: def _allows_semantic_rule_match(rule: EvidenceRule, item: EvidenceItem) -> bool: if not settings.rca_embedding_match_enabled: return False - if not item.summary.strip(): + if not _sanitize_summary(item.summary): return False return _allows_semantic_rule(rule) @@ -436,7 +455,7 @@ def add(value: str) -> None: texts.append(value) for item in evidence_items: - add(item.summary) + add(_sanitize_summary(item.summary)) for candidate_id in candidate_ids: profile = get_evidence_profile(candidate_id) @@ -481,14 +500,21 @@ def _cosine_similarity(left: Sequence[float], right: Sequence[float]) -> float: return dot / (left_norm * right_norm) -def _rule_matches_evidence(rule: EvidenceRule, item: EvidenceItem) -> bool: - evidence_text = f"{item.type} {item.summary}".casefold() +def _rule_matches_evidence(rule: EvidenceRule, item: EvidenceItem, incident_types: list[str]) -> bool: + summary = _sanitize_summary(item.summary) + evidence_text = f"{item.type} {summary}".casefold() if _connector_failed_status_rule(rule): - return _has_connector_failed_status(item.summary) - if _connector_trace_rule(rule) and _negates_connector_trace(item.summary): + return _has_connector_failed_status(summary) + if _connector_trace_rule(rule) and _negates_connector_trace(summary): return False + if _auth_rule(rule): + return _has_scoped_auth_evidence(rule, summary, incident_types) if _consumer_lag_trend_rule(rule): - return _has_consumer_lag_trend_evidence(rule, item.summary) + return _has_consumer_lag_trend_evidence(rule, summary) + if _source_network_sink_negative_rule(rule) and not _has_sink_context(summary): + return False + if _negates_rule_fault(rule, summary): + return False rule_text = rule.evidence.casefold() example_text = (rule.example or "").casefold() @@ -516,13 +542,14 @@ def _rule_matches_evidence(rule: EvidenceRule, item: EvidenceItem) -> bool: def _has_temporal_precedence(item: EvidenceItem) -> bool: - normalized = _normalize_text(item.summary) + summary = _sanitize_summary(item.summary) + normalized = _normalize_text(summary) return bool( re.search( r"\b(?:after|since|following|followed|before|prior|preced(?:e|ed|ing)|then|subsequent)\b", normalized, ) - or re.search(r"(?:이후|직후|뒤이어|이어서|다음|전후|전에|먼저|선행)", normalized) + or re.search(r"(?:이후|직후|후|뒤이어|이어서|다음|전후|전에|먼저|선행)", summary) ) @@ -550,6 +577,158 @@ def _consumer_lag_trend_rule(rule: EvidenceRule) -> bool: return rule.root_cause_id == "CONSUMER_LAG_SPIKE" and rule.kind == "required" +def _auth_rule(rule: EvidenceRule) -> bool: + return rule.root_cause_id in {"SOURCE_AUTH_EXPIRED", "SINK_AUTH_EXPIRED"} and rule.kind == "required" + + +def _source_network_sink_negative_rule(rule: EvidenceRule) -> bool: + return ( + rule.root_cause_id == "SOURCE_NETWORK_REACHABILITY" + and rule.kind == "negative" + and "sink dependency" in rule.evidence.casefold() + ) + + +def _has_sink_context(summary: str) -> bool: + normalized = _normalize_text(summary) + return bool( + re.search(r"\b(?:sink|write|jdbc|flush|batch)\b", normalized) + or re.search(r"(?:싱크|쓰기)", summary) + ) + + +def _has_scoped_auth_evidence(rule: EvidenceRule, summary: str, incident_types: list[str]) -> bool: + observed_summary = _without_auth_negation_fragments(summary) + normalized = _without_auth_negation_fragments(_normalize_text(summary)) + if not observed_summary.strip() and not normalized.strip(): + return False + has_auth_signal = bool( + re.search( + r"\b(?:auth|authentication|permission|credential|token|password|sasl|expired|denied)\b", + normalized, + ) + or re.search(r"(?:인증\s*실패|권한\s*거부|토큰\s*만료|credential\s*만료)", observed_summary, re.IGNORECASE) + ) + if not has_auth_signal: + return False + has_source_hint = bool(re.search(r"\b(?:source|extract|read)\b", normalized) or re.search(r"(?:소스|읽기)", observed_summary)) + has_sink_hint = bool(re.search(r"\b(?:sink|write|jdbc|flush|batch)\b", normalized) or re.search(r"(?:쓰기|싱크)", observed_summary)) + auth_source_scoped = _has_scoped_fault_hint(observed_summary, "source", "auth") + auth_sink_scoped = _has_scoped_fault_hint(observed_summary, "sink", "auth") + incident_set = set(incident_types) + if rule.root_cause_id == "SOURCE_AUTH_EXPIRED": + if auth_sink_scoped and not auth_source_scoped: + return False + return auth_source_scoped or ( + "SOURCE_AUTH_FAILURE" in incident_set and not auth_sink_scoped and not has_sink_hint + ) + if auth_source_scoped and not auth_sink_scoped: + return False + return auth_sink_scoped or ( + "SINK_AUTH_FAILURE" in incident_set and not auth_source_scoped and not has_source_hint + ) + + +def _has_scoped_fault_hint(summary: str, scope: str, fault: str) -> bool: + scope_patterns = { + "source": r"(?:source|extract|read|소스|읽기)", + "sink": r"(?:sink|write|jdbc|flush|batch|싱크|쓰기)", + } + fault_patterns = { + "auth": ( + r"(?:auth|authentication|permission|credential|token|password|sasl|" + r"expired|denied|인증|권한|토큰|credential)" + ), + } + scope_re = scope_patterns[scope] + fault_re = fault_patterns[fault] + return bool( + re.search(rf"{scope_re}.{{0,80}}{fault_re}", summary, re.IGNORECASE) + or re.search(rf"{fault_re}.{{0,80}}{scope_re}", summary, re.IGNORECASE) + ) + + +def _has_auth_negation(normalized: str) -> bool: + return any(pattern.search(normalized) for pattern in _AUTH_NEGATION_FRAGMENT_PATTERNS) + + +_AUTH_NEGATION_FRAGMENT_PATTERNS = ( + re.compile( + r"\b(?:no|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:auth|authentication|permission|credential|token)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:error|failure|issue|problem|change|rotation|expired|denied)?\b", + re.IGNORECASE, + ), + re.compile( + r"\bnot\s+(?:an?\s+)?(?:auth|authentication|permission|credential|token)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:error|failure|issue|problem|change|rotation|expired|denied)?\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:auth|authentication|permission|credential|token)" + r"(?:(?!\bbut\b|[.;,\n]).){0,32}(?:normal|valid|healthy|unchanged)\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:auth|authentication|permission|credential|token).{0,80}" + r"(?:error|failure|issue|problem|change|rotation|문제)?\s*" + r"(?:없음|아님|아닌|없다|정상|유효)\b", + re.IGNORECASE, + ), + re.compile( + r"(?:인증|권한|토큰|credential)\s*(?:오류|실패|문제|변경|만료)?\s*" + r"(?:없음|아님|아닌|없다|정상|유효)", + re.IGNORECASE, + ), +) + + +def _without_auth_negation_fragments(text: str) -> str: + observed = text + for pattern in _AUTH_NEGATION_FRAGMENT_PATTERNS: + observed = pattern.sub(" ", observed) + return observed + + +def _negates_rule_fault(rule: EvidenceRule, summary: str) -> bool: + normalized = _normalize_text(summary) + raw = summary.casefold() + rule_text = f"{rule.evidence} {rule.example or ''}".casefold() + + def matches(pattern: str) -> bool: + return bool(re.search(pattern, normalized, re.IGNORECASE) or re.search(pattern, raw, re.IGNORECASE)) + + if "schema" in rule_text or "serialization" in rule_text or "deserialization" in rule_text: + return bool( + matches(r"\bno\s+(?:schema|serialization|deserialization)\s+(?:error|failure)\b") + or matches(r"\bschema\s+(?:status\s+)?(?:normal|valid|compatible|unchanged|healthy)\b") + or matches(r"\bschema\s+(?:error|failure|issue|problem|change)?\s*(?:없음|없다|아님|아닌|정상|유효|호환)\b") + or matches(r"(?:schema|스키마).*(?:정상|호환|변경\s*없음|오류\s*없음)") + ) + if "config" in rule_text: + return bool( + matches(r"\bno\s+config\s+(?:change|error|diff|validation)\b") + or matches(r"\bconfig\s+(?:status\s+)?(?:normal|valid|unchanged|snapshot)\b") + or matches(r"\bconfig\s+(?:error|change|diff|validation|issue|problem)?\s*(?:없음|없다|아님|아닌|정상|유효)\b") + or matches(r"(?:config|설정).*(?:정상|변경\s*없음|오류\s*없음|스냅샷)") + ) + if "timeout" in rule_text or "connection" in rule_text or "reachability" in rule_text: + return bool( + matches(r"\b(?:no|without)\s+(?:\w+\s+){0,3}(?:timeout|network|reachability|connection)\s+(?:evidence|error|failure|issue)\b") + or matches(r"\b(?:endpoint|connection|network)\s+(?:reachable|healthy|normal|ok)\b") + or matches(r"(?:연결|네트워크|endpoint).*(?:정상|성공|가능)") + ) + if "constraint" in rule_text or "duplicate" in rule_text: + return bool( + matches(r"\bno\s+(?:duplicate|constraint)\s+(?:error|violation|records?)\b") + or matches(r"\b(?:duplicate|constraint)(?:\s+\w+){0,4}\s*(?:없음|없다|아님|아닌|normal|healthy|zero)\b") + or matches(r"(?:중복|제약).*(?:없음|정상)") + ) + return False + + def _has_consumer_lag_trend_evidence(rule: EvidenceRule, summary: str) -> bool: normalized = _normalize_text(summary) if "consumer lag" in rule.evidence.casefold(): @@ -633,6 +812,10 @@ def _normalize_text(value: str) -> str: return " ".join(_tokens(value)) +def _sanitize_summary(value: str) -> str: + return strip_control_metadata(value).strip() + + def _meaningful_tokens(value: str) -> set[str]: return {token for token in _tokens(value) if len(token) > 1 and token not in _GENERIC_TOKENS} @@ -661,10 +844,11 @@ def _score_confidence( supporting_ratio = supporting_matched / supporting_total if supporting_total else 0.0 if required_total and required_matched == required_total: - confidence = 0.82 + (supporting_ratio * 0.10) - elif required_matched > 0: - confidence = 0.60 + (required_ratio * 0.16) + (supporting_ratio * 0.04) + confidence = 0.88 + (supporting_ratio * 0.04) confidence = min(confidence, root_cause.default_confidence_cap) + elif required_matched > 0: + confidence = 0.72 + (required_ratio * 0.14) + (supporting_ratio * 0.04) + confidence = min(confidence, root_cause.default_confidence_cap, 0.79) else: confidence = min(0.35 + (supporting_ratio * 0.10), root_cause.default_confidence_cap, 0.59) @@ -699,6 +883,27 @@ def _demote_symptom_below_confirmed_root_cause( ] +def _demote_direct_effect_below_confirmed_regression( + candidates: list[_EvaluatedCandidate], +) -> list[_EvaluatedCandidate]: + ceilings: dict[str, float] = {} + for candidate in candidates: + effects = _DOMINANT_CAUSES.get(candidate.root_cause_id) + if not effects or not candidate.required_evidence_satisfied: + continue + ceiling = candidate.confidence - _CAUSAL_DEPTH_MARGIN + for effect_id in effects: + ceilings[effect_id] = max(ceilings.get(effect_id, 0.0), ceiling) + if not ceilings: + return candidates + return [ + replace(candidate, confidence=_clamp_confidence(ceiling)) + if (ceiling := ceilings.get(candidate.root_cause_id)) is not None and candidate.confidence > ceiling + else candidate + for candidate in candidates + ] + + def _needs_llm_assist(candidates: list[_EvaluatedCandidate]) -> bool: if len(candidates) < 2: return False @@ -723,7 +928,7 @@ async def _run_llm_assist( "role": "user", "content": build_user_prompt( candidate_pool=[(candidate.root_cause, candidate.profile) for candidate in candidates[:MAX_CANDIDATES]], - evidence_summaries=[(item.evidence_id, item.summary) for item in evidence_items], + evidence_summaries=[(item.evidence_id, _sanitize_summary(item.summary)) for item in evidence_items], classifier_types=classifier_types, ), }, diff --git a/services/ai-service/app/agents/retrieval.py b/services/ai-service/app/agents/retrieval.py index 6ec0876d..71fec626 100644 --- a/services/ai-service/app/agents/retrieval.py +++ b/services/ai-service/app/agents/retrieval.py @@ -2,6 +2,7 @@ from __future__ import annotations import asyncio +import inspect import logging from datetime import datetime, timezone from typing import Any @@ -9,6 +10,7 @@ from app.agents.agentic import ToolCallRecord, run_tool_loop from app.core.config import settings +from app.evidence.signals import evidence_signal_summary from app.evidence.redaction import redact_payload, redact_text from app.knowledge.vector_store import get_vector_store from app.llm.provider import get_llm_provider @@ -22,6 +24,7 @@ from app.tools.registry import ToolClientRegistry logger = logging.getLogger(__name__) +_ORIGINAL_RUN_TOOL_LOOP = run_tool_loop # planner 가 명시적 키워드 매칭 없이 fallback 으로 선택하는 도구. 이 도구만으로 이뤄진 # plan 은 순수 지식/용어 질의("DLQ가 뭐야?")로 간주해 RAG 근거가 있으면 단락한다. @@ -92,11 +95,43 @@ def _safe_task_trace_entry(entry: Any) -> dict[str, Any]: } +def _summary_with_signals(tool_name: str, summary: str, result: Any) -> str: + signal_summary = evidence_signal_summary(tool_name, _raw_payload_for_store(result)) + if not signal_summary or signal_summary in summary: + return summary + return f"{summary}; evidence signals: {signal_summary}" + + def _has_operational_tool(plan: PlannerOutput) -> bool: """planner 가 fallback 이 아닌 명시적 운영 runtime tool 을 계획했는지 여부.""" return any(step.tool_name not in _FALLBACK_ONLY_TOOLS for step in plan.retrieval_plan) +def _registry_supports_react_loop(registry: ToolClientRegistry) -> bool: + if run_tool_loop is not _ORIGINAL_RUN_TOOL_LOOP: + return True + list_tools = getattr(registry, "list_tools", None) + if not callable(list_tools) or inspect.iscoroutinefunction(list_tools): + return False + try: + tools = list_tools() + except TypeError: + return False + except Exception: + logger.warning("react loop tool catalog unavailable", exc_info=True) + raise + if inspect.isawaitable(tools): + close = getattr(tools, "close", None) + if callable(close): + close() + return False + try: + iter(tools) + except TypeError: + return False + return True + + async def _pub(bus: EventBus, repo: AnyEventRepo, run_id: str, event: StreamingEvent) -> None: await append_event(repo, run_id, event) await bus.publish(run_id, event) @@ -127,7 +162,7 @@ async def _evidence_from_executed( if failed: summary = f"{tool_name}: {redact_text(result.error.message if result.error else '조회 실패')}" else: - summary = redact_text(result.summary) + summary = redact_text(_summary_with_signals(tool_name, result.summary, result)) store_ref = await evidence_repo.put( run_id=run_id, evidence_id=evidence_id, tool_name=tool_name, step_id=step_id, status=result.status.value, payload=redact_payload(_raw_payload_for_store(result)), @@ -241,7 +276,7 @@ async def call_step(step: "RetrievalPlanStep") -> EvidenceItem: # type: ignore[ evidence_id = str(uuid4()) if result.status == ToolStatus.SUCCESS: - summary = redact_text(result.summary) + summary = redact_text(_summary_with_signals(step.tool_name, result.summary, result)) store_ref = await evidence_repo.put( run_id=run_id, evidence_id=evidence_id, @@ -341,6 +376,7 @@ async def call_step(step: "RetrievalPlanStep") -> EvidenceItem: # type: ignore[ allow_react_loop and mode in (AgentMode.SIMPLE_QUERY, AgentMode.INCIDENT_ANALYSIS) and provider.supports_tools() + and _registry_supports_react_loop(registry) ): loop_result = await run_tool_loop( user_message=user_message or "", registry=registry, context=context, diff --git a/services/ai-service/app/catalogs/evidence_matrix.py b/services/ai-service/app/catalogs/evidence_matrix.py index 8d7a216b..f89dbd79 100644 --- a/services/ai-service/app/catalogs/evidence_matrix.py +++ b/services/ai-service/app/catalogs/evidence_matrix.py @@ -9,9 +9,9 @@ EvidenceProfile( root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', required=( - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='source connection timeout 증가', example='`pipeline_source_connection_timeout_total` 증가'), + EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='source connection timeout 증가', example='`pipeline_source_connection_timeout_total` 증가, database saturation, read deadline exceeded'), EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='pipeline extract/read 단계 timeout log', example='`extract_users` task `ConnectionTimeout`'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='pipeline read latency 증가', example='extract duration p95 증가'), + EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='pipeline read latency 증가', example='read duration percentile 상승, extraction wait 증가'), ), supporting=( EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='supporting', evidence='sink write 단계 정상', example='sink write latency 정상'), @@ -25,7 +25,7 @@ EvidenceProfile( root_cause_id='SOURCE_AUTH_EXPIRED', required=( - EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='required', evidence='auth/permission error log', example='`AccessDenied`, `token expired`, permission denied, access denied, 인증 실패, 권한 거부, 비밀번호 인증 실패'), + EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='required', evidence='auth/permission error log', example='read path authentication failure, source secret expired, permission denied, access denied, 인증 실패, 권한 거부, 토큰 만료'), ), supporting=( EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='supporting', evidence='credential rotation 또는 secret 변경 이력', example='rotate 직후 실패'), @@ -37,8 +37,8 @@ EvidenceProfile( root_cause_id='SOURCE_READ_LATENCY', required=( - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='source read latency 증가', example='p95 read latency 증가'), - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='extract task duration 증가', example='task runtime 증가'), + EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='source read latency 증가', example='p95 read latency 상승, scan volume 증가'), + EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='extract task duration 증가', example='task runtime 증가, extract duration 증가, extract p95 상승, read stage duration 증가'), ), supporting=( EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='supporting', evidence='downstream 처리 정상', example='Kafka/sink 지표 정상'), @@ -92,8 +92,8 @@ EvidenceProfile( root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', required=( - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='retry count exhausted', example='max retry reached'), - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='동일 task 반복 실패', example='retry history'), + EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='retry count exhausted', example='retry budget exhausted, retry limit reached'), + EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='동일 task 반복 실패', example='retry history, repeated task failure, retry attempts all failed'), ), supporting=( EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='supporting', evidence='transient dependency error', example='source/sink timeout'), @@ -105,7 +105,7 @@ EvidenceProfile( root_cause_id='SCHEMA_MISMATCH', required=( - EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='required', evidence='serialization/deserialization/schema error', example='incompatible schema, deserialization error, 스키마 불일치, 스키마 오류, 역직렬화 오류'), + EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='required', evidence='serialization/deserialization/schema error', example='incompatible schema, deserialization error, serialization exception, 스키마 불일치, 스키마 오류, 역직렬화 오류'), ), supporting=( EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='supporting', evidence='schema version 변경 이력', example='recent subject version'), @@ -119,7 +119,7 @@ root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', required=( EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='required', evidence='Connect worker rebalance 이벤트 반복', example='rebalance count 급증'), - EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='required', evidence='task assignment가 반복적으로 변경', example='task revoked/assigned loop'), + EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='required', evidence='task assignment가 반복적으로 변경', example='task revoked/assigned loop, task 할당 불안정'), ), supporting=( EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='supporting', evidence='worker pod restart 또는 network flap', example='worker instability'), @@ -131,8 +131,8 @@ EvidenceProfile( root_cause_id='PIPELINE_CONFIG_INVALID', required=( - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='config validation error 또는 invalid option log', example='unknown config, invalid converter'), - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='최근 pipeline/connector config 변경', example='config diff 존재', causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='config validation error 또는 invalid option log', example='unknown config, invalid converter, config validation failed, unsupported transform alias, malformed connector option'), + EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='최근 pipeline/connector config 변경', example='config diff 존재, connector config 변경, config created or updated', causality_type='temporal', temporality_required=True, causal_chain_step=1), ), supporting=( EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='supporting', evidence='rollback 또는 이전 config에서 정상 동작', example='config regression evidence'), @@ -171,7 +171,7 @@ EvidenceProfile( root_cause_id='PARTITION_IMBALANCE', required=( - EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='required', evidence='broker별 partition 또는 leader skew', example='distribution imbalance'), + EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='required', evidence='broker별 partition 또는 leader skew', example='distribution imbalance, leader skew, leader 편중, 일부 파티션 latency skew'), ), supporting=( EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='supporting', evidence='특정 broker만 resource pressure', example='broker hot spot'), @@ -185,7 +185,7 @@ root_cause_id='TOPIC_INGRESS_SPIKE', required=( EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='required', evidence='topic ingress rate 급증', example='messages in/sec 또는 bytes in/sec 증가'), - EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='required', evidence='upstream volume 증가와 시간 상관', example='source row count 급증', causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='required', evidence='upstream volume 증가와 시간 상관', example='source row count 급증, upstream 이벤트 폭증, scheduled producer burst', causality_type='temporal', temporality_required=True, causal_chain_step=1), ), supporting=( EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='supporting', evidence='consumer lag가 ingress 증가 직후 동반', example='lag start time correlation', causality_type='temporal', temporality_required=True, causal_chain_step=2), @@ -228,7 +228,7 @@ root_cause_id='SINK_WRITE_LATENCY', required=( EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='required', evidence='sink write latency 증가', example='write p95 증가'), - EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='required', evidence='connector sink task 처리시간 증가', example='flush/batch duration 증가'), + EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='required', evidence='connector sink task 처리시간 증가', example='flush/batch duration 증가, connector task 지연'), ), supporting=( EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='supporting', evidence='source/Kafka 정상', example='upstream 정상'), @@ -240,7 +240,7 @@ EvidenceProfile( root_cause_id='SINK_AUTH_EXPIRED', required=( - EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='required', evidence='sink auth/permission error log', example='`AccessDenied`, `token expired`, permission denied, access denied, 인증 실패, 권한 거부, 비밀번호 인증 실패'), + EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='required', evidence='sink auth/permission error log', example='write path authentication failure, sink secret expired, permission denied, access denied, 인증 실패, 권한 거부, 토큰 만료'), ), supporting=( EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='supporting', evidence='credential rotation 또는 secret 변경 이력', example='rotate 직후 실패'), @@ -266,7 +266,7 @@ root_cause_id='POD_OOM_KILLED', required=( EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='required', evidence='pod last state OOMKilled', example='Kubernetes status', semantic_allowed=False), - EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='required', evidence='restart count 증가', example='restart count delta', semantic_allowed=False), + EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='required', evidence='restart count 증가', example='restart count delta, container restart', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='supporting', evidence='memory usage limit 근접', example='container memory metric'), @@ -278,8 +278,8 @@ EvidenceProfile( root_cause_id='DEPLOYMENT_REGRESSION', required=( - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='배포 이후 error/latency 증가', example='rollout time correlation', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='image/config diff', example='change record', semantic_allowed=False), + EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='배포 이후 error/latency 증가', example='rollout time correlation, deployment followed by failures', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='image/config diff', example='change record, new image rollout, image tag diff, connector image 배포, 이미지 배포', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='supporting', evidence='rollback 후 개선', example='after evidence'), @@ -292,7 +292,7 @@ root_cause_id='POD_CRASH_LOOP', required=( EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='required', evidence='pod `CrashLoopBackOff` 또는 반복 restart', example='restart count 증가'), - EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='required', evidence='container termination reason과 app error summary', example='exit code, startup failure'), + EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='required', evidence='container termination reason과 app error summary', example='exit code, startup failure, 앱 시작 실패'), ), supporting=( EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='supporting', evidence='최근 config/image 변경', example='rollout 직후 crash'), @@ -304,7 +304,7 @@ EvidenceProfile( root_cause_id='NODE_PRESSURE', required=( - EvidenceRule(root_cause_id='NODE_PRESSURE', kind='required', evidence='node condition pressure', example='MemoryPressure, DiskPressure, PIDPressure'), + EvidenceRule(root_cause_id='NODE_PRESSURE', kind='required', evidence='node condition pressure', example='MemoryPressure, DiskPressure, PIDPressure, 노드 CPU 사용량 임계치 초과'), EvidenceRule(root_cause_id='NODE_PRESSURE', kind='required', evidence='affected pod scheduling/eviction event', example='eviction 또는 pending 증가'), ), supporting=( @@ -330,8 +330,8 @@ EvidenceProfile( root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', required=( - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='config 변경 시점 이후 error/latency 증가', example='change time correlation', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='변경 diff와 증상 계층이 연결됨', example='connector task config diff', semantic_allowed=False, causality_type='causal', causal_chain_step=2), + EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='config 변경 시점 이후 error/latency 증가', example='change time correlation, post-change error or latency signal', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='변경 diff와 증상 계층이 연결됨', example='configuration diff affecting failing pipeline stage, validation failure after config update', semantic_allowed=False, causality_type='causal', causal_chain_step=2), ), supporting=( EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='supporting', evidence='rollback 또는 이전 config로 개선', example='after evidence'), @@ -343,8 +343,8 @@ EvidenceProfile( root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', required=( - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='schema version 변경 이후 schema/serialization error 증가', example='subject version change', semantic_allowed=False), - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='compatibility check 실패 또는 필드 타입 변화', example='incompatible schema', semantic_allowed=False), + EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='schema version 변경 이후 schema/serialization error 증가', example='subject version change followed by serialization failure', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='compatibility check 실패 또는 필드 타입 변화', example='incompatible schema, compatibility error, 호환성 에러, field type mismatch', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='supporting', evidence='affected topic/connector가 변경 subject를 사용', example='topology match'), @@ -356,8 +356,8 @@ EvidenceProfile( root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', required=( - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='image rollout 이후 error/latency/restart 증가', example='deployment rollout event', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='이전 image 대비 config/runtime 차이', example='image tag diff', semantic_allowed=False), + EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='image rollout 이후 error/latency/restart 증가', example='deployment rollout event followed by restart or error-rate increase', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), + EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='image version update', example='image tag/version changed, runtime dependency or config delta', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='supporting', evidence='rollback 후 개선', example='after evidence'), @@ -370,7 +370,7 @@ root_cause_id='CREDENTIAL_ROTATION_REGRESSION', required=( EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='required', evidence='credential rotation 이후 auth failure 증가', example='rotate time correlation', semantic_allowed=False), - EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='required', evidence='affected dependency가 해당 credential을 사용', example='dependency ownership match', semantic_allowed=False), + EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='required', evidence='affected dependency가 해당 credential을 사용', example='dependency ownership match, rotated secret not active on dependency', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='supporting', evidence='rotation audit 또는 secret version 변경', example='version diff'), @@ -395,8 +395,8 @@ EvidenceProfile( root_cause_id='PIPELINE_DUPLICATE_SPIKE', required=( - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='duplicate count 또는 duplicate key error 증가', example='duplicate metric 증가'), - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='retry/replay/backfill 또는 idempotency gap', example='repeated processing evidence'), + EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='duplicate count 또는 duplicate key error 증가', example='duplicate metric 증가, repeated records'), + EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='retry/replay/backfill 또는 idempotency gap', example='repeated processing evidence, idempotency policy gap, replay/backfill boundary evidence'), ), supporting=( EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='supporting', evidence='최근 transform/config 변경', example='key derivation change'), @@ -409,7 +409,7 @@ root_cause_id='PIPELINE_FRESHNESS_DELAY', required=( EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='required', evidence='end-to-end freshness 또는 watermark delay 증가', example='freshness SLA breach', semantic_allowed=False), - EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='required', evidence='pipeline stage 중 병목 단계 식별', example='source/Kafka/sink stage duration', semantic_allowed=False), + EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='required', evidence='pipeline stage 중 병목 단계 식별', example='source/Kafka/sink stage duration, stage throughput bottleneck, downstream lag buildup', semantic_allowed=False), ), supporting=( EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='supporting', evidence='lag 또는 sink latency 동반', example='downstream bottleneck'), @@ -433,139 +433,18 @@ ), ) -EVIDENCE_RULES: tuple[EvidenceRule, ...] = ( - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='source connection timeout 증가', example='`pipeline_source_connection_timeout_total` 증가'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='pipeline extract/read 단계 timeout log', example='`extract_users` task `ConnectionTimeout`'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='required', evidence='pipeline read latency 증가', example='extract duration p95 증가'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='supporting', evidence='sink write 단계 정상', example='sink write latency 정상'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='supporting', evidence='최근 source credential rotate 없음', example='auth 변경 없음'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='negative', evidence='sink write timeout 증가', example='source 단독 원인 가능성 낮춤'), - EvidenceRule(root_cause_id='SOURCE_DB_CONNECTION_TIMEOUT', kind='negative', evidence='source metric 정상', example='source timeout 후보 약화'), - EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='required', evidence='auth/permission error log', example='`AccessDenied`, `token expired`, permission denied, access denied, 인증 실패, 권한 거부, 비밀번호 인증 실패'), - EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='supporting', evidence='credential rotation 또는 secret 변경 이력', example='rotate 직후 실패'), - EvidenceRule(root_cause_id='SOURCE_AUTH_EXPIRED', kind='negative', evidence='connection timeout만 존재하고 auth error 없음', example='auth 후보 약화'), - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='source read latency 증가', example='p95 read latency 증가'), - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='required', evidence='extract task duration 증가', example='task runtime 증가'), - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='supporting', evidence='downstream 처리 정상', example='Kafka/sink 지표 정상'), - EvidenceRule(root_cause_id='SOURCE_READ_LATENCY', kind='negative', evidence='source connection failure', example='latency가 아니라 connectivity 후보 우선'), - EvidenceRule(root_cause_id='SOURCE_DATA_NOT_READY', kind='required', evidence='source watermark 정체 또는 expected partition 미생성', example='source watermark가 SLA 시간 이상 갱신되지 않음'), - EvidenceRule(root_cause_id='SOURCE_DATA_NOT_READY', kind='required', evidence='pipeline extract 결과 empty batch 반복', example='row count 0 또는 기준 대비 급감'), - EvidenceRule(root_cause_id='SOURCE_DATA_NOT_READY', kind='supporting', evidence='upstream schedule 지연 또는 source 생성 job 지연', example='source owner schedule delay'), - EvidenceRule(root_cause_id='SOURCE_DATA_NOT_READY', kind='negative', evidence='source read timeout 또는 auth failure', example='데이터 미준비보다 연결/auth 후보 우선'), - EvidenceRule(root_cause_id='SOURCE_NETWORK_REACHABILITY', kind='required', evidence='Bifrost에서 source endpoint reachability 실패', example='connection refused, no route to host, 연결 실패, 호스트 연결 실패, 네트워크 도달 실패'), - EvidenceRule(root_cause_id='SOURCE_NETWORK_REACHABILITY', kind='supporting', evidence='여러 pipeline에서 같은 source endpoint 연결 실패', example='shared dependency timeout'), - EvidenceRule(root_cause_id='SOURCE_NETWORK_REACHABILITY', kind='supporting', evidence='고객사 source 내부 지표 정상이나 network path error 존재', example='network error code 증가'), - EvidenceRule(root_cause_id='SOURCE_NETWORK_REACHABILITY', kind='negative', evidence='auth error 또는 query error만 존재', example='network 후보 약화'), - EvidenceRule(root_cause_id='CONNECTOR_TASK_FAILED', kind='required', evidence='connector task status `FAILED`', example='Kafka Connect task 상태', semantic_allowed=False), - EvidenceRule(root_cause_id='CONNECTOR_TASK_FAILED', kind='required', evidence='task trace 또는 worker log', example='exception stack summary'), - EvidenceRule(root_cause_id='CONNECTOR_TASK_FAILED', kind='supporting', evidence='최근 connector config/schema 변경', example='변경 이후 실패'), - EvidenceRule(root_cause_id='CONNECTOR_TASK_FAILED', kind='negative', evidence='worker 전체 장애', example='worker/root infra 후보 우선'), - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='retry count exhausted', example='max retry reached'), - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='required', evidence='동일 task 반복 실패', example='retry history'), - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='supporting', evidence='transient dependency error', example='source/sink timeout'), - EvidenceRule(root_cause_id='PIPELINE_TASK_RETRY_EXHAUSTED', kind='negative', evidence='첫 실패이며 retry 여지 있음', example='exhausted 아님'), - EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='required', evidence='serialization/deserialization/schema error', example='incompatible schema, deserialization error, 스키마 불일치, 스키마 오류, 역직렬화 오류'), - EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='supporting', evidence='schema version 변경 이력', example='recent subject version'), - EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='supporting', evidence='데이터 샘플 구조 변화', example='field type mismatch'), - EvidenceRule(root_cause_id='SCHEMA_MISMATCH', kind='negative', evidence='schema 변경 없음', example='후보 약화'), - EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='required', evidence='Connect worker rebalance 이벤트 반복', example='rebalance count 급증'), - EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='required', evidence='task assignment가 반복적으로 변경', example='task revoked/assigned loop'), - EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='supporting', evidence='worker pod restart 또는 network flap', example='worker instability'), - EvidenceRule(root_cause_id='CONNECTOR_WORKER_REBALANCE_LOOP', kind='negative', evidence='단일 connector task exception만 존재', example='task 자체 실패 후보 우선'), - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='config validation error 또는 invalid option log', example='unknown config, invalid converter'), - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='required', evidence='최근 pipeline/connector config 변경', example='config diff 존재'), - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='supporting', evidence='rollback 또는 이전 config에서 정상 동작', example='config regression evidence'), - EvidenceRule(root_cause_id='PIPELINE_CONFIG_INVALID', kind='negative', evidence='변경 없이 dependency timeout만 존재', example='config 후보 약화'), - EvidenceRule(root_cause_id='CONSUMER_LAG_SPIKE', kind='required', evidence='consumer lag 급증', example='lag p95 증가', semantic_allowed=False), - EvidenceRule(root_cause_id='CONSUMER_LAG_SPIKE', kind='required', evidence='offset progression 둔화', example='commit rate 감소', semantic_allowed=False), - EvidenceRule(root_cause_id='CONSUMER_LAG_SPIKE', kind='supporting', evidence='topic ingress 증가', example='incoming messages 증가'), - EvidenceRule(root_cause_id='CONSUMER_LAG_SPIKE', kind='supporting', evidence='consumer pod resource pressure', example='CPU/memory saturation'), - EvidenceRule(root_cause_id='CONSUMER_LAG_SPIKE', kind='negative', evidence='broker 장애 evidence', example='broker 원인 우선'), - EvidenceRule(root_cause_id='BROKER_RESOURCE_PRESSURE', kind='required', evidence='broker resource saturation', example='disk, CPU, network'), - EvidenceRule(root_cause_id='BROKER_RESOURCE_PRESSURE', kind='required', evidence='broker request latency 증가', example='produce/fetch latency'), - EvidenceRule(root_cause_id='BROKER_RESOURCE_PRESSURE', kind='supporting', evidence='under-replicated partition 증가', example='ISR 변화'), - EvidenceRule(root_cause_id='BROKER_RESOURCE_PRESSURE', kind='negative', evidence='consumer만 느림', example='consumer 원인 우선'), - EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='required', evidence='broker별 partition 또는 leader skew', example='distribution imbalance'), - EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='supporting', evidence='특정 broker만 resource pressure', example='broker hot spot'), - EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='supporting', evidence='Cruise Control proposal 개선 예상', example='rebalance proposal'), - EvidenceRule(root_cause_id='PARTITION_IMBALANCE', kind='negative', evidence='균등 분산 상태', example='후보 배제'), - EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='required', evidence='topic ingress rate 급증', example='messages in/sec 또는 bytes in/sec 증가'), - EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='required', evidence='upstream volume 증가와 시간 상관', example='source row count 급증'), - EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='supporting', evidence='consumer lag가 ingress 증가 직후 동반', example='lag start time correlation'), - EvidenceRule(root_cause_id='TOPIC_INGRESS_SPIKE', kind='negative', evidence='ingress 정상인데 consumer 처리량만 감소', example='consumer/sink 후보 우선'), - EvidenceRule(root_cause_id='CONSUMER_REBALANCE_LOOP', kind='required', evidence='consumer group rebalance 반복', example='rebalance event count 증가'), - EvidenceRule(root_cause_id='CONSUMER_REBALANCE_LOOP', kind='required', evidence='member join/leave 반복 또는 assignment churn', example='member id 변경 반복'), - EvidenceRule(root_cause_id='CONSUMER_REBALANCE_LOOP', kind='supporting', evidence='pod restart 또는 heartbeat/session timeout', example='consumer stability issue'), - EvidenceRule(root_cause_id='CONSUMER_REBALANCE_LOOP', kind='negative', evidence='lag 증가만 있고 rebalance 없음', example='lag spike 원인으로 부족'), - EvidenceRule(root_cause_id='SINK_DB_CONNECTION_TIMEOUT', kind='required', evidence='sink write timeout 증가', example='sink connector write timeout'), - EvidenceRule(root_cause_id='SINK_DB_CONNECTION_TIMEOUT', kind='required', evidence='sink dependency connection error', example='reachability or pool error'), - EvidenceRule(root_cause_id='SINK_DB_CONNECTION_TIMEOUT', kind='supporting', evidence='source read 정상', example='upstream 정상'), - EvidenceRule(root_cause_id='SINK_DB_CONNECTION_TIMEOUT', kind='supporting', evidence='sink write latency 증가', example='write duration p95 증가'), - EvidenceRule(root_cause_id='SINK_DB_CONNECTION_TIMEOUT', kind='negative', evidence='source extract timeout', example='source 후보 우선'), - EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='required', evidence='sink write latency 증가', example='write p95 증가'), - EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='required', evidence='connector sink task 처리시간 증가', example='flush/batch duration 증가'), - EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='supporting', evidence='source/Kafka 정상', example='upstream 정상'), - EvidenceRule(root_cause_id='SINK_WRITE_LATENCY', kind='negative', evidence='sink auth error', example='auth 후보 우선'), - EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='required', evidence='sink auth/permission error log', example='`AccessDenied`, `token expired`, permission denied, access denied, 인증 실패, 권한 거부, 비밀번호 인증 실패'), - EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='supporting', evidence='credential rotation 또는 secret 변경 이력', example='rotate 직후 실패'), - EvidenceRule(root_cause_id='SINK_AUTH_EXPIRED', kind='negative', evidence='connection timeout만 존재하고 auth error 없음', example='auth 후보 약화'), - EvidenceRule(root_cause_id='SINK_CONSTRAINT_VIOLATION', kind='required', evidence='sink constraint 또는 duplicate key error', example='unique constraint violation'), - EvidenceRule(root_cause_id='SINK_CONSTRAINT_VIOLATION', kind='supporting', evidence='schema 또는 transform 변경 이력', example='field 변경 후 write error'), - EvidenceRule(root_cause_id='SINK_CONSTRAINT_VIOLATION', kind='supporting', evidence='동일 record 반복 실패', example='poison record 가능성'), - EvidenceRule(root_cause_id='SINK_CONSTRAINT_VIOLATION', kind='negative', evidence='sink timeout/latency만 존재', example='constraint 후보 약화'), - EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='required', evidence='pod last state OOMKilled', example='Kubernetes status', semantic_allowed=False), - EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='required', evidence='restart count 증가', example='restart count delta', semantic_allowed=False), - EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='supporting', evidence='memory usage limit 근접', example='container memory metric'), - EvidenceRule(root_cause_id='POD_OOM_KILLED', kind='negative', evidence='app-level source timeout만 존재', example='source 후보 우선'), - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='배포 이후 error/latency 증가', example='rollout time correlation', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='required', evidence='image/config diff', example='change record', semantic_allowed=False), - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='supporting', evidence='rollback 후 개선', example='after evidence'), - EvidenceRule(root_cause_id='DEPLOYMENT_REGRESSION', kind='negative', evidence='배포 전부터 문제 지속', example='변경 원인 약화'), - EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='required', evidence='pod `CrashLoopBackOff` 또는 반복 restart', example='restart count 증가'), - EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='required', evidence='container termination reason과 app error summary', example='exit code, startup failure'), - EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='supporting', evidence='최근 config/image 변경', example='rollout 직후 crash'), - EvidenceRule(root_cause_id='POD_CRASH_LOOP', kind='negative', evidence='정상 pod 상태에서 app-level timeout만 존재', example='pod crash 후보 약화'), - EvidenceRule(root_cause_id='NODE_PRESSURE', kind='required', evidence='node condition pressure', example='MemoryPressure, DiskPressure, PIDPressure'), - EvidenceRule(root_cause_id='NODE_PRESSURE', kind='required', evidence='affected pod scheduling/eviction event', example='eviction 또는 pending 증가'), - EvidenceRule(root_cause_id='NODE_PRESSURE', kind='supporting', evidence='같은 node의 여러 workload 영향', example='node-local symptom'), - EvidenceRule(root_cause_id='NODE_PRESSURE', kind='negative', evidence='특정 app pod만 실패', example='app/config 후보 우선'), - EvidenceRule(root_cause_id='PVC_PRESSURE', kind='required', evidence='PVC 사용량 또는 I/O latency 임계치 초과', example='volume usage high, fsync latency'), - EvidenceRule(root_cause_id='PVC_PRESSURE', kind='required', evidence='pod log에 disk full 또는 write failure', example='no space left on device'), - EvidenceRule(root_cause_id='PVC_PRESSURE', kind='supporting', evidence='broker 또는 DB workload와 시간 상관', example='storage-backed workload 영향', causality_type='correlational', temporality_required=True, causal_chain_step=2), - EvidenceRule(root_cause_id='PVC_PRESSURE', kind='negative', evidence='CPU/memory pressure만 존재', example='PVC 후보 약화'), - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='config 변경 시점 이후 error/latency 증가', example='change time correlation', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='required', evidence='변경 diff와 증상 계층이 연결됨', example='connector task config diff', semantic_allowed=False, causality_type='causal', causal_chain_step=2), - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='supporting', evidence='rollback 또는 이전 config로 개선', example='after evidence'), - EvidenceRule(root_cause_id='RECENT_CONFIG_CHANGE_REGRESSION', kind='negative', evidence='변경 전부터 동일 증상 지속', example='config regression 후보 약화'), - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='schema version 변경 이후 schema/serialization error 증가', example='subject version change', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='required', evidence='compatibility check 실패 또는 필드 타입 변화', example='incompatible schema', semantic_allowed=False), - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='supporting', evidence='affected topic/connector가 변경 subject를 사용', example='topology match'), - EvidenceRule(root_cause_id='RECENT_SCHEMA_CHANGE_REGRESSION', kind='negative', evidence='schema 변경 없음', example='schema regression 후보 약화'), - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='image rollout 이후 error/latency/restart 증가', example='deployment rollout event', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='required', evidence='이전 image 대비 config/runtime 차이', example='image tag diff', semantic_allowed=False), - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='supporting', evidence='rollback 후 개선', example='after evidence'), - EvidenceRule(root_cause_id='RECENT_IMAGE_DEPLOYMENT_REGRESSION', kind='negative', evidence='rollout 전부터 문제 지속', example='image regression 후보 약화'), - EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='required', evidence='credential rotation 이후 auth failure 증가', example='rotate time correlation', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='required', evidence='affected dependency가 해당 credential을 사용', example='dependency ownership match', semantic_allowed=False), - EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='supporting', evidence='rotation audit 또는 secret version 변경', example='version diff'), - EvidenceRule(root_cause_id='CREDENTIAL_ROTATION_REGRESSION', kind='negative', evidence='auth error 없이 timeout만 존재', example='credential 후보 약화'), - EvidenceRule(root_cause_id='UPSTREAM_DATA_VOLUME_ANOMALY', kind='required', evidence='source row count 또는 topic ingress가 기준 대비 급변', example='volume z-score 이상, throughput 급감/급증, 유입량 급변'), - EvidenceRule(root_cause_id='UPSTREAM_DATA_VOLUME_ANOMALY', kind='supporting', evidence='upstream schedule/change와 시간 상관', example='upstream batch size change', causality_type='correlational', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='UPSTREAM_DATA_VOLUME_ANOMALY', kind='supporting', evidence='pipeline 처리량 저하 없이 입력만 변동', example='downstream 정상'), - EvidenceRule(root_cause_id='UPSTREAM_DATA_VOLUME_ANOMALY', kind='negative', evidence='pipeline failure 때문에 output만 감소', example='pipeline 후보 우선'), - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='duplicate count 또는 duplicate key error 증가', example='duplicate metric 증가'), - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='required', evidence='retry/replay/backfill 또는 idempotency gap', example='repeated processing evidence'), - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='supporting', evidence='최근 transform/config 변경', example='key derivation change'), - EvidenceRule(root_cause_id='PIPELINE_DUPLICATE_SPIKE', kind='negative', evidence='upstream부터 duplicate가 존재', example='upstream data quality 후보 우선'), - EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='required', evidence='end-to-end freshness 또는 watermark delay 증가', example='freshness SLA breach', semantic_allowed=False), - EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='required', evidence='pipeline stage 중 병목 단계 식별', example='source/Kafka/sink stage duration', semantic_allowed=False), - EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='supporting', evidence='lag 또는 sink latency 동반', example='downstream bottleneck'), - EvidenceRule(root_cause_id='PIPELINE_FRESHNESS_DELAY', kind='negative', evidence='source 데이터 미생성만 확인', example='source data not ready 후보 우선'), - EvidenceRule(root_cause_id='SCHEMA_NULL_RATE_SPIKE', kind='required', evidence='특정 field null rate 급증', example='null rate metric 증가', semantic_allowed=False), - EvidenceRule(root_cause_id='SCHEMA_NULL_RATE_SPIKE', kind='required', evidence='schema/source/transform 변경과 시간 상관', example='field mapping change', semantic_allowed=False, causality_type='temporal', temporality_required=True, causal_chain_step=1), - EvidenceRule(root_cause_id='SCHEMA_NULL_RATE_SPIKE', kind='supporting', evidence='downstream validation error 동반', example='bad record increase'), - EvidenceRule(root_cause_id='SCHEMA_NULL_RATE_SPIKE', kind='negative', evidence='전체 volume 급감만 존재', example='volume anomaly 후보 우선'), -) +def _flatten_evidence_profiles( + profiles: Iterable[EvidenceProfile], +) -> tuple[EvidenceRule, ...]: + return tuple( + rule + for profile in profiles + for rule_group in (profile.required, profile.supporting, profile.negative, profile.exclusion) + for rule in rule_group + ) + + +EVIDENCE_RULES: tuple[EvidenceRule, ...] = _flatten_evidence_profiles(EVIDENCE_PROFILES) EVIDENCE_PROFILE_INDEX: dict[str, EvidenceProfile] = { item.root_cause_id: item for item in EVIDENCE_PROFILES diff --git a/services/ai-service/app/catalogs/failure_types.py b/services/ai-service/app/catalogs/failure_types.py index 9447d296..ec810129 100644 --- a/services/ai-service/app/catalogs/failure_types.py +++ b/services/ai-service/app/catalogs/failure_types.py @@ -14,13 +14,13 @@ incident_type='SOURCE_AUTH_FAILURE', layer='source', description='source credential, 권한, token 문제', - signals=('auth denied', 'expired token', 'permission error'), + signals=('source auth error', 'read path authentication failure', 'expired token', 'permission error', 'expired secret'), ), FailureType( incident_type='SOURCE_READ_LATENCY', layer='source', description='source read 단계 지연', - signals=('extract duration 증가', 'source read latency 증가'), + signals=('extract duration 증가', 'source read latency 증가', 'read duration p95 상승', 'scan volume 증가'), ), FailureType( incident_type='SOURCE_DATA_NOT_AVAILABLE', @@ -32,13 +32,13 @@ incident_type='PIPELINE_TASK_FAILED', layer='pipeline', description='pipeline task 또는 job 실패', - signals=('task failed', 'retry exhausted'), + signals=('task failed', 'retry exhausted', 'retry budget exhausted', 'retry limit reached'), ), FailureType( incident_type='CONNECTOR_TASK_FAILED', layer='pipeline', description='Kafka Connect connector task 실패', - signals=('task FAILED', 'trace 포함'), + signals=('terminal task failure state', 'connector trace error'), ), FailureType( incident_type='CONNECTOR_WORKER_UNHEALTHY', @@ -98,7 +98,7 @@ incident_type='SINK_AUTH_FAILURE', layer='sink', description='sink credential 또는 권한 문제', - signals=('auth denied', 'permission error'), + signals=('sink auth error', 'write path permission denied', 'permission error', 'expired secret'), ), FailureType( incident_type='SINK_WRITE_LATENCY', @@ -134,7 +134,7 @@ incident_type='DEPLOYMENT_ROLLOUT_REGRESSION', layer='infra', description='배포 이후 상태 악화', - signals=('rollout event 이후 error 증가',), + signals=('rollout event 이후 error 증가', 'image rollout followed by error increase', 'deployment followed by failure'), ), FailureType( incident_type='PVC_PRESSURE', @@ -146,19 +146,19 @@ incident_type='CONFIG_CHANGE_REGRESSION', layer='change', description='설정 변경 이후 장애', - signals=('config diff와 시간 상관',), + signals=('config diff와 시간 상관', 'configuration change followed by error increase'), ), FailureType( incident_type='SCHEMA_CHANGE_REGRESSION', layer='change', description='schema 변경 이후 장애', - signals=('schema version 변경 후 error',), + signals=('schema version 변경 후 error', 'schema subject change followed by serialization error'), ), FailureType( incident_type='IMAGE_DEPLOYMENT_REGRESSION', layer='change', description='image 배포 이후 장애', - signals=('new image rollout 이후 failure',), + signals=('new image rollout 이후 failure', 'image rollout followed by runtime error increase', 'runtime image rollout followed by restart'), ), FailureType( incident_type='CREDENTIAL_ROTATION_FAILURE', @@ -182,7 +182,7 @@ incident_type='DUPLICATE_SPIKE', layer='data_quality', description='중복 증가', - signals=('duplicate count 증가',), + signals=('duplicate count 증가', 'record duplication increase', 'idempotency policy gap', 'replay/backfill window'), ), FailureType( incident_type='NULL_RATE_SPIKE', diff --git a/services/ai-service/app/catalogs/incident_rootcause_map.py b/services/ai-service/app/catalogs/incident_rootcause_map.py index 1464d911..c0bfb1ea 100644 --- a/services/ai-service/app/catalogs/incident_rootcause_map.py +++ b/services/ai-service/app/catalogs/incident_rootcause_map.py @@ -26,7 +26,17 @@ ), IncidentRootCauseMapEntry( incident_type='CONNECTOR_TASK_FAILED', - root_cause_ids=('CONNECTOR_TASK_FAILED', 'SCHEMA_MISMATCH', 'PIPELINE_CONFIG_INVALID', 'SOURCE_DB_CONNECTION_TIMEOUT', 'SINK_DB_CONNECTION_TIMEOUT', 'SOURCE_NETWORK_REACHABILITY'), + root_cause_ids=( + 'CONNECTOR_TASK_FAILED', + 'SCHEMA_MISMATCH', + 'PIPELINE_CONFIG_INVALID', + 'SOURCE_AUTH_EXPIRED', + 'SINK_AUTH_EXPIRED', + 'SINK_DB_CONNECTION_TIMEOUT', + 'SOURCE_DB_CONNECTION_TIMEOUT', + 'SOURCE_NETWORK_REACHABILITY', + 'SINK_CONSTRAINT_VIOLATION', + ), ), IncidentRootCauseMapEntry( incident_type='CONNECTOR_WORKER_UNHEALTHY', diff --git a/services/ai-service/app/catalogs/types.py b/services/ai-service/app/catalogs/types.py index fb78f8f1..d3e19ded 100644 --- a/services/ai-service/app/catalogs/types.py +++ b/services/ai-service/app/catalogs/types.py @@ -86,7 +86,7 @@ class RootCause: description: str owned_by: str direct_action_allowed: DirectActionPolicy - default_confidence_cap: float = 0.79 + default_confidence_cap: float = 0.88 notes: tuple[str, ...] = () diff --git a/services/ai-service/app/evidence/metadata.py b/services/ai-service/app/evidence/metadata.py index e69de29b..a1437e94 100644 --- a/services/ai-service/app/evidence/metadata.py +++ b/services/ai-service/app/evidence/metadata.py @@ -0,0 +1,47 @@ +"""Evidence metadata hygiene helpers shared by classifier and RCA paths.""" +from __future__ import annotations + +import re + +CONTROL_METADATA_KEYS = { + "accepted", + "accepted_root_cause_id", + "answer", + "answer_phrase", + "case_id", + "corrected_root_cause_id", + "expected", + "expected_root_cause", + "expected_root_cause_id", + "gold", + "label", + "oracle", + "prediction", + "predicted_root_cause_id", + "root_cause", + "root_cause_id", +} + +CONTROL_ID_RE = re.compile(r"^[A-Z0-9]+(?:_[A-Z0-9]+){1,}$") +CONTROL_METADATA_RE = re.compile( + r"\b(?:answer(?:_phrase)?|case[_ -]?id|expected(?:_root[_ -]?cause(?:_id)?)?|" + r"accepted[_ -]?root[_ -]?cause(?:[_ -]?id)?|corrected[_ -]?root[_ -]?cause(?:[_ -]?id)?|" + r"predicted[_ -]?root[_ -]?cause(?:[_ -]?id)?|gold|label|oracle|prediction|" + r"root[_ -]?cause(?:[_ -]?id)?)\b" + r"\s*(?:[:=]|is|는|은)?\s*[0-9A-Za-z_.-]+", + re.IGNORECASE, +) + + +def strip_control_metadata(value: str) -> str: + """Remove benchmark/gold/control labels before matching or prompting.""" + return CONTROL_METADATA_RE.sub(" ", value) + + +def is_control_metadata_key(key: str) -> bool: + normalized = key.strip().casefold() + return normalized in CONTROL_METADATA_KEYS or "root_cause" in normalized + + +def is_control_id(value: str) -> bool: + return bool(CONTROL_ID_RE.fullmatch(value.strip())) diff --git a/services/ai-service/app/evidence/signals.py b/services/ai-service/app/evidence/signals.py new file mode 100644 index 00000000..20d89356 --- /dev/null +++ b/services/ai-service/app/evidence/signals.py @@ -0,0 +1,514 @@ +"""Structured evidence signal extraction for RCA matching. + +The extractor emits catalog-level evidence phrases only. It intentionally +does not copy raw values, connector names, credentials, case identifiers, gold +labels, or normal-state summaries into the generated signal text. +""" +from __future__ import annotations + +import re +from collections.abc import Iterable +from typing import Any + +from app.evidence.metadata import is_control_id, is_control_metadata_key, strip_control_metadata + +_FAILED_RE = re.compile(r"\bFAILED\b|failed|failure|exception|\berror\b|오류|에러|실패", re.IGNORECASE) +_TASK_FAILURE_RE = re.compile(r"\bFAILED\b|failed|failure|exception|오류|에러|실패", re.IGNORECASE) +_TRACE_RE = re.compile(r"trace|stack|exception|worker log|stacktrace|로그|트레이스", re.IGNORECASE) +_AUTH_RE = re.compile( + r"access\s*denied|permission\s*denied|unauthori[sz]ed|authentication|" + r"\bauth\b|auth(?:entication)?\s*error|token\s*expired|credential\s*expired|" + r"password authentication failed|invalid password|invalid credential|" + r"credential invalid|credential expired|sasl|인증\s*실패|권한\s*거부|" + r"credential\s*만료|credential\s*미적용|토큰\s*만료", + re.IGNORECASE, +) +_SCHEMA_RE = re.compile( + r"schema|serialization|deserialization|incompatible|compatibility|converter|" + r"avro|serde|type mismatch|schema registry|스키마|역직렬화|호환성", + re.IGNORECASE, +) +_CONFIG_RE = re.compile( + r"invalid config|unknown config|config validation|configuration error|" + r"invalid option|required configuration|bad config|config diff|" + r"config\s*변경|설정\s*오류|설정\s*오타|잘못된\s*설정", + re.IGNORECASE, +) +_CONSTRAINT_RE = re.compile( + r"duplicate key|unique constraint|constraint violation|foreign key|not null|" + r"data integrity|sqlintegrity|record rejected|duplicate records?|" + r"중복\s*레코드|제약\s*위반|" + r"(?:record|row|sink|data)\s+validation fail", + re.IGNORECASE, +) +_TIMEOUT_RE = re.compile(r"timeout|timed out|read timed out|write timed out|타임아웃", re.IGNORECASE) +_NETWORK_RE = re.compile( + r"dns|unknownhost|no route|network unreachable|connection refused|" + r"connect exception|tcp connect|endpoint unreachable|host unreachable|i/o error|" + r"네트워크\s*단절|연결\s*실패|호스트.*포트", + re.IGNORECASE, +) +_LAG_RE = re.compile( + r"consumer lag|lag p95|offset progression|commit rate|total lag|" + r"lag_total|lag high|offset commit|lag\s*증가|lag\s*급증", + re.IGNORECASE, +) +_DEPLOYMENT_RE = re.compile( + r"rollout|deployment|deploy|image|이미지|배포|신규\s*connector", + re.IGNORECASE, +) +_DEGRADATION_RE = re.compile( + r"error|failure|failed|exception|latency|restart|crash|oom|unhealthy|" + r"할당\s*실패|재시작|에러|오류|실패|급증|증가|악화", + re.IGNORECASE, +) +_DIFF_RE = re.compile( + r"diff|tag|version|runtime|config|changed|change record|previous|" + r"이전|대비|차이|변경|버전|설정", + re.IGNORECASE, +) +_TEMPORAL_DEPLOYMENT_RE = re.compile( + r"after|since|following|followed|post[- ]?rollout|post[- ]?deploy|" + r"이후|직후|뒤이어|후", + re.IGNORECASE, +) +_RETRY_RE = re.compile( + r"retry|retries|max retries exceeded|max retry reached|retry exhausted|" + r"재시도|retry\s*소진|반복\s*실패", + re.IGNORECASE, +) +_IDEMPOTENCY_RE = re.compile( + r"exactly[- ]once|idempotency|offset reset|replay|backfill|중복\s*해소|" + r"멱등|offset\s*reset", + re.IGNORECASE, +) +_NORMAL_RE = re.compile( + r"no\s+(?:open\s+)?incidents?|all connectors running|tasks running|" + r"no error logs|normal|healthy|valid|running|정상|없음|유효", + re.IGNORECASE, +) +_CONNECTOR_FAILED_RE = re.compile( + r"(?:connector|커넥터|task|태스크)[^.;,\n]{0,80}" + r"(?:status|state|상태)?\s*[:=]?\s*(?:FAILED|failed|failure|error|실패|오류|에러)" + r"|(?:status|state|상태)\s*[:=]?\s*(?:FAILED|failed|failure|error|실패|오류|에러)" + r"[^.;,\n]{0,80}(?:connector|커넥터|task|태스크)", + re.IGNORECASE, +) +_CONNECTOR_STATE_FAILED_RE = re.compile( + r"\b(?:status|state)\s*[:=]?\s*(?:FAILED|failed|failure|error)\b" + r"|상태\s*[:=]?\s*(?:FAILED|실패|오류|에러)", + re.IGNORECASE, +) +_SCHEMA_VERSION_RE = re.compile(r"schema version|subject version|schema registry", re.IGNORECASE) +_SCHEMA_STRUCTURE_RE = re.compile(r"type mismatch|field type|필드 타입", re.IGNORECASE) +_CONFIG_CHANGE_RE = re.compile(r"config change|config diff|config 변경", re.IGNORECASE) +_DUPLICATE_COUNT_RE = re.compile(r"duplicate count|중복\s*레코드", re.IGNORECASE) +_READ_LATENCY_RE = re.compile( + r"read_latency|read latency|extract duration|extract 단계 p95|full scan", + re.IGNORECASE, +) +_WRITE_LATENCY_RE = re.compile(r"write_latency|write latency|write duration|write p95", re.IGNORECASE) +_LAG_SPIKE_RE = re.compile( + r"consumer lag|lag p95|total lag|lag_total|lag high|lag\s*증가|lag\s*급증", + re.IGNORECASE, +) +_OFFSET_PROGRESS_RE = re.compile(r"offset progression|commit rate|offset_progression", re.IGNORECASE) +_INGRESS_RE = re.compile(r"topic ingress|incoming messages|bytes-in", re.IGNORECASE) + +_NEGATED_SIGNAL_PATTERNS = { + "global": ( + re.compile(r"\bno\s+(?:open\s+)?incidents?\b", re.IGNORECASE), + re.compile(r"\bno\s+error\s+logs?\b", re.IGNORECASE), + re.compile(r"\ball\s+connectors\s+running\b|\btasks\s+running\b", re.IGNORECASE), + re.compile(r"\b(?:status|state)\s*[:=]?\s*(?:running|ok|healthy|normal|valid)\b", re.IGNORECASE), + re.compile(r"\b(?:status|state)\s*[:=]?\s*(?:RUNNING|정상|유효)\b|상태\s*[:=]?\s*(?:RUNNING|정상|유효)", re.IGNORECASE), + ), + "failure": ( + re.compile( + r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:failed|failure|error|exception|issue|problem)s?\b", + re.IGNORECASE, + ), + re.compile(r"(?:오류|에러|실패|예외|문제)\s*(?:없음|없다|아님|아닌|미확인)", re.IGNORECASE), + ), + "connector": ( + re.compile( + r"\b(?:connector|task)s?\s+(?:status|state)?\s*[:=]?\s*" + r"(?:running|ok|healthy|normal|valid)\b", + re.IGNORECASE, + ), + re.compile(r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}(?:failed|failure)\s+tasks?\b", re.IGNORECASE), + re.compile(r"\bno\s+(?:task\s+)?failures?\b", re.IGNORECASE), + re.compile(r"(?:connector|커넥터|task|태스크).{0,80}(?:RUNNING|정상|유효)", re.IGNORECASE), + re.compile(r"(?:task|태스크)?\s*(?:실패|오류|에러)\s*(?:없음|없다|아님|아닌)", re.IGNORECASE), + ), + "trace": ( + re.compile(r"\bno\s+(?:task\s+)?(?:trace|worker log)s?\b", re.IGNORECASE), + re.compile(r"\b(?:trace|worker log)s?\s+(?:not found|missing|unavailable)\b", re.IGNORECASE), + re.compile(r"(?:trace|worker log|트레이스|로그)\s*(?:없음|없다|미확인|누락)", re.IGNORECASE), + ), + "auth": ( + re.compile( + r"\b(?:no|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:auth|authentication|permission|credential|token|password|sasl)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:error|failure|issue|problem|expired|denied)s?\b", + re.IGNORECASE, + ), + re.compile( + r"\bnot\s+(?:an?\s+)?(?:auth|authentication|permission|credential|token|password|sasl)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:error|failure|issue|problem|expired|denied)s?\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:auth|authentication|permission|credential|token|password|sasl)" + r"(?:(?!\bbut\b|[.;,\n]).){0,32}(?:normal|valid|healthy|unchanged|ok)\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:auth|authentication|permission|credential|token|password|sasl)" + r".{0,80}(?:change|rotation|변경|문제)?\s*" + r"(?:없음|없다|아님|아닌|정상|유효|normal|valid|healthy|unchanged)\b", + re.IGNORECASE, + ), + re.compile(r"(?:인증|권한|토큰|credential).{0,80}(?:오류|실패|문제|만료)?\s*(?:없음|없다|아님|아닌|정상|유효)", re.IGNORECASE), + ), + "schema": ( + re.compile( + r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:schema|serialization|deserialization|compatibility|converter|avro|serde)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:error|failure|issue|problem|mismatch)s?\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:schema|serialization|deserialization|compatibility|converter|subject)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:normal|healthy|valid|compatible|unchanged|ok)\b", + re.IGNORECASE, + ), + re.compile(r"(?:스키마|역직렬화|직렬화|호환성).{0,80}(?:오류|에러|실패|문제|변경)?\s*(?:없음|없다|아님|아닌|정상|유효|호환)", re.IGNORECASE), + ), + "schema_change": ( + re.compile(r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}(?:schema|subject)\s+(?:change|diff|update)s?\b", re.IGNORECASE), + re.compile(r"\b(?:schema|subject|schema registry).{0,80}(?:unchanged|same|stable|valid|healthy)\b", re.IGNORECASE), + re.compile(r"(?:스키마|subject).{0,80}(?:변경|차이|업데이트)?\s*(?:없음|없다|아님|아닌|정상|유효)", re.IGNORECASE), + ), + "config": ( + re.compile( + r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:config|configuration|option|setting)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:error|failure|issue|problem|validation|diff|change)s?\b", + re.IGNORECASE, + ), + re.compile( + r"\b(?:config|configuration|option|setting)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:normal|healthy|valid|unchanged|same|ok|snapshot)\b", + re.IGNORECASE, + ), + re.compile(r"(?:config|configuration|설정).{0,80}(?:오류|에러|실패|문제|변경|차이|오타)?\s*(?:없음|없다|아님|아닌|정상|유효)", re.IGNORECASE), + ), + "config_change": ( + re.compile(r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}(?:config|configuration)\s+(?:change|diff|update)s?\b", re.IGNORECASE), + re.compile(r"\b(?:config|configuration).{0,80}(?:unchanged|same|stable|snapshot)\b", re.IGNORECASE), + re.compile(r"(?:config|configuration|설정).{0,80}(?:변경|차이|diff)?\s*(?:없음|없다|아님|아닌|정상|유효)", re.IGNORECASE), + ), + "duplicate": ( + re.compile( + r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:duplicate|constraint|unique|foreign key|not null|data integrity)" + r"(?:(?!\bbut\b|[.;,\n]).){0,80}(?:error|failure|issue|problem|violation|records?|keys?)s?\b", + re.IGNORECASE, + ), + re.compile(r"\bduplicate\s+count\s*[:=]?\s*0\b", re.IGNORECASE), + re.compile(r"\b(?:duplicate|constraint).{0,80}(?:normal|healthy|valid|unchanged|zero)\b", re.IGNORECASE), + re.compile(r"(?:중복|제약).{0,80}(?:레코드|키|위반|오류|에러|문제)?\s*(?:없음|없다|아님|아닌|정상|해소)", re.IGNORECASE), + ), + "lag": ( + re.compile( + r"\b(?:consumer\s+)?lag(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:normal|healthy|stable|within\s+threshold|below\s+threshold|ok)\b", + re.IGNORECASE, + ), + re.compile(r"\b(?:offset progression|commit rate).{0,80}(?:normal|healthy|stable|ok)\b", re.IGNORECASE), + re.compile(r"\bno\s+(?:consumer\s+)?lag\s+(?:spike|increase|surge|issue|problem)\b", re.IGNORECASE), + re.compile(r"(?:consumer\s*)?lag.{0,80}(?:정상|안정|임계.*이내|증가\s*없음|급증\s*없음)", re.IGNORECASE), + re.compile(r"(?:offset progression|commit rate).{0,80}(?:정상|안정|둔화\s*없음|감소\s*없음)", re.IGNORECASE), + ), + "timeout": ( + re.compile(r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}(?:timeout|timed out)\b", re.IGNORECASE), + re.compile(r"(?:timeout|타임아웃).{0,80}(?:없음|없다|아님|아닌|정상)", re.IGNORECASE), + ), + "network": ( + re.compile( + r"\b(?:no|not|without)\s+(?:(?!\bbut\b|[.;,\n]).){0,80}" + r"(?:network|reachability|connection|endpoint|dns)\s+(?:error|failure|issue|problem)\b", + re.IGNORECASE, + ), + re.compile(r"\b(?:endpoint|connection|network|dns).{0,80}(?:reachable|healthy|normal|ok|available)\b", re.IGNORECASE), + re.compile(r"(?:연결|네트워크|endpoint|호스트).{0,80}(?:정상|성공|가능|문제\s*없음)", re.IGNORECASE), + ), + "deployment": ( + re.compile(r"\b(?:deployment|rollout|deploy|image).{0,80}(?:healthy|normal|successful|completed|ok)\b", re.IGNORECASE), + re.compile(r"(?:배포|이미지).{0,80}(?:정상|성공|완료|문제\s*없음)", re.IGNORECASE), + ), + "retry": ( + re.compile(r"\bno\s+(?:(?!\bbut\b|[.;,\n]).){0,80}(?:retry|retries).{0,80}(?:exhausted|failure|issue|problem)\b", re.IGNORECASE), + re.compile(r"\b(?:retry|retries).{0,80}(?:normal|healthy|available|remaining|ok)\b", re.IGNORECASE), + re.compile(r"(?:retry|재시도).{0,80}(?:소진|실패|문제)?\s*(?:없음|없다|아님|아닌|정상|잔여)", re.IGNORECASE), + ), + "idempotency": ( + re.compile(r"\b(?:idempotency|replay|backfill|duplicate).{0,80}(?:normal|healthy|gap\s*closed|ok)\b", re.IGNORECASE), + re.compile(r"(?:멱등|중복|replay|backfill).{0,80}(?:정상|해소|gap\s*없음|문제\s*없음)", re.IGNORECASE), + ), + "latency": ( + re.compile(r"\b(?:read|write|extract|sink|source)?\s*latency.{0,80}(?:normal|healthy|stable|within\s+threshold|ok)\b", re.IGNORECASE), + re.compile(r"(?:read|write|extract|sink|source|읽기|쓰기)?\s*latency.{0,80}(?:정상|안정|임계.*이내)", re.IGNORECASE), + ), + "ingress": ( + re.compile(r"\b(?:topic ingress|incoming messages|bytes-in).{0,80}(?:normal|healthy|stable|within\s+threshold|ok)\b", re.IGNORECASE), + re.compile(r"(?:topic ingress|incoming messages|bytes-in|유입).{0,80}(?:정상|안정|임계.*이내)", re.IGNORECASE), + ), +} + +_SOURCE_HINT_RE = re.compile(r"\bsource\b|extract|read stage|source_reader|source connector|소스", re.IGNORECASE) +_SINK_HINT_RE = re.compile(r"\bsink\b|write stage|sink_writer|sink connector|flush|batch|jdbc sink", re.IGNORECASE) +def evidence_signal_summary(tool_name: str, raw_payload: Any) -> str: + """Return semicolon-separated general RCA evidence signals.""" + pieces = [strip_control_metadata(item) for item in _flatten_text(raw_payload)] + text = " ".join(pieces) + if not text: + return "" + + tags: list[str] = [] + lower = text.casefold() + side = _side_hint(lower, tool_name) + auth_side = _auth_side_hint(pieces, tool_name) + + failed = _has_signal(pieces, _TASK_FAILURE_RE, "failure") + connector_failed = _has_signal(pieces, _CONNECTOR_FAILED_RE, "connector") or ( + "connector" in lower and _has_signal(pieces, _CONNECTOR_STATE_FAILED_RE, "connector") + ) + trace = _has_signal(pieces, _TRACE_RE, "trace") + auth = _has_signal(pieces, _AUTH_RE, "auth") + schema = _has_signal(pieces, _SCHEMA_RE, "schema") + config = _has_signal(pieces, _CONFIG_RE, "config") + constraint = _has_signal(pieces, _CONSTRAINT_RE, "duplicate") + timeout = _has_signal(pieces, _TIMEOUT_RE, "timeout") + network = _has_signal(pieces, _NETWORK_RE, "network") + lag_spike = _has_signal(pieces, _LAG_SPIKE_RE, "lag") + offset_slow = _has_signal(pieces, _OFFSET_PROGRESS_RE, "lag") + deployment = _has_signal(pieces, _DEPLOYMENT_RE, "deployment") + degradation = _has_signal(pieces, _DEGRADATION_RE, "failure") + retry = _has_signal(pieces, _RETRY_RE, "retry") + idempotency = _has_signal(pieces, _IDEMPOTENCY_RE, "idempotency") + + if connector_failed: + _add(tags, "connector task status FAILED") + if trace and failed: + _add(tags, "task trace 또는 worker log") + + if auth: + if auth_side == "source": + _add(tags, "source auth/permission error log") + elif auth_side == "sink": + _add(tags, "sink auth/permission error log") + else: + _add(tags, "auth/permission error log") + + if schema: + _add(tags, "serialization/deserialization/schema error") + if _has_signal(pieces, _SCHEMA_VERSION_RE, "schema_change"): + _add(tags, "schema version 변경 이력") + if _has_signal(pieces, _SCHEMA_STRUCTURE_RE, "schema"): + _add(tags, "데이터 샘플 구조 변화") + + if config: + _add(tags, "config validation error 또는 invalid option log") + if _has_signal(pieces, _CONFIG_CHANGE_RE, "config_change"): + _add(tags, "최근 pipeline/connector config 변경") + + if ( + deployment + and degradation + and _TEMPORAL_DEPLOYMENT_RE.search(text) + and not _is_normal_only(text) + ): + _add(tags, "image rollout 이후 error/latency/restart 증가") + if deployment and _DIFF_RE.search(text) and not _is_normal_only(text): + _add(tags, "image version update") + + if constraint: + _add(tags, "sink constraint 또는 duplicate key error") + _add(tags, "동일 record 반복 실패") + if _has_signal(pieces, _DUPLICATE_COUNT_RE, "duplicate"): + _add(tags, "duplicate count 또는 duplicate key error 증가") + if idempotency: + _add(tags, "retry/replay/backfill 또는 idempotency gap") + + if network: + if side == "source": + _add(tags, "Bifrost에서 source endpoint reachability 실패") + elif side == "sink": + _add(tags, "sink dependency 연결 실패 또는 connection timeout") + else: + _add(tags, "Bifrost에서 source endpoint reachability 실패") + + if timeout: + if side == "source": + _add(tags, "source connection timeout 증가") + _add(tags, "pipeline extract/read 단계 timeout log") + elif side == "sink": + _add(tags, "sink write timeout 증가") + _add(tags, "sink dependency 연결 실패 또는 connection timeout") + else: + _add(tags, "pipeline extract/read 단계 timeout log") + + if _has_signal(pieces, _READ_LATENCY_RE, "latency"): + _add(tags, "source read latency 증가") + _add(tags, "extract task duration 증가") + if _has_signal(pieces, _WRITE_LATENCY_RE, "latency"): + _add(tags, "sink write latency 증가") + if "source_healthy" in lower or "source 정상" in lower or "upstream normal" in lower: + _add(tags, "source read 정상") + if "sink_healthy" in lower or "sink 정상" in lower: + _add(tags, "sink write 단계 정상") + if "credential_rotation" in lower or "secret rotation" in lower or "rotate" in lower or "credential rotation" in lower: + _add(tags, "credential rotation 또는 secret 변경 이력") + + if lag_spike: + _add(tags, "consumer lag 급증") + if offset_slow: + _add(tags, "offset progression 둔화") + if _has_signal(pieces, _INGRESS_RE, "ingress"): + _add(tags, "topic ingress rate 급증") + + if retry: + _add(tags, "retry count exhausted") + if failed or "repeat" in lower or "반복" in lower: + _add(tags, "동일 task 반복 실패") + + return "; ".join(tags) + + +def _flatten_text(value: Any, context: str = "") -> Iterable[str]: + if value is None: + return + if isinstance(value, str): + stripped = value.strip() + if stripped and not is_control_id(stripped): + yield f"{context} {stripped}".strip() + return + if isinstance(value, (bool, int, float)): + yield f"{context} {value}".strip() + return + if isinstance(value, dict): + for key, item in value.items(): + key_text = str(key) + if is_control_metadata_key(key_text): + continue + yield key_text + next_context = f"{context} {key_text}".strip() + yield from _flatten_text(item, next_context) + return + if isinstance(value, (list, tuple, set)): + for item in value: + yield from _flatten_text(item, context) + + +def _side_hint(text: str, tool_name: str) -> str: + has_source = bool(_SOURCE_HINT_RE.search(text)) + has_sink = bool(_SINK_HINT_RE.search(text)) + if has_source and not has_sink: + return "source" + if has_sink and not has_source: + return "sink" + if tool_name in {"get_consumer_lag", "get_consumer_groups"}: + return "sink" + return "unknown" + + +def _auth_side_hint(pieces: list[str], tool_name: str) -> str: + sides: set[str] = set() + for piece in pieces: + observed = _without_normal_fragments(piece, "auth", "failure") + if not _AUTH_RE.search(observed) or _is_normal_only(observed): + continue + for match in _AUTH_RE.finditer(observed): + side = _nearest_side_for_match(observed, match.start(), tool_name) + if side in {"source", "sink"}: + sides.add(side) + if len(sides) == 1: + return next(iter(sides)) + return "unknown" + + +def _nearest_side_for_match(piece: str, index: int, tool_name: str) -> str: + candidates: list[tuple[int, str]] = [] + for match in _SOURCE_HINT_RE.finditer(piece): + candidates.append((abs(match.start() - index), "source")) + for match in _SINK_HINT_RE.finditer(piece): + candidates.append((abs(match.start() - index), "sink")) + if not candidates: + return "sink" if tool_name in {"get_consumer_lag", "get_consumer_groups"} else "unknown" + candidates.sort(key=lambda item: item[0]) + nearest_distance, nearest_side = candidates[0] + tied_sides = {side for distance, side in candidates if distance == nearest_distance} + return nearest_side if len(tied_sides) == 1 else "unknown" + + +def _is_normal_only(text: str) -> bool: + fault_text = _without_normal_fragments(text, *_NEGATED_SIGNAL_PATTERNS.keys()) + fault_observed = bool( + _FAILED_RE.search(fault_text) + or _SCHEMA_RE.search(fault_text) + or _CONFIG_RE.search(fault_text) + or _CONSTRAINT_RE.search(fault_text) + or _TIMEOUT_RE.search(fault_text) + or _NETWORK_RE.search(fault_text) + or _LAG_RE.search(fault_text) + or _DEGRADATION_RE.search(fault_text) + ) + return _has_normal_fragment(text) and not fault_observed + + +def _has_auth_negation(text: str) -> bool: + return _has_fault_negation(text, "auth") + + +def _has_signal(pieces: list[str], pattern: re.Pattern[str], fault: str) -> bool: + for piece in pieces: + observed = _without_normal_fragments(piece, "failure", fault) + if pattern.search(observed): + return True + return False + + +def _without_normal_fragments(text: str, *faults: str) -> str: + cleaned = text + seen: set[str] = set() + ordered_faults = [fault for fault in faults if fault not in {"global", "failure"}] + ordered_faults.append("global") + if "failure" in faults: + ordered_faults.append("failure") + for fault in ordered_faults: + if fault in seen: + continue + seen.add(fault) + for pattern in _NEGATED_SIGNAL_PATTERNS.get(fault, ()): + cleaned = pattern.sub(" ", cleaned) + return cleaned + + +def _has_normal_fragment(text: str) -> bool: + return bool(_NORMAL_RE.search(text)) or any( + pattern.search(text) + for patterns in _NEGATED_SIGNAL_PATTERNS.values() + for pattern in patterns + ) + + +def _has_fault_negation(text: str, fault: str) -> bool: + return any(pattern.search(text) for pattern in _NEGATED_SIGNAL_PATTERNS.get(fault, ())) + + +def _add(tags: list[str], tag: str) -> None: + if tag not in tags: + tags.append(tag) diff --git a/services/ai-service/app/workflow/runner.py b/services/ai-service/app/workflow/runner.py index b3ec2b29..41fff657 100644 --- a/services/ai-service/app/workflow/runner.py +++ b/services/ai-service/app/workflow/runner.py @@ -173,6 +173,29 @@ def _action_execution_answer(executor_out, verifier_out) -> str: return "\n".join(lines) +def _approval_wait_answer(rca_out, remediation_out, approval_out) -> str: + lines = ["승인 대기 중입니다."] + candidates = getattr(rca_out, "root_cause_candidates", []) or [] + if candidates: + top = candidates[0] + lines.append(f"원인 후보: {top.root_cause_id} (confidence: {top.confidence:.0%})") + + pending_ids = { + request.action_id + for request in (getattr(approval_out, "approval_requests", []) or []) + } + action_candidates = getattr(remediation_out, "action_candidates", []) or [] + pending_actions = [ + candidate + for candidate in action_candidates + if not pending_ids or candidate.action_id in pending_ids + ] + if pending_actions: + names = ", ".join(candidate.action_name for candidate in pending_actions) + lines.append(f"승인 필요 조치: {names}") + return "\n".join(lines) + + async def _run_auto_rollback( executor_out, candidates, @@ -953,9 +976,11 @@ async def _run_workflow_impl( tool_context=planner_context, ) # (#692) ReAct 루프가 있으면 커넥터 이름을 list_connectors/topology 체이닝으로 - # 알아낼 수 있으므로, '이름을 알려달라'며 단축하지 않고 retrieval(루프)로 넘긴다. - # 루프 불가(LLM 미연결)일 때만 clarification 으로 종료한다. - if planner_out.clarification_message and not get_llm_provider().supports_tools(): + # 알아낼 수 있으므로, 식별자 탐색 plan 이 있을 때만 retrieval 로 넘긴다. + # plan 이 비어 있는 명시적 clarification 은 뒤 단계로 흘리지 않고 여기서 종료한다. + if planner_out.clarification_message and ( + not planner_out.retrieval_plan or not get_llm_provider().supports_tools() + ): answer = planner_out.clarification_message retrieval_out = RetrievalOutput( evidence_items=[ @@ -1312,13 +1337,7 @@ async def _run_workflow_impl( # #922: 승인 대기 중에도 인시던트 상세에 RCA·권장조치(action_candidates)가 # 표시되도록 이 시점의 report snapshot 을 남긴다. run 은 승인 전까지 report # 단계에 도달하지 못하므로(여기서 return), 권장조치가 비어 보이던 문제를 해소한다. - try: - pause_answer = await report_agent.run_report( - user_message, retrieval_out, mode, get_llm_provider(), - rca_out=rca_out, classifier_out=classifier_out, - ) - except Exception: - pause_answer = "" + pause_answer = _approval_wait_answer(rca_out, remediation_out, approval_out) await _persist_report_snapshot( run_id=run_id, answer=pause_answer, diff --git a/services/ai-service/scripts/rca_eval_campaign.py b/services/ai-service/scripts/rca_eval_campaign.py index ff34b9e8..0492f067 100644 --- a/services/ai-service/scripts/rca_eval_campaign.py +++ b/services/ai-service/scripts/rca_eval_campaign.py @@ -4,6 +4,10 @@ 만으로 배포된 RCA 로직(run_rca)에 통과시켜 AC@1/AC@3/AC@5/Avg@5/ECE/기권율을 산출한다. human_verdict(사후 결론)는 증거에서 제외해 정답 누출을 막는다. +주의: 이 캠페인은 accepted root cause에서 incident type을 역매핑해 classifier output을 +구성하는 oracle incident-type RCA replay다. classifier 포함 end-to-end 정확도나 +unseen production holdout이 아니다. + 실행(floor, 재현): cd services/ai-service && .venv/bin/python scripts/rca_eval_campaign.py 실행(LLM-on, 라이브 정확도): RCA_EVAL_USE_LLM=1 python scripts/rca_eval_campaign.py └ 실 LLM/임베딩 구성이 있는 곳(배포 pod/Job)에서만 의미. 비파괴(read-only RCA 평가). @@ -128,6 +132,11 @@ async def main() -> None: report = build_eval_report(cases, layer_map) abstain = sum(1 for c in cases if not c.predicted_ranking or c.predicted_ranking[0] == UNKNOWN_ROOT_CAUSE_ID) out = { + "evaluation_condition": ( + "35 seed oracle incident-type RCA replay; evidence uses symptom, trigger, " + "contributing_factors only; human_verdict excluded; not classifier end-to-end; " + "not unseen production holdout" + ), "total_cases": report.total_cases, "AC@1": round(report.ac_at_1.accuracy, 4), "AC@3": round(report.ac_at_3.accuracy, 4), diff --git a/services/ai-service/tests/test_classifier.py b/services/ai-service/tests/test_classifier.py index 5254544f..c77ebdb6 100644 --- a/services/ai-service/tests/test_classifier.py +++ b/services/ai-service/tests/test_classifier.py @@ -18,6 +18,16 @@ async def generate(self, messages: list[dict], model: str | None = None) -> str: return self.response +class _CapturingLLMProvider(_DummyLLMProvider): + def __init__(self, response: str = "") -> None: + super().__init__(response) + self.messages: list[dict] = [] + + async def generate(self, messages: list[dict], model: str | None = None) -> str: + self.messages = messages + return self.response + + def _patch_llm(monkeypatch: pytest.MonkeyPatch, response: str = "") -> None: monkeypatch.setattr("app.llm.provider.get_llm_provider", lambda: _DummyLLMProvider(response)) @@ -107,6 +117,43 @@ async def test_unknown_when_no_signal(monkeypatch: pytest.MonkeyPatch) -> None: assert top.confidence < 0.6 +@pytest.mark.asyncio +async def test_control_metadata_does_not_drive_rule_classification( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + retrieval = _retrieval_with_summary( + "expected_root_cause=SINK_AUTH_EXPIRED normal observation only", + "ev-label", + ) + + result = await run_classifier("상태 확인", retrieval) + + assert [item.type for item in result.classification.incident_types] == [ + "UNKNOWN_NEEDS_MORE_EVIDENCE" + ] + + +@pytest.mark.asyncio +async def test_control_metadata_is_removed_from_classifier_llm_prompt( + monkeypatch: pytest.MonkeyPatch, +) -> None: + provider = _CapturingLLMProvider("") + monkeypatch.setattr("app.llm.provider.get_llm_provider", lambda: provider) + retrieval = _retrieval_with_summary( + "accepted_root_cause_id=SINK_AUTH_EXPIRED normal observation only", + "ev-label", + ) + + await run_classifier("expected_root_cause=SOURCE_AUTH_EXPIRED 상태 확인", retrieval) + + prompt = provider.messages[1]["content"] + assert "expected_root_cause" not in prompt + assert "accepted_root_cause_id" not in prompt + assert "SOURCE_AUTH_EXPIRED" not in prompt + assert "SINK_AUTH_EXPIRED" not in prompt + + @pytest.mark.asyncio async def test_catalog_only_ids(monkeypatch: pytest.MonkeyPatch) -> None: _patch_llm( diff --git a/services/ai-service/tests/test_evidence_signals.py b/services/ai-service/tests/test_evidence_signals.py new file mode 100644 index 00000000..f7ff6ec4 --- /dev/null +++ b/services/ai-service/tests/test_evidence_signals.py @@ -0,0 +1,169 @@ +from __future__ import annotations + +import pytest + +from app.catalogs.root_causes import root_cause_ids +from app.evidence.signals import evidence_signal_summary + + +def test_signal_summary_extracts_catalog_signals_without_raw_secrets() -> None: + payload = { + "operation": "get_connector_task_trace", + "result": { + "connector": "orders-sink", + "traces": [ + { + "taskId": 0, + "state": "FAILED", + "trace": "sink authentication failed: token expired for password=secret", + } + ], + }, + } + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert "connector task status FAILED" in summary + assert "task trace 또는 worker log" in summary + assert "sink auth/permission error log" in summary + assert "secret" not in summary + assert "orders-sink" not in summary + + +def test_signal_summary_ignores_control_metadata_labels() -> None: + payload = { + "case_id": "C001", + "expected_root_cause": "SINK_AUTH_EXPIRED", + "result": {"message": "no auth error; connector status RUNNING"}, + } + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert "SINK_AUTH_EXPIRED" not in summary + assert "auth/permission error log" not in summary + + +def test_signal_summary_strips_control_metadata_inside_strings() -> None: + payload = { + "message": ( + "accepted_root_cause_id=SINK_AUTH_EXPIRED " + "corrected_root_cause_id=SOURCE_AUTH_EXPIRED connector status RUNNING" + ) + } + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert summary == "" + + +def test_signal_summary_keeps_fault_when_normal_status_is_mixed() -> None: + payload = { + "sink": {"status": "normal"}, + "logs": ["deserialization error: incompatible schema"], + } + + summary = evidence_signal_summary("search_logs", payload) + + assert "serialization/deserialization/schema error" in summary + + +def test_signal_summary_scopes_auth_to_fault_fragment_not_benign_source_status() -> None: + payload = { + "source": {"status": "normal"}, + "sink": {"trace": "authentication failed token expired"}, + } + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert "sink auth/permission error log" in summary + assert "source auth/permission error log" not in summary + + +def test_signal_summary_uses_nearest_auth_scope_in_single_text() -> None: + payload = {"message": "source status normal; sink authentication failed token expired"} + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert "sink auth/permission error log" in summary + assert "source auth/permission error log" not in summary + + +def test_signal_summary_keeps_auth_fault_when_normal_auth_status_is_mixed() -> None: + payload = {"message": "source auth status normal. sink authentication failed token expired"} + + summary = evidence_signal_summary("get_connector_task_trace", payload) + + assert "sink auth/permission error log" in summary + assert "source auth/permission error log" not in summary + + +def test_signal_summary_does_not_synthesize_deployment_regression_from_single_observation() -> None: + payload = {"deployment": {"image": "orders-worker:v2", "status": "rolled out"}} + + summary = evidence_signal_summary("get_deployments", payload) + + assert "image rollout 이후 error/latency/restart 증가" not in summary + assert "image version update" not in summary + + +def test_signal_summary_requires_temporal_deployment_degradation() -> None: + payload = {"message": "new image failure"} + + summary = evidence_signal_summary("get_deployments", payload) + + assert "image rollout 이후 error/latency/restart 증가" not in summary + + +def test_signal_summary_requires_structured_image_change_for_version_signal() -> None: + payload = {"deployment": {"image": "orders-worker", "status": "image pull error"}} + + summary = evidence_signal_summary("get_deployments", payload) + + assert "image version update" not in summary + + +def test_signal_summary_does_not_synthesize_no_fault_from_single_normal_observation() -> None: + payload = { + "openIncidents": 0, + "connectors": [{"name": "orders", "state": "RUNNING"}], + "summary": "no open incidents; all connectors running; no error logs", + } + + summary = evidence_signal_summary("analyze_event_log", payload) + + assert summary == "" + assert "NO_FAULT" not in root_cause_ids() + + +@pytest.mark.parametrize( + "message", + [ + "스키마 오류 없음 connector status RUNNING", + "schema registry subject unchanged; schema valid; no schema error", + "설정 오류 없음", + "config valid; no config error", + "중복 레코드 없음", + "duplicate count 0; no duplicate records", + "lag 정상", + "consumer lag within threshold; offset progression normal", + "connector status RUNNING; no failed task", + "healthy valid no error", + ], +) +def test_signal_summary_does_not_emit_fault_signals_for_normal_negative_observations( + message: str, +) -> None: + summary = evidence_signal_summary("get_connector_task_trace", {"message": message}) + + assert summary == "" + + +def test_signal_summary_keeps_fault_when_negative_and_fault_fragments_are_distinct() -> None: + payload = { + "status": "스키마 오류 없음", + "logs": ["deserialization error: incompatible schema"], + } + + summary = evidence_signal_summary("search_logs", payload) + + assert "serialization/deserialization/schema error" in summary diff --git a/services/ai-service/tests/test_hitl_wiring.py b/services/ai-service/tests/test_hitl_wiring.py index 53331b72..18500f30 100644 --- a/services/ai-service/tests/test_hitl_wiring.py +++ b/services/ai-service/tests/test_hitl_wiring.py @@ -19,6 +19,7 @@ ExecutorOutput, PolicyDecisionOutput, PolicyGuardOutput, + RcaOutput, RemediationOutput, RouteDecision, RouterOutput, @@ -31,13 +32,19 @@ AgentMode, PolicyDecisionType, RiskLevel, + RootCauseCandidate, VerificationStatus, ) from app.streaming.event_bus import EventBus from app.supervisor.graph import Supervisor from app.supervisor.retry_policy import RetryPolicy from app.supervisor.state_store import InMemoryStateStore -from app.workflow.runner import _coerce_requested_action_candidate, _ready_action_candidate, run_workflow +from app.workflow.runner import ( + _approval_wait_answer, + _coerce_requested_action_candidate, + _ready_action_candidate, + run_workflow, +) class _FakeToolDefinition: @@ -220,6 +227,37 @@ def test_requested_action_candidate_allows_consumer_group_restart(): assert candidate.risk == RiskLevel.HIGH +def test_approval_wait_answer_preserves_rca_and_action_context(): + rca = RcaOutput(root_cause_candidates=[ + RootCauseCandidate( + root_cause_id="CONNECTOR_TASK_FAILED", + confidence=0.82, + required_evidence_satisfied=True, + evidence_gap=[], + explanation="connector task failed", + ) + ]) + remediation = RemediationOutput(action_candidates=[ + ActionCandidateOutput( + action_id="act_restart", + action_type=ActionType.RUNTIME_TOOL, + action_name="restart_connector", + risk=RiskLevel.HIGH, + reason="runbook", + expected_effect="restart connector", + tool_name="restart_connector", + tool_params={"connector_name": "orders"}, + ) + ]) + approval = MagicMock() + approval.approval_requests = [MagicMock(action_id="act_restart")] + + answer = _approval_wait_answer(rca, remediation, approval) + + assert "CONNECTOR_TASK_FAILED" in answer + assert "restart_connector" in answer + + def test_requested_action_candidate_escalates_medium_tool_to_human_approval(): registry = MagicMock() registry.get_definition.return_value = _FakeToolDefinition( diff --git a/services/ai-service/tests/test_rca.py b/services/ai-service/tests/test_rca.py index c400549c..ccea7ffa 100644 --- a/services/ai-service/tests/test_rca.py +++ b/services/ai-service/tests/test_rca.py @@ -6,7 +6,7 @@ import pytest from app.agents.rca import run_rca -from app.catalogs.evidence_matrix import get_evidence_profile +from app.catalogs.evidence_matrix import EVIDENCE_RULES, get_evidence_profile, list_evidence_profiles from app.catalogs.root_causes import root_cause_ids from app.core.config import Settings, settings from app.schemas.outputs import Classification, ClassifierOutput, IncidentTypeOutput, RcaOutput, RetrievalOutput @@ -16,8 +16,10 @@ class _DummyLLMProvider: def __init__(self, response: str = "") -> None: self.response = response + self.messages: list[dict] = [] async def generate(self, messages: list[dict], model: str | None = None) -> str: + self.messages = messages return self.response @@ -365,6 +367,169 @@ async def test_normal_auth_evidence_does_not_commit_auth_expired( assert top.confidence < 0.60 +@pytest.mark.asyncio +async def test_normal_source_auth_status_does_not_suppress_sink_auth_fault( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("SINK_AUTH_FAILURE"), + _retrieval("source auth status normal. sink authentication failed token expired"), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "SINK_AUTH_EXPIRED" + assert top.required_evidence_satisfied is True + assert top.confidence >= 0.60 + + +@pytest.mark.parametrize( + "summary", + [ + "source 인증 오류 없음", + "source 인증 실패 없음", + "source 권한 문제 없음", + "source 토큰 정상", + "인증 실패 없음", + "권한 문제 없음", + "토큰 정상", + ], +) +@pytest.mark.asyncio +async def test_korean_auth_negation_does_not_commit_auth_expired( + monkeypatch: pytest.MonkeyPatch, + summary: str, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("SOURCE_AUTH_FAILURE"), + _retrieval(summary), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "UNKNOWN_WITH_EVIDENCE_GAP" + assert top.confidence < 0.60 + + +@pytest.mark.asyncio +async def test_normal_metadata_schema_does_not_commit_schema_mismatch( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("SCHEMA_MISMATCH"), + _retrieval( + "metadata schema status normal. schema registry subject unchanged. " + "no schema error or serialization failure. connector status RUNNING." + ), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "UNKNOWN_WITH_EVIDENCE_GAP" + assert top.confidence < 0.60 + + +@pytest.mark.parametrize( + ("incident_type", "summary"), + [ + ("SCHEMA_MISMATCH", "스키마 오류 없음 connector status RUNNING"), + ("PIPELINE_TASK_FAILED", "설정 오류 없음"), + ("DUPLICATE_SPIKE", "중복 레코드 없음"), + ("CONSUMER_LAG_SPIKE", "lag 정상"), + ("CONSUMER_LAG_SPIKE", "consumer lag 정상"), + ("CONNECTOR_TASK_FAILED", "connector status RUNNING; no failed task"), + ], +) +@pytest.mark.asyncio +async def test_normal_negative_evidence_does_not_commit_matching_fault( + monkeypatch: pytest.MonkeyPatch, + incident_type: str, + summary: str, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier(incident_type), + _retrieval(summary), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "UNKNOWN_WITH_EVIDENCE_GAP" + assert top.confidence < 0.60 + + +@pytest.mark.asyncio +async def test_control_metadata_does_not_select_root_cause( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("CONNECTOR_TASK_FAILED"), + _retrieval( + "case_id=C3_SOURCE_DB_CONNECTION_TIMEOUT_07 " + "expected_root_cause=SINK_AUTH_EXPIRED unrelated connector observation" + ), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "UNKNOWN_WITH_EVIDENCE_GAP" + assert top.confidence < 0.60 + + +@pytest.mark.asyncio +async def test_accepted_root_cause_metadata_does_not_select_root_cause( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("CONNECTOR_TASK_FAILED"), + _retrieval( + "accepted_root_cause_id=SINK_AUTH_EXPIRED " + "corrected_root_cause_id=SOURCE_AUTH_EXPIRED connector status RUNNING" + ), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "UNKNOWN_WITH_EVIDENCE_GAP" + assert top.confidence < 0.60 + + +@pytest.mark.asyncio +async def test_connector_task_unscoped_auth_does_not_default_to_source_auth( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("CONNECTOR_TASK_FAILED"), + _retrieval( + "connector task status FAILED", + "task trace worker log: authentication failed token expired", + ), + ) + + top = result.root_cause_candidates[0] + assert top.root_cause_id == "CONNECTOR_TASK_FAILED" + + +@pytest.mark.asyncio +async def test_connector_task_sink_auth_context_does_not_select_source_auth( + monkeypatch: pytest.MonkeyPatch, +) -> None: + _patch_llm(monkeypatch) + result = await run_rca( + _classifier("CONNECTOR_TASK_FAILED"), + _retrieval( + "source status normal", + "sink authentication failed token expired", + "connector task status FAILED", + "task trace worker log exception", + ), + ) + + ordered = [candidate.root_cause_id for candidate in result.root_cause_candidates] + assert ordered[0] != "SOURCE_AUTH_EXPIRED" + assert ordered.index("SINK_AUTH_EXPIRED") < ordered.index("SOURCE_AUTH_EXPIRED") + + @pytest.mark.asyncio async def test_knowledge_evidence_does_not_satisfy_required_rules( monkeypatch: pytest.MonkeyPatch, @@ -623,6 +788,17 @@ def test_structured_required_rules_opt_out_of_semantic_matching() -> None: assert rule.semantic_allowed is False +def test_evidence_rules_are_derived_from_profiles() -> None: + flattened = tuple( + rule + for profile in list_evidence_profiles() + for rules in (profile.required, profile.supporting, profile.negative, profile.exclusion) + for rule in rules + ) + + assert EVIDENCE_RULES == flattened + + @pytest.mark.asyncio async def test_structured_semantic_opt_out_blocks_embedding_only_required_match( monkeypatch: pytest.MonkeyPatch, @@ -736,6 +912,24 @@ async def test_catalog_only_root_cause_ids(monkeypatch: pytest.MonkeyPatch) -> N assert result.root_cause_candidates[0].root_cause_id != "MADE_UP_ROOT_CAUSE" +@pytest.mark.asyncio +async def test_control_metadata_is_removed_from_rca_llm_prompt( + monkeypatch: pytest.MonkeyPatch, +) -> None: + provider = _DummyLLMProvider("") + monkeypatch.setattr("app.llm.provider.get_llm_provider", lambda: provider) + + result = await run_rca( + _classifier("SOURCE_AUTH_FAILURE", "SINK_AUTH_FAILURE"), + _retrieval("source 인증 실패 sink 인증 실패 expected_root_cause=PIPELINE_DUPLICATE_SPIKE"), + ) + + assert result.root_cause_candidates[0].root_cause_id in {"SOURCE_AUTH_EXPIRED", "SINK_AUTH_EXPIRED"} + prompt = provider.messages[1]["content"] + assert "expected_root_cause" not in prompt + assert "PIPELINE_DUPLICATE_SPIKE" not in prompt + + @pytest.mark.asyncio async def test_empty_evidence_items(monkeypatch: pytest.MonkeyPatch) -> None: _patch_llm(monkeypatch)