Skip to content

Fix PyPI package size by preparing taxonomy data during setup - #462

Merged
Anket11 merged 1 commit into
mainfrom
fix/pypi-package-size
Nov 7, 2026
Merged

Anket11 merged 1 commit into
mainfrom
fix/pypi-package-size

Conversation

@Anket11

@Anket11 Anket11 commented Nov 7, 2026

Copy link
Copy Markdown
Member

Summary

pip install laiser
laiser setup
  fetch and verify skills, knowledge, and tasks from taxonomy-v1
  prepare the pinned embedding model
extract_concepts(...)
  load local assets and run the existing extraction flow

Evidence

  • Before Taxonomy assets alone accounted for about 129 MiB after compression. The release workflow caps each PyPI upload at 100 MiB.
  • After The wheel is 67 KiB and the source distribution is 78 KiB. The local suite passed 71 tests. The installed-wheel test verified a fresh bundle download, cache reuse, and local loading. A live Gemini run returned 5 skills, 15 knowledge areas, and 14 task abilities with the same 34 taxonomy matches as the original checkout.

Merge Danger

Door Two-way before tagging. Publish taxonomy-v1 from the merged commit, test setup against the public assets, then tag the same commit v1.0.1.

Blast radius Installation. Users run laiser setup once after installing or upgrading.

@github-actions

github-actions Bot commented Nov 7, 2026

Copy link
Copy Markdown

Complexity Analysis

Average: C — Moderate (13.909090909090908)

Hotspots tracked below. These are functional, well-exercised components — listed for visibility as the codebase scales.

Grade Name Type Score
F FAISSIndexManager.initialize_index Method 53
E SkillExtractionService.extract_and_align_core Method 36
E FAISSIndexManager.search_similar_skills Method 32
D ResponseParser._parse_skills_from_response Method 24
D FAISSIndexManager Class 23
C ResponseParser.parse_knowledge_task_response Method 20
C _BaseTaxonomyFAISSIndexManager.search_similar Method 18
C ResponseParser Class 17
C ResponseParser.parse_ksa_extraction_response Method 16
C ResponseParser.parse_skill_extraction_response Method 15
C openai_generate Function 14
C _download_bundle Function 13
C parse_output_vllm Function 13
C AlignmentService.align Method 11
C _BaseTaxonomyFAISSIndexManager.initialize_index Method 11
C LLMRouter._initialize_components Method 11
C anthropic_generate Function 11
B SkillExtractionService._deduplicate Method 10
B GeminiAPI.generate_with_config Method 10
B load_model_from_vllm Function 10
B _BaseTaxonomyFAISSIndexManager Class 9
B ResponseParser.parse_ksa_details_response Method 8
B SkillExtractionService Class 8
B llm_generate Function 8
B SkillExtractorRefactored._expand_allowed_sources Method 7
B get_completion_vllm Function 7
B LLMRouter.generate Method 7
B llama_cpp_chat Function 7
B AlignmentService Class 6
B SkillExtractionService._normalize_mixed_concept_rows Method 6
B fetch_model_output Function 6
B GeminiAPI Class 6
B LlamaCppBackend.__init__ Method 6

@github-actions

github-actions Bot commented Nov 7, 2026

Copy link
Copy Markdown

Code Hygiene

The following items are defined but not yet in active use. Routine cleanup — no impact on functionality.

  • laiser/llm_methods.py:87 — unused variable 'args' (100% confidence)
  • laiser/llm_models/llama_cpp_handler.py:45 — unused variable 'chat_format' (100% confidence)
  • laiser/llm_models/llama_cpp_handler.py:86 — unused variable 'exc_type' (100% confidence)
  • laiser/llm_models/llama_cpp_handler.py:86 — unused variable 'tb' (100% confidence)
  • laiser/llm_models/llm_router.py:71 — unused variable 'args' (100% confidence)
  • laiser/llm_models/llm_router.py:86 — unused variable 'args' (100% confidence)
  • laiser/llm_models/llm_router.py:89 — unused variable 'args' (100% confidence)
  • laiser/services.py:128 — unused variable 'raw_description' (100% confidence)

@Anket11
Anket11 merged commit 2f70e40 into main Nov 7, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant