Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,11 +35,11 @@ LAiSER is open-source software that reads such documents and links each skill th

# Statement of need

Students and job seekers acquire skills through university courses, online courses and previous jobs, while many employers define in-house taxonomies for skills. Across syllabi and job descriptions, skills are just keywords, and without additional context what a skill means is left to subjective inference. Existing approaches that implement classical NLP methods often miss domain context [@Boselli2018], and works that use transformers or LLMs leave gaps in reproducibility and source grounding [@Li2023SkillGPT; @Herandi2024SkillLLM; @Nguyen2024Rethinking]. Without grounding, researchers and curriculum designers can be misled by irrelevant matches, which could negatively affect the decisions those matches inform. LAiSER is an open-source research tool for skill researchers that acts as a translation layer between the skill language of universities and industry, grounding its results in national taxonomies, with the choice of LLM left to the researcher. Every match carries its taxonomy source, link and similarity score, so users can check it. We share it so that researchers and educators can focus on understanding skills and iterating on their findings instead of building the pipeline themselves. Target users include labor economists studying occupational transitions, curriculum designers auditing program alignment with industry needs, and credentialing organizations producing standards-aligned digital badges.
Students and job seekers acquire skills through university courses, online courses and previous jobs, while many employers define in-house taxonomies for skills. Across syllabi and job descriptions, skills are just keywords, and without additional context what a skill means is left to subjective inference. Existing approaches that implement classical natural language processing (NLP) methods often miss domain context [@Boselli2018], and works that use transformers or LLMs leave gaps in reproducibility and source grounding [@Li2023SkillGPT; @Herandi2024SkillLLM; @Nguyen2024Rethinking]. Without grounding, researchers and curriculum designers can be misled by irrelevant matches, which could negatively affect the decisions those matches inform. LAiSER is an open-source research tool for skill researchers that acts as a translation layer between the skill language of universities and industry, grounding its results in national taxonomies, with the choice of LLM left to the researcher. Every match carries its taxonomy source, link and similarity score, so users can check it. We share it so that researchers and educators can focus on understanding skills and iterating on their findings instead of building the pipeline themselves. Target users include labor economists studying occupational transitions, curriculum designers auditing program alignment with industry needs, and credentialing organizations producing standards-aligned digital badges.

# State of the field

Several open-source tools address parts of the skill extraction problem. SkillNER [@SkillNER2022] uses rule-based matching against the EMSI (now Lightcast) skills database via spaCy, an open-source natural language processing library, offering fast lookups but limited ability to detect novel or context-dependent skills not present in its dictionary. Nesta's Skills Extractor Library [@Nesta2023] trains a spaCy named entity recognition (NER) model on labeled job advertisements and maps extracted phrases to ESCO or Lightcast taxonomies using sentence-transformer embeddings. The esco-skill-extractor, also published as ESCOX [@EscoExtractor2024; @Kavargyris2025ESCOX], embeds full input texts with a transformer and matches them against ESCO entries by cosine similarity.
Several open-source tools address parts of the skill extraction problem. SkillNER [@SkillNER2022] uses rule-based matching against the EMSI (now Lightcast) skills database via spaCy, an open-source NLP library, offering fast lookups but limited ability to detect novel or context-dependent skills not present in its dictionary. Nesta's Skills Extractor Library [@Nesta2023] trains a spaCy named entity recognition (NER) model on labeled job advertisements and maps extracted phrases to ESCO or Lightcast taxonomies using sentence-transformer embeddings. The esco-skill-extractor, also published as ESCOX [@EscoExtractor2024; @Kavargyris2025ESCOX], embeds full input texts with a transformer and matches them against ESCO entries by cosine similarity.

LLMs have also been applied to skill extraction directly. SkillGPT [@Li2023SkillGPT] extracts skills from job descriptions with an open-source LLM and standardizes them to ESCO through vector similarity search. Skill-LLM [@Herandi2024SkillLLM] fine-tunes an LLM for skill extraction from job descriptions, and @Nguyen2024Rethinking evaluate in-context learning with LLMs on six skill extraction benchmarks, finding that LLMs trail supervised models overall but better handle syntactically complex skill mentions.

Expand Down
Loading