Popular repositories Loading

1. harvesting harvesting Public

   Collection of data parser for harvested data in SciLonS

   Python 2

2. scilons-eval scilons-eval Public

   An evaluation framework for language models on scientific text processing tasks.

   Python

3. roberta-pretrain roberta-pretrain Public

   Python

4. datatrove datatrove Public

   Forked from huggingface/datatrove

   Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

   Python

5. tokenisers tokenisers Public

   Python