Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
LICENSE		LICENSE
OS_RAG_LLM_JAP_at_4_Bits-PDF.pdf		OS_RAG_LLM_JAP_at_4_Bits-PDF.pdf
OpenSource_RAG_LLM_JAP_at_4_Bits.ipynb		OpenSource_RAG_LLM_JAP_at_4_Bits.ipynb
README.md		README.md

Repository files navigation

Open-source RAG for Japanese LLM in low-resource settings

Llama-Index as a data framework
Embeddings from Multi-lingual E5 from Microsoft
Elyza as LLM based on LlaMA 2 (Facebook/Meta)
4Bits quantized by Bitsandbytes (served by Hugging Face Accelerate)
CJKPDFReader loader for Japanese PDF files
Open source Vector database (Postgres + PGVector)
Vanilla hybrid search
Ngrok for TCP tunneling
Q&A test
Conclusion

About

Open source RAG with Llama Index for Japanese LLM in low resource settting

nlp japanese ngrok llm llama-index pgvector bitsandbytes elyza

Report repository

Releases

No releases published

Packages

Contributors

Languages

Jupyter Notebook 100.0%