Skip to content

fix: updates to newer version of llama.cpp#1

Open
gphorvath wants to merge 3 commits intomickymultani:mainfrom
gphorvath:updates-and-fixes
Open

fix: updates to newer version of llama.cpp#1
gphorvath wants to merge 3 commits intomickymultani:mainfrom
gphorvath:updates-and-fixes

Conversation

@gphorvath
Copy link
Copy Markdown

@gphorvath gphorvath commented Oct 25, 2024

  • Fixed name changes in newer llama.cpp
    • LLAMA_CUBLAS --> GGML_CUDA
    • convert-hf-to-gguf.py --> convert_hf_to_gguf.py
    • llama.cpp/quantize --> llama.cpp/llama-quantize
    • llama.cpp/main --> llama.cpp/llama-cli
  • Pinned llama.cpp to the most recent release tag to avoid drift in the future.
  • Fixed typo: Orignal vs Original
  • Added .gitignore to make sure tutorial directories and python artifacts aren't checked in

@gphorvath
Copy link
Copy Markdown
Author

Thank you for the tutorial! I fixed a couple issues as I worked through caused by some drift in llama.cpp and a typo. If this isn't helpful, feel free to close!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant