Arandu

This is Arandu, an app to help with Llama.cpp usage, the idea is to create a small system around llama-server without need to hook with the dll files.

• [x] Model management
• [x] HuggingFace Integration
• [x] Llama.cpp GitHub Integration with releases management
• [x] Llama-server terminal launching with easy arguments customization and presets, Internal / External
• [x] Llama-server native chat UI integrated
• [x] Hardware monitor
• [x] Color themes

To-do (long way ahead)

• [ ] Make compatible with Linux and Mac (problematic because of webview)

Building

Use cargo tauri build, it will output to backend\target\release.

Download

https://github.com/fredconex/Arandu/releases

Screenshots