feat(llama.cpp): estimate vram usage - #5299

feat(llama.cpp): estimate vram usage#5299

mudler merged 1 commit into

mastermudler/LocalAI:masterfrom

estimate_gpu_layersmudler/LocalAI:estimate_gpu_layersCopy head branch name to clipboard