Does ramalama make AI boring?? Running AI models with Ramalama.
What is ramalama Ramalama is an open source command line tool that makes running AI models locally simple by treating them like containers. Ramalama runs models with podman/docker and there's no co...

Source: DEV Community
What is ramalama Ramalama is an open source command line tool that makes running AI models locally simple by treating them like containers. Ramalama runs models with podman/docker and there's no config needed. It is GPU optimizedand accelerates performance. It is compatible with llama.cpp, openvino, vLLM, whisper.cpp and manymore. Installing ramalama Ramalama is easy to install. After installing check the version you are using. Ramalama supports multiple model registries(transports); 1. Ollama It is the quickest and easiest registry. Here are a few AI models i ran using ollama. 2. Hugging face Some hugging face model require one to login. Here are some that don't require logging in: 3. Modelscope Model scope worked quite well too. but I had to upgrade ramalama's version. Here are some of modelscope's model I used; 4. OCI registries Let's start with what is OCI? OCI(Open Container Initiative), is a standard or a specification which defines how containers and their images should be packa