![]() ![]() Here’s what that one-liner does: #!/bin/bash Here’s a one-liner you can use to install it on your M1/M2 Mac: curl -L "" | bash However, Llama.cpp also has support for Linux/Windows. Llama.cpp is a port of Llama in C/C++, which makes it possible to run Llama 2 locally using 4-bit integer quantization on Macs. In this blog post we’ll cover three open-source tools you can use to run Llama 2 on your own devices: It’s only been a couple days since Llama 2 was released, but there are already a handful of techniques for running it locally. Here’s an example using a locally-running Llama 2 to whip up a website about why llamas are cool: The cool thing about running Llama 2 locally is that you don’t even need an internet connection. But you can also run Llama locally on your M1/M2 Mac, on Windows, on Linux, or even your phone. We’ve been talking a lot about how to run and fine-tune Llama 2 on Replicate. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |