Getting Llama 2 Running Before I'd Even Finished My Coffee
Meta and Microsoft dropped Llama 2 today, and unlike the March leak, this time you can just ask for the weights. I did, and spent the rest of the afternoon trying to get a quantized 13B running on my own laptop.
