I had the same problem, It's not easy to run it in house. But Llama and other hugging face sota models are working fine on my machines