Tag: GPU
-
Optimize LLM Performance on Mac and Ubuntu
This post discusses optimizing performance with large language models using Ollama on macOS with Apple’s M1/M2 chips and dual NVIDIA 2080 Ti GPUs on Ubuntu. It provides installation steps and GPU acceleration tips, highlights alternative tools, and outlines how to implement OpenAI-compatible APIs efficiently, maximizing hardware performance for local inference.
Johngai’s Tech Forge 