OpenAI Hoarding Tens Of Thousands Of Apple Mac mini And Mac Studio Devices, As ASUS And MSI Burn Through Their Entire First Batch Of NVIDIA RTX Spark Chip And Beg For More
wccftech.com
AI labs are going after any compute-capable machine, including Apple Mac mini and Mac Studio devices, as well as the NVIDIA RTX Spark PCs.
  • deleted@lemmy.worldEnglish
    31·
    16 days ago

    For your hardware, the VRam is not enough to run 27b but, I’d recommend Qwen 3.5 9b for image / text to text.

    And I’m planning to experiment with Qwen 3.8 9b for text to text.

    4_k_m quantization is the sweet spot for performance and ram usage.

    Also, I find Llama cpp is better than Ollama in terms of performance.