Llama.cpp Now Supports Qwen2-VL (Vision Language Model)(github.com)

143 points by BUFU 1 year ago | 37 comments

AI has a deep understanding of how this code works(github.com)

212 points by theresistor 11 months ago | 93 comments

LuaJIT PR: Add Support for RISC-V 64(github.com)

136 points by ignota 2 years ago | 50 comments

Native visionOS platform support(github.com)

348 points by whalee 1 year ago | 261 comments

GitHub pull request from an Apple visionOS engineer adding native visionOS platform support to the Godot game engine.

Apple's MLX adding CUDA support(github.com)

522 points by nsagent 1 year ago | 181 comments

A GitHub pull request (closed, WIP) in Apple's ml-explore/mlx repository adding an experimental CUDA backend to the MLX framework.

Llama.cpp: Full CUDA GPU Acceleration(github.com)

640 points by gzer0 3 years ago | 265 comments

A draft GitHub pull request to llama.cpp adding full CUDA GPU acceleration for all ggml tensors, including storing the KV cache in VRAM.