Llama.cpp Now Supports Qwen2-VL (Vision Language Model) (github.com)

Screenshot of github.com: Llama.cpp Now Supports Qwen2-VL (Vision Language Model)

First screen, captured 1 year ago.

Looks similar

Screenshot of github.com: Mistral Integration Improved in Llama.cpp

Mistral Integration Improved in Llama.cpp (github.com)

82 points by decide1000 1 year ago | 13 comments

Screenshot of github.com: New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy (github.com)

368 points by weinzierl 2 years ago | 72 comments

GitHub pull request to llama.cpp by jart that upstreams llamafile's vectorized expf() functions to compute SiLU and softmax faster and more accurately on CPU.

llama-cpp ggml simd softmax

Screenshot of github.com: AI has a deep understanding of how this code works

AI has a deep understanding of how this code works (github.com)

212 points by theresistor 11 months ago | 93 comments

Screenshot of github.com: LuaJIT PR: Add Support for RISC-V 64

LuaJIT PR: Add Support for RISC-V 64 (github.com)

136 points by ignota 2 years ago | 50 comments

Screenshot of github.com: The Windows Console gets support for Sixel images

The Windows Console gets support for Sixel images (github.com)

30 points by zadjii 2 years ago | 7 comments

Screenshot of github.com: Llama.cpp: Full CUDA GPU Acceleration

Llama.cpp: Full CUDA GPU Acceleration (github.com)

640 points by gzer0 3 years ago | 265 comments

A draft GitHub pull request to llama.cpp adding full CUDA GPU acceleration for all ggml tensors, including storing the KV cache in VRAM.

llama-cpp cuda gpu-acceleration llm-inference

Looks similar

Mistral Integration Improved in Llama.cpp(github.com)

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy(github.com)

AI has a deep understanding of how this code works(github.com)

LuaJIT PR: Add Support for RISC-V 64(github.com)

The Windows Console gets support for Sixel images(github.com)

Llama.cpp: Full CUDA GPU Acceleration(github.com)