Mistral Integration Improved in Llama.cpp (github.com)

Screenshot of github.com: Mistral Integration Improved in Llama.cpp

First screen, captured 1 year ago.

Looks similar

Screenshot of github.com: Llama.cpp Now Supports Qwen2-VL (Vision Language Model)

Llama.cpp Now Supports Qwen2-VL (Vision Language Model)(github.com)

143 points by BUFU 1 year ago | 37 comments

Screenshot of github.com: New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy (github.com)

368 points by weinzierl 2 years ago | 72 comments

GitHub pull request to llama.cpp by jart that upstreams llamafile's vectorized expf() functions to compute SiLU and softmax faster and more accurately on CPU.

llama-cpp ggml simd softmax

Screenshot of github.com: AI has a deep understanding of how this code works

AI has a deep understanding of how this code works (github.com)

212 points by theresistor 11 months ago | 93 comments

Screenshot of github.com: Java Panama Vector API Integrated with Apache Lucene

Java Panama Vector API Integrated with Apache Lucene (github.com)

67 points by kurhan 3 years ago | 12 comments

Screenshot of github.com: Apple's MLX adding CUDA support

Apple's MLX adding CUDA support (github.com)

522 points by nsagent 1 year ago | 181 comments

A GitHub pull request (closed, WIP) in Apple's ml-explore/mlx repository adding an experimental CUDA backend to the MLX framework.

mlx cuda apple nvidia

Screenshot of github.com: Vision Now Available in Llama.cpp

Vision Now Available in Llama.cpp (github.com)

475 points by redman25 1 year ago | 104 comments

Documentation page in the llama.cpp GitHub repository describing multimodal (vision) input support via libmtmd and the tools that use it.

llama-cpp multimodal vision-models libmtmd

Looks similar

Llama.cpp Now Supports Qwen2-VL (Vision Language Model)(github.com)

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy(github.com)

AI has a deep understanding of how this code works(github.com)

Java Panama Vector API Integrated with Apache Lucene(github.com)

Apple's MLX adding CUDA support(github.com)

Vision Now Available in Llama.cpp(github.com)

New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy (github.com)

AI has a deep understanding of how this code works (github.com)

Java Panama Vector API Integrated with Apache Lucene (github.com)

Apple's MLX adding CUDA support (github.com)

Vision Now Available in Llama.cpp (github.com)