Microsoft BitNet: inference framework for 1-bit LLMs(github.com)

105 points by galeos 2 years ago | 25 comments

Microsoft Python Driver for SQL Server(github.com)

64 points by kermatt 1 year ago | 25 comments

Microsoft open-sources LiteBox, a security-focused library OS(github.com)

374 points by aktau 8 months ago | 194 comments

GitHub repository for Microsoft's LiteBox, an open-source security-focused library OS supporting kernel- and user-mode execution.

VPTQ: Extreme low-bit Quantization for real LLMs(github.com)

12 points by OpenSourceRonin 2 years ago | 1 comments

OpenVMM – A New VMM for Windows and Linux, Written in Rust(github.com)

136 points by g0xA52A2A 2 years ago | 100 comments

LLMLingua: Compressing Prompts for Faster Inferencing(github.com)

131 points by TarqDirtyToMe 2 years ago | 38 comments

DeepInfer: High-performance inference framework for DeepSeek models(github.com)

2273 points by ggcr 6 days ago | 890 comments

GitHub repository for DeepInfer, DeepSeek's open-source high-performance, large-scale inference framework for DeepSeek models.

Llama2.c: Inference llama 2 in one file of pure C(github.com)

659 points by anjneymidha 3 years ago | 158 comments

GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.

Heretic: Automatic censorship removal for language models(github.com)

705 points by melded 11 months ago | 339 comments

GitHub repository for Heretic, an AGPL-licensed tool for fully automatic censorship removal (abliteration) in transformer language models.

Blitz: A lightweight, modular, extensible web renderer(github.com)

391 points by whatever3 2 years ago | 102 comments

GitHub repository for Blitz, a high-performance HTML and CSS renderer from DioxusLabs powered by WGPU.

Show HN: An open source framework for voice assistants(github.com)

320 points by kwindla 2 years ago | 34 comments

GitHub repository for Pipecat, an open source Python framework for building real-time voice and multimodal conversational AI agents.

Show HN: Sumi.css – CSS Framework(github.com)

58 points by bepero 5 days ago | 13 comments

GitHub repository for Sumi.css, a minimalist classless-first CSS framework (6.7 KB gzipped) with dark mode, theming via custom properties, and no build step.