Code for the Byte Pair Encoding algorithm, commonly used in LLM tokenization (github.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of github.com: Code for the Byte Pair Encoding algorithm, commonly used in LLM tokenization

First screen, captured 2 years ago.

Looks similar

Screenshot of github.com: Llm.c – LLM training in simple, pure C/CUDA

Llm.c – LLM training in simple, pure C/CUDA (github.com)

810 points by tosh 2 years ago | 134 comments

GitHub repository for llm.c, Andrej Karpathy's project for training LLMs like GPT-2 in simple, raw C/CUDA.

llm gpt-2 c cuda

Screenshot of github.com: Show HN: Keydogger – Minimal keyboard macro for Linux (Wayland)

Show HN: Keydogger – Minimal keyboard macro for Linux (Wayland)(github.com)

87 points by jarusll 2 years ago | 39 comments

Screenshot of github.com: Show HN: A (marginally) useful x86-64 ELF executable in 466 bytes

Show HN: A (marginally) useful x86-64 ELF executable in 466 bytes (github.com)

78 points by meribold 2 years ago | 17 comments

Screenshot of github.com: Pydvice: An attempt at bringing (defadvice) from Elisp to Python

Pydvice: An attempt at bringing (defadvice) from Elisp to Python (github.com)

10 points by xenophonf 2 years ago | 3 comments

Screenshot of github.com: Show HN: Moribito – A TUI for LDAP Viewing/Queries

Show HN: Moribito – A TUI for LDAP Viewing/Queries (github.com)

89 points by woumn 1 year ago | 23 comments

Screenshot of github.com: Tini: A tiny but valid `init` for containers

Tini: A tiny but valid `init` for containers (github.com)

9 points by thunderbong 1 year ago | 0 comments