torch-neuronx github.com ↗

AWS's PyTorch backend for Trainium and Inferentia chips.

LibraryAI & MLpytorchawstrainium

Recommended in 1 thread

libtt ↗AI & ML
An open-source libtpu implementation for Tenstorrent accelerators that can run much of TorchTPU.
1 thread
T3 AI & ML
A session-oriented interface for working with coding agents.
1 thread
Artificial Analysis ↗AI & ML
A site benchmarking and comparing AI models on quality, price and speed.
0 threads
TabPFN AI & ML
A transformer model that does tabular prediction via in-context learning.
1 thread
DeepSeek 4.1 Flash AI & ML
An open-weight language model from DeepSeek.
0 threads
Paseo AI & ML
A tool for running and managing coding agents.
1 thread
Hermes AI & ML
A personal AI agent framework that can run locally with local or cloud models.
1 thread
Physical Intelligence API ↗AI & ML
A beta API from Physical Intelligence for running its robot foundation models, fine-tuned per task and robot.
1 thread

OpenRouter ↗
A marketplace that routes API requests to many LLM inference providers.
7 threads
GLM ↗
An open-weights large language model family from Zhipu AI.
5 threads
llama.cpp
A C/C++ engine for running LLMs locally.
4 threads
GoModel ↗
LLM gateway written in Go, offered as a LiteLLM alternative.
3 threads
DeepSeek
A family of large language models offered via a low-cost API.
2 threads
OpenCode Go ↗
A subscription plan for accessing models through the OpenCode coding tool.
2 threads
Cerebras ↗
A hosted fast inference service offering Qwen models.
1 thread
Claude
Anthropic's AI model and command-line assistant.
1 thread
Claude Code gateways ↗
Documented setup for routing Claude Code through an LLM gateway for centralized control and alternate model providers.
1 thread
Cloudflare Workers AI ↗
Cloudflare's serverless platform for running hosted AI models.
1 thread
CodeCarbon ↗
An open-source Python library for estimating the carbon emissions of compute workloads.
1 thread
Codex
OpenAI's coding agent.
1 thread

Link from a commenter, not checked or endorsed by us: ↗ https://github.com/aws-neuron/torch-neuronx