Skip to content
@EmbeddedLLM

EmbeddedLLM

We are committed to making production-grade AI inference as accessible and reliable as electricity, powered by vLLM.

Pinned Loading

  1. JamAIBase JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

    Python 1.1k 48

  2. vllm vllm Public

    Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 94 7

  3. embeddedllm embeddedllm Public

    EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Python 54 5

Repositories

Showing 10 of 87 repositories
  • TokenVisor-recipes Public

    Inference recipes

    EmbeddedLLM/TokenVisor-recipes's past year of commit activity
    Python 0 0 0 0 Updated Oct 11, 2026
  • litellm Public Forked from BerriAI/litellm

    Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

    EmbeddedLLM/litellm's past year of commit activity
    Python 0 12,409 0 0 Updated Oct 11, 2026
  • vllm Public Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm's past year of commit activity
    Python 94 Apache-2.0 23,512 1 10 Updated Oct 10, 2026
  • agentic-api Public Forked from vllm-project/agentic-api

    Stateful API logic for agentic applications using vLLM

    EmbeddedLLM/agentic-api's past year of commit activity
    Rust 1 Apache-2.0 85 0 0 Updated Oct 9, 2026
  • TokenVisor-charts Public
    EmbeddedLLM/TokenVisor-charts's past year of commit activity
    Shell 1 0 0 0 Updated Oct 8, 2026
  • skypilot Public Forked from skypilot-org/skypilot

    SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

    EmbeddedLLM/skypilot's past year of commit activity
    Python 2 Apache-2.0 1,296 0 0 Updated Oct 7, 2026
  • recipes Public Forked from vllm-project/recipes

    Common recipes to run vLLM

    EmbeddedLLM/recipes's past year of commit activity
    JavaScript 0 Apache-2.0 452 0 0 Updated Oct 7, 2026
  • JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

    EmbeddedLLM/JamAIBase's past year of commit activity
    Python 1,102 Apache-2.0 48 1 1 Updated Oct 6, 2026
  • pi-cliffcompaction Public

    CliffCompaction for Pi: mechanical, truncate-only context compaction

    EmbeddedLLM/pi-cliffcompaction's past year of commit activity
    TypeScript 0 MIT 0 0 0 Updated Sep 27, 2026
  • Infera Public Forked from AMD-AGI/Infera

    More token goodput from frontier models. A distributed, SLA-aware serving mesh — disaggregated prefill/decode, KV-aware routing, and cache offload, tuned to your production SLA.

    EmbeddedLLM/Infera's past year of commit activity
    Python 0 MIT 7 0 0 Updated Sep 23, 2026
View all repositories

Most used topics

llm llm-inference