Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
T text-generation-inference
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Package Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • lizhiping
  • text-generation-inference
  • Repository
  • Branches

  • Overview
  • Active
  • Stale
  • All
  • auto_max_prefill
    9e2a4a52 · Typo in h100. · Nov 10, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • main default protected
    a7850008 · Add initial support for compressed-tensors checkpoints (#2732) · Nov 10, 2024
    Download source code
    zip tar.gz tar.bz2 tar
  • feat-backend-llamacpp
    8ba38947 · feat(backend): remove reinterpret_cast converting from uint32_t to llama_token(int32_t) · Nov 09, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • support-continue-final-message
    1895d7b7 · fix: bump openapi docs · Nov 08, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feature/compressed-tensors-w8a8-int
    851cd522 · w8a8 int integration test · Nov 08, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/limit
    6297f176 · feat: add payload limit · Nov 05, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • support-flash-qwen2-vl
    41dff314 · feat: support flash attention 2 in qwen2 vl vision blocks · Nov 04, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • maintenance/marlin-kernels-0.7.0
    96e301b4 · Update to moe-kernels 0.7.0 · Nov 04, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • pr-2711-ci-branch
    a604bfe4 · fix: run pre commit lints · Nov 01, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • pr-2634-ci-branch
    f9f34a5e · fix: remove mostly mocked unit test · Oct 29, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • trtllm-stop-words
    3bb78a82 · misc(deps): update ompi from 4.1.6 to 4.1.7rc1 to avoid strange deadlock · Oct 28, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • upgrade-outlines
    7bc2c97b · Check if allowed tokens is None (#2694) · Oct 28, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • git_v2.4.0
    0a655a0a · v2.4.0 · Oct 25, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • return-streaming-error-in-openai-client-compatible-format
    de735e3d · Revert "fix: improve streamin error to include error_type" · Oct 25, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • improve-find-segments-function
    f311643f · fix: improve find_segments via numpy diff · Oct 24, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • auto_length
    e3db5259 · Fix integration mt0 (transformers update). · Oct 24, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • close_dl_thread
    fe8d55db · Clean both threads. · Oct 21, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • adjust-where-request-max-tokens-is-defaulted
    b3917ff6 · fix: add limit to internal stream function too · Oct 15, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feature/machete
    c9e0f36d · Machete WIP · Oct 14, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • add-test-for-warmup-and-kvcache
    99b1cf59 · fix: rerun linter · Oct 09, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • Next

Delete protected branch '[branch name]'?

You’re about to permanently delete the protected branch [branch name].

This branch hasn’t been merged into main . To avoid data loss, consider merging this branch before deleting it.

Once you confirm and press Delete protected branch , it cannot be undone or recovered.

To confirm, type [branch name] :

Delete protected branch