Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
T text-generation-inference
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Package Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • lizhiping
  • text-generation-inference
  • Repository
  • Branches

  • Overview
  • Active
  • Stale
  • All
  • self-generating-docs
    4bac7624 · Update server.rs · Aug 21, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • speculative
    33958e09 · Start. · Sep 11, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • dev
    c35f39cf · Add AWQ quantization inference support (#1019) · Sep 25, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/attention_sinks
    56de96ab · missing arg · Oct 05, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/cuda_12
    8a7771a3 · Use cuda devel instead · Oct 11, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • medusa
    5b340a5f · Dump work. · Nov 30, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • fix/avoid_record_streams
    65db02f1 · fix: use TORCH_NCCL_AVOID_RECORD_STREAMS=1 · Jan 09, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • support-phi-model
    31b23f98 · feat: boilerplate phi2 model integration · Jan 10, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • update_docs2
    45978034 · Pre-emptive on sealion. · Jan 26, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • bump-poetry-and-requirements
    fc86dba7 · fix: ensure latest requirements exported · Jan 26, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • fix_neox_rotary_emb
    871e5e73 · fix rotary dim · Jan 30, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • mamba2
    a3c45da0 · Improvments within mamba. · Jan 31, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • update_readme merged
    94d243b3 · Freshen up the README. · Feb 01, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • debug-request-id
    b71557d9 · add request id in logs · Feb 01, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • revert merged
    1e03b61b · Revert "Modify default for max_new_tokens in python client (#1336)" · Feb 01, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • add_readme_dashboard
    c10c4a02 · Github magic? · Feb 01, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • update_peft
    e10530d4 · update to peft 0.8.2 · Feb 06, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • add_batch_dimension
    81fa53f3 · Fix tests. · Feb 08, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • ci-amihalik-update-chat-completion-messages
    5cdee2a5 · Merge branch 'amihalik-update-chat-completion-messages' into... · Feb 15, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • fix-gemma-tokenization
    cd57f9c6 · fix: avoid duplicate bos token · Feb 23, 2024
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • Prev
  • Next

Delete protected branch '[branch name]'?

You’re about to permanently delete the protected branch [branch name].

This branch hasn’t been merged into main . To avoid data loss, consider merging this branch before deleting it.

Once you confirm and press Delete protected branch , it cannot be undone or recovered.

To confirm, type [branch name] :

Delete protected branch