Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
T text-generation-inference
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Package Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • lizhiping
  • text-generation-inference
  • Repository
  • Branches

  • Overview
  • Active
  • Stale
  • All
  • feat/support_deepspeed
    f11965c1 · support deepspeed · Oct 13, 2022
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • megatron
    60ed7b53 · first tests · Feb 23, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • deploy/aml
    47ac334a · 0.4.0 · Mar 12, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/parse_logs
    7caea425 · feat(launcher): parse all shard logs · Apr 15, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/improve_max_tokens
    a9634953 · add logic to queue · Apr 26, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • remove_post_load_weights
    7ccb8eef · TMP. · May 15, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • quantization
    fb084094 · Reducing number of reps while autotuning. · Jun 06, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • add_gptq_docs
    17837b1e · Adding docs about GPTQ usage. · Jun 15, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • add_integration_test
    dca0fe25 · Adding GPTQ integration tests. · Jun 19, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • feat/better_tokens
    a4fd6905 · fmt · Jun 23, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • enable_non_divisible_embeddings merged
    db4efbf4 · fix(server): T5 weights names. (#582) · Jul 12, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • bnb4
    bfa3920a · BNB 4bits. · Jul 12, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • simpler_exllama
    f555dabc · Putting back header inclusion (seems unused but still) · Jul 20, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • compat_logger merged
    7766fee9 · fix typo for dynamic rotary (#745) · Jul 31, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • model_compat_log
    e994ad11 · Added InferenceClient · Aug 02, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • osanseviero-patch-1
    4ddb6681 · Add workflow to upload documentation · Aug 08, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • test_docs
    43ed6c21 · Dummy commit · Aug 10, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • streaming_conceptual
    4a9615e8 · Add to ToC · Aug 11, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • fix_leak
    89a4e723 · Attempting to fix torch leak. · Aug 12, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • improve-docs
    cf435285 · remove stream since its a separate PR · Aug 18, 2023
    Compare
    Download source code
    zip tar.gz tar.bz2 tar
  • Next

Delete protected branch '[branch name]'?

You’re about to permanently delete the protected branch [branch name].

This branch hasn’t been merged into main . To avoid data loss, consider merging this branch before deleting it.

Once you confirm and press Delete protected branch , it cannot be undone or recovered.

To confirm, type [branch name] :

Delete protected branch