missing arg

56de96ab · OlivierDehaene · 29341dcc · 56de96ab
Commit 56de96ab authored 1 year ago by OlivierDehaene
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

server/text_generation_server/models/custom_modeling/flash_santacoder_modeling.py ...erver/models/custom_modeling/flash_santacoder_modeling.py +1 -0

No files found.
--- a/server/text_generation_server/models/custom_modeling/flash_santacoder_modeling.py
+++ b/server/text_generation_server/models/custom_modeling/flash_santacoder_modeling.py
@@ -363,6 +363,7 @@ class Block(nn.Module):
        slots,
        input_lengths,
        max_s,
+        prefill_cache_indices
    ):
        hidden_states, residual = self.ln_1(hidden_states, residual)
        hidden_states = self.attn(