JFDuan 0d93f15694

Accelerate LLaMA model loading (#234)

2023-08-30 01:00:13 -07:00

..

core

[Fix] Fix a condition for ignored sequences (#867)

2023-08-27 23:00:56 -07:00

engine

Refactor scheduler (#658)

2023-08-02 16:42:01 -07:00

entrypoints

Enable request body OpenAPI spec for OpenAI endpoints (#865)

2023-08-29 21:54:08 -07:00

model_executor

Accelerate LLaMA model loading (#234)

2023-08-30 01:00:13 -07:00

transformers_utils

Add support for aquila (#663)

2023-08-22 00:13:36 -07:00

worker

Add Falcon support (new) (#592)

2023-08-02 14:04:39 -07:00

__init__.py

Bump up the version to v0.1.4 (#846)

2023-08-25 12:28:00 +09:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

fix: incorrect bigcode attention heads num (#676)

2023-08-04 10:35:22 -07:00

logger.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

outputs.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

sampling_params.py

Fix typo in sampling_params.py (#788)

2023-08-18 10:12:46 +09:00

sequence.py

avoid python list copy in sequence initialization (#401)

2023-07-08 12:42:08 -07:00

utils.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00