wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-14 11:19:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
440 Commits 1 Branch 0 Tags
1fe09900238870a0477fa638dbd2d2bd2f251e1d
Commit Graph
41 Commits
Author SHA1 Message Date
Stephen KriderandGitHub 9cabcb7645 Add Dockerfile (#1350) 2023-10-31 12:36:47 -07:00
Zhuohan LiandGitHub 9eed4d1f3e Update README.md (#1292) 2023-10-08 23:15:50 -07:00
Usama AhmedandGitHub 0967102c6d fixing typo in tiiuae/falcon-rw-7b model name (#1226) 2023-09-29 13:40:25 -07:00
Woosuk KwonandGitHub 202351d5bf Add Mistral to supported model list (#1221) 2023-09-28 14:33:04 -07:00
Nick PerezandGitHub 4ee52bb169 Docs: Fix broken link to openai example (#1145) 
Link to `openai_client.py` is no longer valid - updated to `openai_completion_client.py`
 2023-09-22 11:36:09 -07:00
Woosuk KwonandGitHub 7d7e3b78a3 Use --ipc=host in docker run for distributed inference (#1125) 2023-09-21 18:26:47 -07:00
Tanmay VermaandGitHub 6f2dd6c37e Add documentation to Triton server tutorial (#983) 2023-09-20 10:32:40 -07:00
Woosuk KwonandGitHub eda1a7cad3 Announce paper release (#1036) 2023-09-13 17:38:13 -07:00
Woosuk KwonandGitHub b9cecc2635 [Docs] Update installation page (#1005) 2023-09-10 14:23:31 -07:00
Zhuohan LiandGitHub 002800f081 Align vLLM's beam search implementation with HF generate (#857) 2023-09-04 17:29:42 -07:00
Woosuk KwonGitHubZhuohan Li
 		55b28b1eee [Docs] Minor fixes in supported models (#920) 
* Minor fix in supported models

* Add another small fix for Aquila model

---------

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2023-08-31 16:28:39 -07:00
Zhuohan LiandGitHub 14f9c72bfd Update Supported Model List (#825) 2023-08-22 11:51:44 -07:00
UranusandGitHub 1b151ed181 Fix baichuan doc style (#748) 2023-08-13 20:57:31 -07:00
Zhuohan LiandGitHub f7389f4763 [Doc] Add Baichuan 13B to supported models (#656) 2023-08-02 16:45:12 -07:00
Zhuohan LiandGitHub 1b0bd0fe8a Add Falcon support (new) (#592) 2023-08-02 14:04:39 -07:00
Zhuohan LiandGitHub df5dd3c68e Add Baichuan-7B to README (#494) 2023-07-25 15:25:12 -07:00
Zhuohan LiandGitHub 6fc2a38b11 Add support for LLaMA-2 (#505) 2023-07-20 11:38:27 -07:00
Zhanghao WuGitHubZhuohan Li
 		58df2883cb [Doc] Add doc for running vLLM on the cloud (#426) 
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2023-07-16 13:37:14 -07:00
Andre SlavescuGitHubwoWoosuk Kwon
 		c894836108 [Model] Add support for GPT-J (#226) 
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
 2023-07-08 17:55:16 -07:00
Woosuk KwonandGitHub ffa6d2f9f9 [Docs] Fix typo (#346) 2023-07-03 16:51:47 -07:00
Woosuk KwonandGitHub 404422f42e [Model] Add support for MPT (#334) 2023-07-03 16:47:53 -07:00
Woosuk KwonandGitHub e41f06702c Add support for BLOOM (#331) 2023-07-03 13:12:35 -07:00
BayangandGitHub 9d27b09d12 Update README.md (#306) 2023-06-29 06:52:15 -07:00
Zhuohan LiandGitHub 2cf1a333b6 [Doc] Documentation for distributed inference (#261) 2023-06-26 11:34:23 -07:00
Woosuk KwonandGitHub 665c48963b [Docs] Add GPTBigCode to supported models (#213) 2023-06-22 15:05:11 -07:00
Woosuk KwonandGitHub 794e578de0 [Minor] Fix URLs (#166) 2023-06-19 22:57:14 -07:00
Woosuk KwonandGitHub caddfc14c1 [Minor] Fix icons in doc (#165) 2023-06-19 20:35:38 -07:00
Woosuk KwonandGitHub b7e62d3454 Fix repo & documentation URLs (#163) 2023-06-19 20:03:40 -07:00
Woosuk KwonandGitHub 364536acd1 [Docs] Minor fix (#162) 2023-06-19 19:58:23 -07:00
Zhuohan LiandGitHub 0b32a987dd Add and list supported models in README (#161) 2023-06-20 10:57:46 +08:00
Zhuohan LiandGitHub a255885f83 Add logo and polish readme (#156) 2023-06-19 16:31:13 +08:00
Woosuk KwonandGitHub dcda03b4cb Write README and front page of doc (#147) 2023-06-18 03:19:38 -07:00
Zhuohan LiandGitHub bec7b2dc26 Add quickstart guide (#148) 2023-06-18 01:26:12 +08:00
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Woosuk KwonandGitHub e38074b1e6 Support FP32 (#141) 2023-06-07 00:40:21 -07:00
Woosuk KwonandGitHub 376725ce74 [PyPI] Packaging for PyPI distribution (#140) 2023-06-05 20:03:14 -07:00
Woosuk KwonandGitHub 456941cfe4 [Docs] Write the Adding a New Model section (#138) 2023-06-05 20:01:26 -07:00
Woosuk KwonandGitHub 62ec38ea41 Document supported models (#127) 2023-06-02 22:35:17 -07:00
Woosuk KwonandGitHub 0eda2e0953 Add .readthedocs.yaml (#136) 2023-06-02 22:27:44 -07:00
Woosuk KwonandGitHub 56b7f0efa4 Add a doc for installation (#128) 2023-05-27 01:13:06 -07:00
Woosuk KwonandGitHub 19d2899439 Add initial sphinx docs (#120) 2023-05-22 17:02:44 -07:00