提交 3bed5d45 编写于 作者: 刺猬

feat: 增加模型镜像和开放局域网访问参数

上级 323ce7c8
Dockerfile
models--THUDM--chatglm-6b/
from transformers import AutoModel, AutoTokenizer
import gradio as gr
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True).half().cuda()
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True, mirror='tuna')
model = AutoModel.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True, mirror='tuna').half().cuda()
model = model.eval()
MAX_TURNS = 20
......@@ -42,4 +42,4 @@ with gr.Blocks() as demo:
temperature = gr.Slider(0, 1, value=0.95, step=0.01, label="Temperature", interactive=True)
button = gr.Button("Generate")
button.click(predict, [txt, max_length, top_p, temperature, state], [state] + text_boxes)
demo.queue().launch(share=False, inbrowser=True)
demo.queue().launch(server_name="0.0.0.0", share=False, inbrowser=True)
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册