Skip to content

celialychee/LLM_repo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

基于InternLM实现的智能旅行规划小助手

https://github.com/InternLM/Tutorial

Alt text

💡开发进度💡

  • ☀天气查询
  • 🧭路线规划
  • 🎤ASR语音输入
  • 🔎RAG历史背景查询
  • 🔥实时热点攻略
  • 🏛景点开放信息

📰NEWS📰

  • [2024.09.03] 📣支持RAG生成准确历史文化背景故事
  • [2024.08.25] 📣根据天气偏好生成旅游规划及路线

🖥显存资源占用情况🖥

Name Resource(GB)
ASR 2.56
RAG 2.52
InterLM 15.90
WebUI 8.42
TOTAL 29.40

⭐使用说明⭐

环境配置

pip install -r requirements.txt

ASR模型下载

运行/path/to/LLM_repo/requirements/asr/models_download.sh

RAG模型下载

运行/path/to/LLM_repo/requirements/rag/models_download.sh

模型部署

conda activate agent
# 启用ASR
uvicorn server.asr.asr_server:app --host 0.0.0.0 --port 8003
# 启用RAG
uvicorn server.rag.rag_server:app --host 0.0.0.0 --port 8000

# 部署模型
lmdeploy serve api_server /root/share/new_models/Shanghai_AI_Laboratory/internlm2_5-7b-chat --model-name internlm2_5-7b-chat \
    --model-format hf \
    --quant-policy 4 \
    --cache-max-entry-count 0.4\

# 启动UI
export WEATHER_API_KEY={$和风天气API}
export ITINERARY_API_KEY={$高德地图API}
streamlit run /root/lizhenyu/LLM_repo/app.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors