localGPT部署

最新推荐文章于 2024-06-12 11:47:29 发布

超级小龙虾

最新推荐文章于 2024-06-12 11:47:29 发布

阅读量1.1k

点赞数

文章标签： python

本文链接：https://blog.csdn.net/qq_41638872/article/details/130978221

版权

github

localGPT

This project was inspired by the original privateGPT (https://github.com/imartinez/privateGPT). Most of the description here is inspired by the original privateGPT.

In this model, I have replaced the GPT4ALL model with Vicuna-7B model and we are using the InstructorEmbeddings instead of LlamaEmbeddings as used in the original privateGPT. Both Embeddings as well as LLM will run on GPU instead of CPU. It also has CPU support if you do not have a GPU (see below for instruction).

Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

Built with LangChain and Vicuna-7B and InstructorEmbeddings