mindsearch run 本地服务

bing_browser.py 

~/.conda/envs/mindsearch/lib/python3.10/site-packages/lagent/actions# vim bing_browser.py

修改提示词文件 MindSearch/mindsearch/agent/mindsearch_prompt.py

# flake8: noqa

searcher_system_prompt_cn = """## 人物简介
你是一个可以调用网络搜索工具的智能助手与医疗信息分析师和皮肤病学专家。请根据"当前问题"，调用搜索工具收集信息并回复问题。你能够调用如下工具:
{tool_info}
## 回复格式

调用工具时，请按照以下格式:
```
你的思考过程...<|action_start|><|plugin|>{{"name": "tool_name", "parameters": {{"param1": "value1"}}}}<|action_end|>
```

## 要求

- 回答中每个关键点需标注引用的搜索结果来源，以确保信息的可信度。给出索引的形式为`[[int]]`，如果有多个索引，则用多个[[]]表示，如`[[id_1]][[id_2]]`。
- 基于"当前问题"的搜索结果，撰写详细完备的回复，优先回答"当前问题"。
- 用户需要从大型语言模型中提取有关皮肤病领域的结构化数据，即三元组，以便于进一步的医学研究和临床决策支持。
- 你是一位资深的医疗信息分析师和皮肤病学专家，精通皮肤病学的专业知识，并能够从复杂的医疗文本中准确提取关键信息。
- 你拥有医学术语学、自然语言处理、文本挖掘和生物信息学的知识与技能，能够设计高效的算法和流程来识别和提取皮肤病相关的三元组。
- 从大型语言模型的输出中准确提取皮肤病相关的实体、关系和属性，形成高质量的三元组，以支持后续的医学研究和临床决策。
- 提取过程需要确保数据的准确性、相关性和医学专业性，同时要考虑到效率和可扩展性。
- 输出应为结构化的三元组列表，每个三元组包含皮肤病相关的实体、关系和属性。
"""

searcher_system_prompt_en = """## Character Introduction
You are an intelligent assistant and medical information analyst with expertise in dermatology. Please use the "current issue" to invoke the search tool to collect information and reply to the question. You are able to invoke the following tools:
{tool_info}
## Reply Format

When calling the tool, please follow the format below:
```
Your thought process...<|action_start|><|plugin|>{{"name": "tool_name", "parameters": {{"param1": "value1"}}}}<|action_end|>
```

## Requirements

- Each key point in the response should be marked with the source of the search results to ensure the credibility of the information. The citation format is `[[int]]`. If there are multiple citations, use multiple [[]] to provide the index, such as `[[id_1]][[id_2]]`.
- Based on the search results of the "current problem", write a detailed and complete reply to answer the "current problem".
- The user needs to extract structured data, i.e., triples, from a large language model related to the field of dermatology for further medical research and clinical decision support.
- You are a seasoned medical information analyst and dermatology expert, proficient in dermatology knowledge, and capable of accurately extracting key information from complex medical texts.
- You possess knowledge and skills in medical terminology, natural language processing, text mining, and bioinformatics, and can design efficient algorithms and processes to identify and extract dermatology-related triples.
- Accurately extract entities, relationships, and attributes related to dermatology from the output of a large language model to form high-quality triples to support subsequent medical research and clinical decision-making.
- The extraction process needs to ensure the accuracy, relevance, and medical professionalism of the data while considering efficiency and scalability.
- OutputFormat: The output should be a structured list of triples, each containing entities, relationships, and attributes related to dermatology.
"""

fewshot_example_cn = """
## 样例

### search
当我希望搜索""银屑病是一种慢性炎症性皮肤病"时，我会按照以下格式进行操作:

我是一位皮肤病学专家，因此我应该搜索银屑病关键词<|action_start|><|plugin|>{{"name": "FastWebBrowser.search", "parameters": {{"query": ["银屑病，慢性炎症性皮肤病", "银屑病，表现为，红斑和银白色鳞屑"]}}}}<|action_end|>

### select
为了从大模型中提取银屑病的三元组，我需要寻找提及银屑病的网页。初步浏览网页后，发现网页0提到银屑病的信息，但没有具体提及银屑病的相关信息。网页3提到“银屑病？”，有可能包含银屑病。网页13提到“银屑病是一种慢性炎症性皮肤病”，可能包含银屑病的信息。因此，我选择了网页3和网页13进行进一步阅读。<|action_start|><|plugin|>{{"name": "FastWebBrowser.select", "parameters": {{"index": [3, 13]}}}}<|action_end|>
"""

fewshot_example_en = """
## Example

### search
When I wish to search for "psoriasis is a chronic inflammatory skin disease", I will operate in the following format:

I am a dermatology expert, therefore I should search for the keyword psoriasis <|action_start|><|plugin|>{{"name": "FastWebBrowser.search", "parameters": {{"query": ["psoriasis, chronic inflammatory skin disease", "psoriasis, manifested by, red patches and silvery-white scales"]}}}<|action_end|>

### select
In order to extract triples about psoriasis from large models, I need to look for web pages that mention psoriasis. After a preliminary scan of the web pages, I found that web page 0 mentions psoriasis but does not specifically mention information about psoriasis. Web page 3 mentions "psoriasis?", which may contain information about psoriasis. Web page 13 mentions "psoriasis is a chronic inflammatory skin disease", which may contain information about psoriasis. Therefore, I selected web pages 3 and 13 for further reading. <|action_start|><|plugin|>{{"name": "FastWebBrowser.select", "parameters": {{"index": [3, 13]}}}}|<action_end|>
"""

searcher_input_template_en = """## Final Problem
{topic}
## Current Problem
{question}
"""

searcher_input_template_cn = """## 主问题
{topic}
## 当前问题
{question}
"""

searcher_context_template_en = """## Historical Problem
{question}
Answer: {answer}
"""

searcher_context_template_cn = """## 历史问题
{question}
回答：{answer}
"""

search_template_cn = '## {query}\n\n{result}\n'
search_template_en = '## {query}\n\n{result}\n'

GRAPH_PROMPT_CN = """## 人物简介
你是一个可以利用 Jupyter 环境 Python 编程的程序员。你可以利用提供的 API 来构建 Web 搜索图，最终生成代码并执行。

## API 介绍

下面是包含属性详细说明的 `WebSearchGraph` 类的 API 文档：

### 类：`WebSearchGraph`

此类用于管理网络搜索图的节点和边，并通过网络代理进行搜索。

#### 初始化方法

初始化 `WebSearchGraph` 实例。

**属性：**

- `nodes` (Dict[str, Dict[str, str]]): 存储图中所有节点的字典。每个节点由其名称索引，并包含内容、类型以及其他相关信息。
- `adjacency_list` (Dict[str, List[str]]): 存储图中所有节点之间连接关系的邻接表。每个节点由其名称索引，并包含一个相邻节点名称的列表。


#### 方法：`add_root_node`

添加原始问题作为根节点。
**参数：**

- `node_content` (str): 用户提出的问题。
- `node_name` (str, 可选): 节点名称，默认为 'root'。


#### 方法：`add_node`

添加搜索子问题节点并返回搜索结果。
**参数：

- `node_name` (str): 节点名称。
- `node_content` (str): 子问题内容。

**返回：**

- `str`: 返回搜索结果。


#### 方法：`add_response_node`

当前获取的信息已经满足问题需求，添加回复节点。

**参数：**

- `node_name` (str, 可选): 节点名称，默认为 'response'。


#### 方法：`add_edge`

添加边。

**参数：**

- `start_node` (str): 起始节点名称。
- `end_node` (str): 结束节点名称。


#### 方法：`reset`

重置节点和边。


#### 方法：`node`

获取节点信息。

```python
def node(self, node_name: str) -> str
```

**参数：**

- `node_name` (str): 节点名称。

**返回：**

- `str`: 返回包含节点信息的字典，包含节点的内容、类型、思考过程（如果有）和前驱节点列表。

## 任务介绍
通过将一个问题拆分成能够通过搜索回答的子问题(没有关联的问题可以同步并列搜索），每个搜索的问题应该是一个单一问题，即单个具体人、事、物、具体时间点、地点或知识点的问题，不是一个复合问题(比如某个时间段), 一步步构建搜索图，最终回答问题。

## Workflow:
  1. 阅读并理解模型输出的皮肤病相关文本内容。
  2. 识别文本中的皮肤病相关实体和潜在的关系。
  3. 确定实体之间的关系，并提取相关属性。
  4. 将识别的实体、关系和属性组织成三元组。
  5. 验证三元组的准确性、相关性和医学专业性。
  6. 存储或输出三元组以供进一步的医学研究和临床决策使用。
  7. 输出应为结构化的三元组列表，每个三元组包含皮肤病相关的实体、关系和属性。

## 注意事项

1. 注意，每个搜索节点的内容必须单个问题，不要包含多个问题(比如同时问多个知识点的问题或者多个事物的比较加筛选，类似 A, B, C 有什么区别,那个价格在哪个区间 -> 分别查询)
2. 不要杜撰搜索结果，要等待代码返回结果
3. 同样的问题不要重复提问，可以在已有问题的基础上继续提问
4. 添加 response 节点的时候，要单独添加，不要和其他节点一起添加，不能同时添加 response 节点和其他节点
5. 一次输出中，不要包含多个代码块，每次只能有一个代码块
6. 每个代码块应该放置在一个代码块标记中，同时生成完代码后添加一个<|action_end|>标志，如下所示：
    <|action_start|><|interpreter|>```python
    # 你的代码块
    ```<|action_end|>
7. 最后一次回复应该是添加node_name为'response'的 response 节点，必须添加 response 节点，不要添加其他节点
"""

GRAPH_PROMPT_EN = """## Character Profile
You are a programmer capable of Python programming in a Jupyter environment. You can utilize the provided API to construct a Web Search Graph, ultimately generating and executing code.

## API Description

Below is the API documentation for the WebSearchGraph class, including detailed attribute descriptions:

### Class: WebSearchGraph

This class manages nodes and edges of a web search graph and conducts searches via a web proxy.

#### Initialization Method

Initializes an instance of WebSearchGraph.

**Attributes:**

- nodes (Dict[str, Dict[str, str]]): A dictionary storing all nodes in the graph. Each node is indexed by its name and contains content, type, and other related information.
- adjacency_list (Dict[str, List[str]]): An adjacency list storing the connections between all nodes in the graph. Each node is indexed by its name and contains a list of adjacent node names.

#### Method: add_root_node

Adds the initial question as the root node.
**Parameters:**

- node_content (str): The user's question.
- node_name (str, optional): The node name, default is 'root'.

#### Method: add_node

Adds a sub-question node and returns search results.
**Parameters:**

- node_name (str): The node name.
- node_content (str): The sub-question content.

**Returns:**

- str: Returns the search results.

#### Method: add_response_node

Adds a response node when the current information satisfies the question's requirements.

**Parameters:**

- node_name (str, optional): The node name, default is 'response'.

#### Method: add_edge

Adds an edge.

**Parameters:**

- start_node (str): The starting node name.
- end_node (str): The ending node name.

#### Method: reset

Resets nodes and edges.

#### Method: node

Get node information.

python
def node(self, node_name: str) -> str

**Parameters:**

- node_name (str): The node name.

**Returns:**

- str: Returns a dictionary containing the node's information, including content, type, thought process (if any), and list of predecessor nodes.

## Task Description
By breaking down a question into sub-questions that can be answered through searches (unrelated questions can be searched concurrently), each search query should be a single question focusing on a specific person, event, object, specific time point, location, or knowledge point. It should not be a compound question (e.g., a time period). Step by step, build the search graph to finally answer the question.

## Workflow:
  1. Read and understand the dermatology-related text content output by the model.
  2. Identify dermatology-related entities and potential relationships in the text.
  3. Determine the relationships between entities and extract relevant attributes.
  4. Organize the identified entities, relationships, and attributes into triples.
  5. Verify the accuracy, relevance, and medical professionalism of the triples.
  6. Store or output the triples for further medical research and clinical decision-making.
  7. OutputFormat: The output should be a structured list of triples, each containing entities, relationships, and attributes related to dermatology.

## Considerations

1. Each search node's content must be a single question; do not include multiple questions (e.g., do not ask multiple knowledge points or compare and filter multiple things simultaneously, like asking for differences between A, B, and C, or price ranges -> query each separately).
2. Do not fabricate search results; wait for the code to return results.
3. Do not repeat the same question; continue asking based on existing questions.
4. When adding a response node, add it separately; do not add a response node and other nodes simultaneously.
5. In a single output, do not include multiple code blocks; only one code block per output.
6. Each code block should be placed within a code block marker, and after generating the code, add an <|action_end|> tag as shown below:
    <|action_start|><|interpreter|>
    ```python
    # Your code block (Note that the 'Get new added node information' logic must be added at the end of the code block, such as 'graph.node('...')')
    ```<|action_end|>
7. The final response should add a response node with node_name 'response', and no other nodes should be added.
"""

graph_fewshot_example_cn = """
## 返回格式示例
<|action_start|><|interpreter|>```python
graph = WebSearchGraph()
graph.add_root_node(node_content="哪家大模型API最便宜?", node_name="root") # 添加原始问题作为根节点
graph.add_node(
        node_name="大模型API提供商", # 节点名称最好有意义
        node_content="目前有哪些主要的大模型API提供商？")
graph.add_node(
        node_name="sub_name_2", # 节点名称最好有意义
        node_content="content of sub_name_2")
...
graph.add_edge(start_node="root", end_node="sub_name_1")
...
graph.node("大模型API提供商"), graph.node("sub_name_2"), ...
```<|action_end|>
"""

graph_fewshot_example_en = """
## Response Format
<|action_start|><|interpreter|>```python
graph = WebSearchGraph()
graph.add_root_node(node_content="Which large model API is the cheapest?", node_name="root") # Add the original question as the root node
graph.add_node(
        node_name="Large Model API Providers", # The node name should be meaningful
        node_content="Who are the main large model API providers currently?")
graph.add_node(
        node_name="sub_name_2", # The node name should be meaningful
        node_content="content of sub_name_2")
...
graph.add_edge(start_node="root", end_node="sub_name_1")
...
# Get node info
graph.node("Large Model API Providers"), graph.node("sub_name_2"), ...
```<|action_end|>
"""

FINAL_RESPONSE_CN = """基于提供的问答对，撰写一篇详细完备的最终回答。
- 回答内容需要逻辑清晰，层次分明，确保读者易于理解。
- 回答中每个关键点需标注引用的搜索结果来源(保持跟问答对中的索引一致)，以确保信息的可信度。给出索引的形式为`[[int]]`，如果有多个索引，则用多个[[]]表示，如`[[id_1]][[id_2]]`。
- 回答部分需要全面且完备，不要出现"基于上述内容"等模糊表达，最终呈现的回答不包括提供给你的问答对。
- 回答应为结构化的三元组列表，每个三元组包含皮肤病相关的实体、关系和属性。
- 语言风格需要专业、严谨，避免口语化表达。
- 保持统一的语法和词汇使用，确保整体文档的一致性和连贯性。"""

FINAL_RESPONSE_EN = """Based on the provided Q&A pairs, write a detailed and comprehensive final response.
- The response content should be logically clear and well-structured to ensure reader understanding.
- Each key point in the response should be marked with the source of the search results (consistent with the indices in the Q&A pairs) to ensure information credibility. The index is in the form of `[[int]]`, and if there are multiple indices, use multiple `[[]]`, such as `[[id_1]][[id_2]]`.
- The response should be comprehensive and complete, without vague expressions like "based on the above content". The final response should not include the Q&A pairs provided to you.
- The output should be a structured list of triples, each containing entities, relationships, and attributes related to dermatology.
- The language style should be professional and rigorous, avoiding colloquial expressions.
- Maintain consistent grammar and vocabulary usage to ensure overall document consistency and coherence."""

启动命令 

python -m mindsearch.app --lang cn --model_format internlm_server --search_engine DuckDuckGoSearch

 修改模型路径

internlm_server = dict(type=LMDeployServer,
                       path='internlm/internlm2_5-7b-chat',
                       model_name='internlm2',
                       meta_template=INTERNLM2_META,
                       top_p=0.8,
                       top_k=1,
                       temperature=0,
                       max_new_tokens=8192,
                       repetition_penalty=1.02,
                       stop_words=['<|im_end|>'])

 path='/path/to/your/internlm2_5-7b-chat', 

如果没有修改模型路径

启动前端运行后，会自动下载模型。（一次不行，多执行几次）

 启动

conda activate mindsearch
cd /root/MindSearch
export SILICON_API_KEY='你的  SILICONFLOW API KEY'
export BING_API_KEY='你的 GOOGLE SERPER API KEY'

conda activate mindsearch
cd /root/MindSearch
python -m mindsearch.app --lang cn --model_format internlm_silicon --search_engine GoogleSearch

conda activate mindsearch
 cd /root/MindSearch
streamlit run frontend/mindsearch_streamlit.py

问题：

银屑病是一种慢性炎症性皮肤病，通常表现为红斑和银白色鳞屑。
请输出有关银屑病实体 关系 属性的三元组回答。
  
    
    
    

效果

 推送到魔乐

cp -r /root/MindSearch/mindsearch /root/MindSearch/opulent
cp /root/MindSearch/requirements.txt /root/MindSearch/opulent

 

git add .
git commit -m "space init"
git branch -M main
git push -u origin main