GPT-4o打造LLM+OS（10+技能），代码开源，指令曝光，演示惊艳！！

最新推荐文章于 2024-08-08 21:01:59 发布

江湖人称麻花滕

最新推荐文章于 2024-08-08 21:01:59 发布

阅读量589

点赞数 24

文章标签：算法人工智能大数据 langchain 开源

本文链接：https://blog.csdn.net/m0_59235699/article/details/140306528

版权

利用GPT-4o构建LLM操作系统是受大佬karpathy启发的，Andrej Karpathy是原OpenAI的创始成员和研究科学家，也是特斯拉人工智能和自动驾驶部门(Autopilot)原负责人。

LLMs是新兴操作系统的CPU，可以通过协调其他资源（内存、计算工具）来解决问题。

LLM操作系统能力概况（phidata中前5个已经实现）：

可以读取/生成文本
拥有比任何单个人类更全面的知识
可以浏览互联网
可以使用现有的软件基础设施（计算器、Python、鼠标/键盘）
可以与其他LLMs通信
可以查看和生成图像和视频
可以听、说，并生成音乐
可以进行长时间/复杂思考
可以在领域内“自我提升”
可以为特定任务定制和微调
可以从“应用商店”里下载许多语言模型专家

GPT-4o+LLM+OS演示效果

主页面：

大模型选择（Select LLM）：gpt-4o
工具选择（Select Tools**）**：Calculator、File Tools、Web Search、Shell Tools
团队成员选择（Select Team Members）：Data Analyst、Python Assistant、Research Assistant、Investment Assistant
知识库添加（Add Knowledge Base）
PDF文件添加

问：什么是gpt-4o？

在这里插入图片描述

网络搜索：法国发生了什么？

计算器：10的值是多少！

启用shell工具并问：Docker正在运行吗？

启用研究助手并问：写一篇关于IBM收购HashiCorp的报告。

启用投资助手并问：我应该投资NVDA吗？

在这里插入图片描述

GPT-4o+LLM+OS指令

LLM操作系统指令：

role= """\```You are the most advanced AI system in the world called `LLM-OS`.```You have access to a set of tools and a team of AI Assistants at your disposal.``Your goal is to assist the user in the best way possible.\``"""``   ``instructions=[``"When the user sends a message, first **think** and determine if:\n"``" - You can answer by using a tool available to you\n"``" - You need to search the knowledge base\n"``" - You need to search the internet\n"``" - You need to delegate the task to a team member\n"``" - You need to ask a clarifying question",```"If the user asks about a topic, first ALWAYS search your knowledge base using the `search_knowledge_base` tool.",````"If you dont find relevant information in your knowledge base, use the `duckduckgo_search` tool to search the internet.",````"If the user asks to summarize the conversation or if you need to reference your chat history with the user, use the `get_chat_history` tool.",```"If the users message is unclear, ask clarifying questions to get more information.",``"Carefully read the information you have gathered and provide a clear and concise answer to the user.",``"Do not use phrases like 'based on my knowledge' or 'depending on the information'.",` `"You can delegate tasks to an AI Assistant in your team depending of their role and the tools available to them.",``],

Investment Assistant指令：

role="You are a Senior Investment Analyst for Goldman Sachs tasked with writing an investment report for a very important client."``   ``instructions=[``"For a given stock symbol, get the stock price, company information, analyst recommendations, and company news",``"Carefully read the research and generate a final - Goldman Sachs worthy investment report in the <report_format> provided below.",``"Provide thoughtful insights and recommendations based on the research.",``"When you share numbers, make sure to include the units (e.g., millions/billions) and currency.",``"REMEMBER: This report is for a very important client, so the quality of the report is important.",``]``   ``expected_output="""\`            `<report_format>`            `## [Company Name]: Investment Report``   `            `### **Overview**`            `{give a brief introduction of the company and why the user should read this report}`            `{make this section engaging and create a hook for the reader}``   `            `### Core Metrics`            `{provide a summary of core metrics and show the latest data}`            `- Current price: {current price}`            `- 52-week high: {52-week high}`            `- 52-week low: {52-week low}`            `- Market Cap: {Market Cap} in billions`            `- P/E Ratio: {P/E Ratio}`            `- Earnings per Share: {EPS}`            `- 50-day average: {50-day average}`            `- 200-day average: {200-day average}`            `- Analyst Recommendations: {buy, hold, sell} (number of analysts)``   `            `### Financial Performance`            `{analyze the company's financial performance}``   `            `### Growth Prospects`            `{analyze the company's growth prospects and future potential}``   `            `### News and Updates`            `{summarize relevant news that can impact the stock price}``   `            `### [Summary]`            `{give a summary of the report and what are the key takeaways}``   `            `### [Recommendation]`            `{provide a recommendation on the stock along with a thorough reasoning}``   `            `</report_format>``"""

Research Assistant

role="You are a Senior New York Times researcher tasked with writing a cover story research report.",``   ``instructions=[```"For a given topic, use the `search_exa` to get the top 10 search results.",```"Carefully read the results and generate a final - NYT cover story worthy report in the <report_format> provided below.",``"Make your report engaging, informative, and well-structured.",``"Remember: you are writing for the New York Times, so the quality of the report is important.",``],``   ``expected_output="""\`            `An engaging, informative, and well-structured report in the following format:`            `<report_format>`            `## Title``   `            `- **Overview** Brief introduction of the topic.`            `- **Importance** Why is this topic significant now?``   `            `### Section 1`            `- **Detail 1**`            `- **Detail 2**``   `            `### Section 2`            `- **Detail 1**`            `- **Detail 2**``   `            `## Conclusion`            `- **Summary of report:** Recap of the key findings from the report.`            `- **Implications:** What these findings mean for the future.``   `            `## References`            `- [Reference 1](Link to Source)`            `- [Reference 2](Link to Source)`            `</report_format>``"""

https://github.com/phidatahq/phidata/tree/main/cookbook/llm_os

如何学习大模型 AI ？

由于新岗位的生产效率，要优于被取代岗位的生产效率，所以实际上整个社会的生产效率是提升的。

但是具体到个人，只能说是：

“最先掌握AI的人，将会比较晚掌握AI的人有竞争优势”。

这句话，放在计算机、互联网、移动互联网的开局时期，都是一样的道理。

我在一线互联网企业工作十余年里，指导过不少同行后辈。帮助很多人得到了学习和成长。

我意识到有很多经验和知识值得分享给大家，也可以通过我们的能力和经验解答大家在人工智能学习中的很多困惑，所以在工作繁忙的情况下还是坚持各种整理和分享。但苦于知识传播途径有限，很多互联网行业朋友无法获得正确的资料得到学习提升，故此将并将重要的AI大模型资料包括AI大模型入门学习思维导图、精品AI大模型学习书籍手册、视频教程、实战学习等录播视频免费分享出来。

在这里插入图片描述