SpringBoot 接入阿里云百炼(通入千问) 并实现流式输出内容

卖女孩的小火柴er

已于 2024-06-12 10:25:02 修改

阅读量1.8k

点赞数 12

文章标签： spring boot 前端 java

于 2024-06-12 10:17:27 首次发布

本文链接：https://blog.csdn.net/m0_65408235/article/details/139618719

版权

一：引入Maven依赖

<dependency>
            <groupId>com.aliyun</groupId>
            <artifactId>broadscope-bailian-sdk-java</artifactId>
            <version>1.2.0</version>
</dependency>

二：编写阿里云百炼Client类

配置文件加入如下配置

相关参数请从阿里云百炼官网获取

yun:
  bailian:
    accessKeyId:  **************************
    accessKeySecret:  **************************
    agentKey:   **************************
    appId: **************************

@Component
public class BaiLianClient {
    @Resource
    private AlbaiLianConfig baiLianConfig;
    private AccessTokenClient accessTokenClient;
    @Resource
    private ChatCustomerInfoMapper chatCustomerInfoMapper;
    @PostConstruct
    public void init(){
        String accessKeyId = baiLianConfig.getAccessKeyId();
        String agentKey = baiLianConfig.getAgentKey();
        String accessKeySecret = baiLianConfig.getAccessKeySecret();
        accessTokenClient = new AccessTokenClient(accessKeyId,accessKeySecret,agentKey);
    }
    public Flux<CompletionsResponse> createStreamCompletion(ChatCustomerInfo chatCustomerInfo) {
        String content = chatCustomerInfo.getInfoContent();
        String token = accessTokenClient.getToken();
        BaiLianConfig config = new BaiLianConfig()
                .setApiKey(token);
        CompletionsRequest request = new CompletionsRequest()
                .setAppId(baiLianConfig.getAppId())
                .setPrompt(content)
                .setStream(true);
        ApplicationClient client = new ApplicationClient(config);
        chatCustomerInfoMapper.sendInfo(chatCustomerInfo.getUserId(),chatCustomerInfo.getInfoContent(),false);
        Flux<CompletionsResponse> flux = client.streamCompletions(request);
        return client.streamCompletions(request);
    }
}

三：编写Controller层

为了更快实现功能，本人只是简单调用回复消息接口，并将历史消息保存到数据库表中，具体复杂API请参考阿里云百炼官网手册，后端流式输入采用FLux实现，<