springboot集成ollamai，设置请求超时时间

abments

于 2025-04-27 09:54:33 发布

阅读量195

点赞数 2

分类专栏：人工智能 java基础文章标签： spring boot 后端 java

本文链接：https://blog.csdn.net/abments/article/details/147548581

版权

java基础同时被 2 个专栏收录

19 篇文章

订阅专栏

人工智能

13 篇文章

订阅专栏

集成ollama-ai

引入依赖

        <dependency>
            <groupId>org.springframework.ai</groupId>
            <artifactId>spring-ai-starter-model-ollama</artifactId>
            <version>1.0.0-M7</version>
        </dependency>

配置ollama


spring:
  ai:
    ollama:
      baseUrl: http://xxx:11434
      chat:
        model: xxx
        options:
          max_tokens: xxx
          top_p: 0.9
          top_k: 40
          temperature: 0.7

# 设置客户端超时时间
  @Bean
    RestClient.Builder restClientBuilder(RestClientBuilderConfigurer restClientBuilderConfigurer) {
        RestClient.Builder builder = RestClient.builder()
                .requestFactory(ClientHttpRequestFactories.get(new ClientHttpRequestFactorySettings(Duration.ofMillis(60),
                        Duration.ofSeconds(60), (SslBundle)null)));
        return restClientBuilderConfigurer.configure(builder);
    }

客户端使用

@Slf4j
@Service
@RequiredArgsConstructor
public class OllamaTest {


    private final OllamaChatModel ollamaChatModel;

    public String call(String prompt){

        log.info("call:提示词: {}",prompt);
        String call = ollamaChatModel.call(prompt);
        log.info("call:返回结果: {}",response);
        return response;
    }
}