llama-index,uncharted and llama2:7b run locally to generate Index

最新推荐文章于 2024-09-26 18:36:01 发布

营赢盈英

最新推荐文章于 2024-09-26 18:36:01 发布

阅读量752

点赞数 11

分类专栏： AI 文章标签： llama ai python machinelearning huggingface ollama llama3

本文链接：https://blog.csdn.net/suiusoar/article/details/140507327

版权

AI 专栏收录该内容

362 篇文章 4 订阅 ¥19.90 ¥99.00

订阅专栏

超级会员免费看

题意：本地运行 llama-index、uncharted 以及 llama2:7b 来生成索引

问题背景：

I wanted to use llama-index locally with ollama and llama3:8b to index utf-8 json file. I dont have a gpu. I use uncharted to convert docs into json. Now If it is not possible to use llama-index locally without GPU I wanted to use hugging face inference API. But I am not certain if it is free. Can anyone suggest a way?

This is my python code:

from llama_index.core import Document, SimpleDirectoryReader, VectorStoreIndex
    from llama_index.llms.ollama import Ollama
    import json
    from llama_index.core import Settings
    
    
    # Convert the JSON document into LlamaIndex D

了解本专栏