chatgpt 4V 识图功能

三块钱0794

已于 2023-10-18 08:46:43 修改

阅读量934

点赞数 2

文章标签： chatgpt chatgpt 4v 多模态识图

于 2023-10-17 09:00:02 首次发布

本文链接：https://blog.csdn.net/jxyk2007/article/details/119003179

版权

1.获取图片的sig和file_id

2e0edc6e489ed13a3f32f0dd87527d77.jpg是本地图片的名字

头部认证信息自己F12 抓取

1.获取图片的sig

https://chat.openai.com/backend-api/files

Authorization:Bearer eyJhbGc****************5V-lztYwLb9hr6LP7g
Cookie:  *************************D


{"file_name":"2e0edc6e489ed13a3f32f0dd87527d77.jpg","file_size":51010,"use_case":"multimodal"}

返回{
    "status": "success",
    "upload_url": "https://fileserviceuploadsperm.blob.core.windows.net/files/file-KVRbTP1Xy0NP1WKKZRDKSPL1?se=2023-10-16T11%3A24%3A03Z&sp=c&sv=2021-08-06&sr=b&sig=oXzcBB7Q8HWyZr6JUSbuUYtgwgOWVdia7EiO8ALBe%2Bw%3D",
    "file_id": "file-KVRbTP1Xy0NP1WKKZRDKSPL1"
}

2.上传二进制图片

注意Content-Type: image/jpeg的类型根据图片实际情况设置

https://fileserviceuploadsperm.blob.core.windows.net/files/file-KVRbTP1Xy0NP1WKKZRDKSPL1?se=2023-10-16T11%3A24%3A03Z&sp=c&sv=2021-08-06&sr=b&sig=oXzcBB7Q8HWyZr6JUSbuUYtgwgOWVdia7EiO8ALBe%2Bw%3D


Accept: application/json, text/plain, */*
Accept-Encoding: gzip, deflate, br
Accept-Language: zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6
Connection: keep-alive

Content-Type: image/jpeg
Host: fileserviceuploadsperm.blob.core.windows.net
Origin: https://chat.openai.com
Sec-Fetch-Dest: empty
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.60
sec-ch-ua: "Microsoft Edge";v="117", "Not;A=Brand";v="8", "Chromium";v="117"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "Windows"
x-ms-blob-type: BlockBlob
x-ms-version: 2020-04-08
无返回

3.put图片

将图片以二进制流上传

https://fileserviceuploadsperm.blob.core.windows.net/files/file-KVRbTP1Xy0NP1WKKZRDKSPL1?se=2023-10-16T11%3A24%3A03Z&sp=c&sv=2021-08-06&sr=b&sig=oXzcBB7Q8HWyZr6JUSbuUYtgwgOWVdia7EiO8ALBe%2Bw%3D
Accept: application/json, text/plain, */*
Accept-Encoding: gzip, deflate, br
Accept-Language: zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6
Connection: keep-alive
Content-Length: 51010
Content-Type: image/jpeg
Host: fileserviceuploadsperm.blob.core.windows.net
Origin: https://chat.openai.com
Sec-Fetch-Dest: empty
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.60
sec-ch-ua: "Microsoft Edge";v="117", "Not;A=Brand";v="8", "Chromium";v="117"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "Windows"
x-ms-blob-type: BlockBlob
x-ms-version: 2020-04-08

4.上传二进制图片

4.上传二进制图片
https://chat.openai.com/backend-api/files/file-KVRbTP1Xy0NP1WKKZRDKSPL1/uploaded

Authorization:Bearer eyJ*****tYwLb9hr6LP7g
Cookie:  *HS%2BvXw%3D

提交空
{}

返回
{
    "status": "success",
    "download_url": "https://fileserviceuploadsperm.blob.core.windows.net/files/file-KVRbTP1Xy0NP1WKKZRDKSPL1?se=2023-10-16T11%3A34%3A11Z&sp=r&sv=2021-08-06&sr=b&rscd=attachment%3B%20filename%3D2e0edc6e489ed13a3f32f0dd87527d77.jpg&sig=LJbEvMeV6KtlkTi6Y1udDd%2BK3YSbgfUWnsGCEi5rGSs%3D",
    "metadata": null
}

5.和chatgpt问题绑定，提问

https://chat.openai.com/backend-api/conversation
Authorization:Bearer eyJhbGciOiJSU******%3D


{
	"action": "next",
	"messages": [{
		"id": "aaa27270-f62e-454a-962c-f62794152450",
		"author": {
			"role": "user"
		},
		"content": {
			"content_type": "multimodal_text",
			"parts": [{
				"asset_pointer": "file-service://file-KVRbTP1Xy0NP1WKKZRDKSPL1",
				"size_bytes": 239505,
				"width": 1706,
				"height": 1280
			}, "再看看"]
		},
		"metadata": {}
	}],
	"conversation_id": "41181b17-b71d-4748-8db5-3a80d7a27a33",
	"parent_message_id": "49bd950f-372f-45f6-9f72-b6f27fa04373",
	"model": "gpt-4",
	"timezone_offset_min": -480,
	"suggestions": [],
	"history_and_training_disabled": false,

	"force_paragen": false
}

返回答案