一、前言
Embedding 嵌入模型与自然语言处理紧密相关。在词表示方面，它能捕捉语义信息，解决一词多义问题，让计算机更好理解词汇关系。在文本分类和情感分析中，将文本转为向量后可提高准确性。机器翻译里，帮助确定不同语言词汇对应关系及理解句子语义。信息检索和推荐系统中，通过向量计算相似度以找到相关文档和推荐物品。此外，在语言模型和文本生成任务中，它助力提高预测准确性并生成自然流畅的文本内容，极大地推动了自然语言处理的发展。
二、术语
2.1.向量
是数学和物理学中的一个重要概念。它是具有大小和方向的量，可以用一组有序的数值来表示。在几何中，向量可以表示空间中的位移、速度、力等。向量的大小称为模，方向可以用角度或特定的方向描述。在数学运算中，向量可以进行加法、减法、数乘等操作。向量的概念在很多领域都有广泛应用，如计算机图形学用于描述物体的移动和变形，机器学习中用于表示数据的特征，工程学中用于分析力和运动等。
2.2.Embedding 嵌入模型
是一种将高维数据映射到低维连续向量空间的技术。它通过神经网络或其他机器学习算法，为数据点（如单词、图像、用户行为等）生成低维向量表示。这些向量具有语义相似性，即相似的数据在向量空间中距离较近，同时采用分布式表示。Embedding 模型在自然语言处理、推荐系统、计算机视觉等领域广泛应用，可降维、捕捉语义信息且具有通用性，能有效提高机器学习模型的性能和效率。
OpenAI提供的Embedding models模型：
https://platform.openai.com/docs/guides/embeddings/use-cases
2.3.LangChain
是一个基于语言模型（LLM）的应用开发框架。主要功能包括：能连接不同的语言模型提供商，如 OpenAI、Azure OpenAI、HuggingFace 等；提供缓存支持、用量记录；有提示词管理、大量文档加载器、索引支持等。
它包含多个组件，如模型、提示词、索引、内存、链、代理等。通过这些功能和组件，开发者可以将语言模型与其他数据源相连接，让语言模型拥有数据感知能力，还能使语言模型与其环境互动，实现代理功能。LangChain 可用于构建各种基于 LLM 的应用，如聊天机器人、智能问答、内部知识库、摘要生成等
2.4.余弦相似度
是一种衡量两个向量之间相似程度的指标。它通过计算两个向量的夹角余弦值来确定相似度，取值范围在 - 1 到 1 之间。值越接近 1，表示两个向量越相似；值接近 0 表示它们不太相关；值接近 -1 则表示它们方向相反。在实际应用中，余弦相似度广泛用于文本分析、图像识别、推荐系统等领域，比如衡量文本之间的语义相似性、计算图像特征向量的相似程度等，是一种简单而有效的相似性度量方法。
2.5.欧式距离
是一种衡量空间中两个点之间距离的度量方式。它在数学上是通过计算各个维度上对应数值之差的平方和的平方根得到。欧式距离的值越小，表明两个点在空间中的位置越接近；值越大，则两点距离越远。在实际应用中，欧式距离广泛用于数据分析、机器学习、模式识别等领域，比如在聚类分析中衡量样本间的差异，在图像识别中比较图像特征的相似性等，是一种常见且直观的距离度量方法。
三、前提条件
3.1. 基础环境
- 操作系统：不限
3.2. 安装依赖库
conda create --name langchain python=3.10
conda activate langchain
pip install langchain langchain-openai四、技术实现
4.1.LangChain集成 OpenAI 的 Embedding Model步骤
1. 安装依赖库，参见3.2.安装依赖库
2. 获取OpenAI的API密钥
3. 创建嵌入模型实例
4. 嵌入文本得到向量
4.2.嵌入单个文档
import os
import numpy as np
from langchain_openai import OpenAIEmbeddings
os.environ["OPENAI_API_KEY"] = 'sk-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' # 你的Open AI Key
# 嵌入单个文档
def embed_query(str):
query_vector = embeddings.embed_query(str)
return query_vector
if __name__ == '__main__':
embeddings = OpenAIEmbeddings(model="text-embedding-3-small")
str = '广州有什么特产？'
query_vector = embed_query(str)
print(query_vector)
调用结果：
[0.010850468988100267, -0.02266416388422921, 0.05103969667240343, 0.026811706297863582, 0.008646378751870108, -0.028126227061816146, -0.003238142523691153, 0.03737320546464569, 2.979098117774243e-05, -0.042744615570424783, 0.004161707363557951, 0.010867466555479552, -0.021258986323178703, -0.0039039023878489716, -0.017825365953859983, -0.03832510276549659, -0.08435602024580278, -0.0200917821560184, 0.0029888365645024477, -0.005569718473386687, 0.03447219540809179, -0.011071443883288658, -0.01579692314559177, 0.031389868032051904, -0.0048954595927085945, -0.02139497058750309, -0.022437522822806883, -0.016941462647816326, -0.026811706297863582, 0.015456959690813229, -0.022630168749470637, -0.018301312741640385, 0.051674296114734064, 0.0038727391720542125, -0.012782588833036604, -0.013666491207757737, 0.031480522966504804, -0.013893133200502589, 0.03762251305364881, 0.007320525189788406, 0.0014590055581963275, 0.022947466607990904, -0.012215984316835739, -0.042676621575617545, 0.03340697850785225, 0.018052007015282312, -0.028964802900633357, 0.036557296153409274, -0.060739960923367725, 0.026947690562187966, 0.04460307711696499, -0.0011084193222976276, 0.03363362143191962, -0.11640314865983098, -0.003493114416283164, -0.03318033558378487, -0.04177005360463814, 0.045464312032782804, 0.009768254520481441, -0.034608179672416174, 0.01627286993337217, -0.039141012076733005, 0.023128780202186786, 0.06898971269547488, -0.0571590220946117, -0.03814378917130071, -0.016408854197696558, -0.013281200285752753, -0.016476848192503796, 0.013961125332664782, 0.008091106568137114, -0.00215592852173359, 0.048320000210045407, -0.03270438879600447, -0.018063339347750184, 0.0043656846913670555, 0.00785879934048085, -0.023638723987370807, -0.0023485739827360827, -0.038755720223405496, -0.04827467088017391, 0.024817260486998987, 0.0011367494549754185, 0.014629718047108938, -0.004419511873605669, -0.05452998056670657, 0.05076772814375466, -0.0377131679881017, -0.03762251305364881, 0.03086859191440001, -0.012227316649303613, -0.03447219540809179, 0.0343815367483488, -0.012476622375661687, -0.01321320815359056, 0.05022378736116701, 0.06178251315867152, 0.016000899542078346, -0.0025610505598960918, 0.06472885254509692, 0.03857440662920962, -0.05607114425472651, -0.024250655039475596, 0.03410956821970003, -0.0034676171338917107, 0.04859196873869418, -0.007745478344108425, 0.03605868470069313, 0.02690236309496152, 0.0295314064855117, 0.011706040531651717, -0.006691594707659284, -0.022550844284840568, 0.05117568466201791, -0.010765478357236263, 0.010680487726372258, -0.01885658399405085, -0.06518213839323167, 0.01632952973306649, 0.004844465027925687, -0.014516397516397776, 0.0309819133764337, -0.038211779440817856, -0.009683263889617438, -0.029554071150447447, 0.0008761116289801017, 0.016057561204417717, -0.005246753982971221, -0.03635331789427765, -0.02459061756293161, -0.015298310761553096, -0.04419512059870174, -0.004215534545796565, -0.02574649126026909, 0.02260750408453489, 0.010816471990696646, -0.05457530617128797, 0.0178820257535543, -0.028398197453109966, -0.0023995683146883586, 0.01950251390620431, -0.009688930055851374, -0.003796247557710483, -0.006391294416518302, 0.020352420214844347, -0.06794716791075128, -0.03984360178858078, 0.024318649034282838, -0.026086453783725105, 0.047050805050674244, -0.02409200611021546, -0.029100787164957745, -0.05842821725398286, -0.0542126827081863, -0.02040908001453867, -0.01568360168355808, -0.00036581376661411614, 0.007649155380776548, -0.0044960037207800296, -0.013111219024024746, 0.003085159295003694, -0.0005074647792490172, -0.0016870637432537163, -0.035084126460196575, 0.013099886691556872, -0.05045043028523439, -0.058156245000043995, -0.002372654723569052, -0.01946851690880069, -0.06318769258236707, 0.028239548523849835, -0.03261373386155158, 0.01801801001787869, 0.012646603637389694, -0.004379849641290635, 0.005371406846150258, -0.00288826444215638, -0.005770862718078823, -0.022766153013795025, -0.050722398813883164, 0.010895797386649237, 0.012034671653962381, -0.000412912754799705, -0.014448404452913058, -0.03152585229637629, 0.009014671175173282, 0.03354296277217664, 0.0018315478390055857, -0.007728479845406614, 0.0649101698645829, -0.004668818065625005, 0.032341761607612714, 0.04995181883251824, -0.007785140576423458, 0.02361605932243506, -0.04668817786228248, -0.009898573549894416, 0.0002441709669353713, 0.029848704344031966, 0.006175984756241325, -0.0382344441057536, 0.01408577819584382, 0.03748652878932442, -0.009671932488472089, -0.03363362143191962, -0.04036487790623268, 0.023457410393174928, 0.05466596483103095, 0.004671650683080711, -0.03716923093080416, 0.01928720331460481, 0.0030454970626886606, -0.013383189415318568, 0.08186295925693195, 0.010414183501312374, 0.011955346258009791, 0.060196020140780085, 0.050677073209301766, 0.01651084332726237, 0.06735789407300205, -0.006532945312737888, -0.017156773239415828, 0.00452433362062719, 0.008436735257827066, 0.04580427455623882, 0.021021012929288502, -0.06454754267619113, -0.023140112534654658, 0.0025213883275810585, -0.06259841874461784, -0.023842700383857388, 0.004122044665581656, -0.038211779440817856, -0.04050086217055707, -0.01500367663664605, 0.04294859010426631, 0.009541613459059115, 0.02644907910947182, 0.044013807004505856, -0.024749268354836793, 0.0032069793078963937, 0.010578498596806445, 0.024386641166445032, -0.0188792486589866, 0.050677073209301766, 0.030732607650075624, -0.030324651131812368, 0.021077672728982824, -0.0074678422522419284, 0.015015008969113924, -0.029486077155640205, 0.0009958067131197598, 0.0037622512587987553, 0.007105215529511428, -0.004025722167911041, 0.007428180019926895, -0.036104014030564624, -0.05004247376697113, 0.01481103164130482, -0.0310045761787244, 0.008935346710543215, 0.007592495115420966, -0.04281260583994193, -0.018516621470594838, 0.011400075005599322, 0.015184990230841931, -0.011864690392234374, -0.021496959717068904, -0.03136720336711616, 0.003340131187595705, 0.01087313272171349, -0.02029575855250498, 0.024839923289289686, -0.03973027846390205, -0.008011782103507047, -0.018029342350346565, -0.01704345177738214, -0.013145215090105843, 0.023094783204783163, 0.014969680570564954, -0.047504087173518894, 0.0069352342677834215, 0.019400524776638495, -0.05561785840659176, -0.018437297005964772, 0.01678281371855619, 0.05575384267091615, -0.010748479858534452, -0.016204877801209976, 0.013054558293007902, 0.02508922901564776, -0.03352029810724089, -0.014346416254669769, 0.001092837714400248, 0.042653956910681794, -0.031389868032051904, -0.007807804775697943, 0.016012231874546222, -0.021610281179102592, -0.030573956858170444, 0.02456795476064091, 0.007989118369893824, -0.023015458740153098, 0.03388292529563265, -0.022006903502252928, 0.004243864911304986, -0.04054619150042856, 0.02209756029935087, -0.040319548576361185, -0.008346078460729125, 0.0161935454687421, -0.04081816002907734, 0.017270092838804468, -0.025043901548421312, -0.028262213188785582, -0.00660660407679528, -0.005685872087214819, -0.015524952754297947, 0.025111893680583506, -0.02885148143859967, -0.007989118369893824, 0.012408630243499493, 0.041475420411053614, 0.03850641635969247, -0.05262618969029487, -0.0030398311292853548, 0.028602175712241596, -0.019933133226758264, -0.04154341440586086, -0.029191443962055686, 0.0112470913112506, 0.03535609498884535, -0.02830754065601203, 0.03449485634773744, -0.02036375254731222, -0.011258423643718474, -0.012431293977112717, 0.03023399433471443, 0.02642641630718112, 0.023321424266205492, -0.014969680570564954, -0.025474520868975267, 0.01955917370589863, 0.018686602732322845, 0.014697710179271132, 0.006345966017969332, 0.04927189378560621, 0.06563541679078623, -0.032341761607612714, -0.029871369008967714, 0.03347497250265949, 0.0033486302041159793, -0.012827917231585575, -0.0031276546104356956, 0.008442401424061002, -0.06391294695915059, -0.008442401424061002, -0.01630686693077579, -0.03216044801341683, 0.007014558732413488, 0.015422963624732132, -0.025225215142617195, 0.024545290095705163, -0.0023315759496955342, -0.016590167791892436, -0.006884239703000514, -0.01032919287044837, 0.015887579942689706, 0.005578217257076331, 0.014981012903032827, -0.020941688464658437, 0.043515195551789704, -0.008147767299153959, -0.005932345196117187, 0.04215534545796565, 0.007484840285282477, 0.01896990545608454, 0.0285568463823701, -0.011337748108348542, -0.03209245774389968, -0.013745815672387805, -0.004739643280904167, -0.016556172657133866, 0.0013407270156151536, 0.047821385032039164, -0.03957162953464192, 0.034313546478831655, 0.009150656370820192, -0.02142896758490671, -0.04192870253389827, -0.021021012929288502, -0.06708592554435328, -0.0033939586026649495, 0.017451406433000347, -0.047413432239066, -0.001259277622232045, 0.047141459985127136, -0.04995181883251824, -0.04292592543933057, 0.026789041632927835, 0.013723151938774582, -0.03988892739316218, 0.014029117464826976, -0.006226979321024231, 0.028126227061816146, 0.013632495141676642, -0.05539121920781448, 0.01979714709978883, 0.006810581404604384, -0.016284202265840042, 0.0028585177679201048, 0.03456285034254468, 0.025225215142617195, 0.0706215387685279, -0.02040908001453867, -0.017202100706642274, -0.0071675419611009475, 0.004187204180288143, 0.009144990204586256, -0.017145440906947952, 0.02554251300113746, 0.0372372212003213, -0.06713125487422476, 0.0015227485313443303, -0.02307211853984742, 0.03308968064933198, -0.020828367002624748, -0.028760824641501728, -0.03222844200822407, -0.03041530792891031, 0.023253432134043298, -0.0031928141251421826, 0.050903712408079047, 0.015343639160102064, -0.058473542858564265, -0.02699301989205946, -0.05829222926436838, 0.04385515807524572, -0.012340637180014775, -0.0012451125558931495, -0.03299902198958899, -0.04027421924648969, -0.013609830476740895, 0.009688930055851374, -0.02003512049367903, -0.008833358512299924, 0.0007273780249680952, 0.037101236935996915, 0.019139886717812547, -0.07016825292039315, 0.03735054452500004, -0.007473508418475865, -0.016760149053620443, -0.01669215692145825, -0.02409200611021546, 0.0523088918317746, 0.035106791125132326, 0.01564960468615446, -0.0190945592505861, -0.05629778345350379, 0.02592780485446497, -0.010788142090849486, -0.04224600411770863, 0.025587842331008956, -0.014697710179271132, -0.016102888671644163, 0.040863489358948825, -0.02749163134477561, 0.07950588625767559, 0.003419455885056403, -0.030959248711497953, 0.018992570121020288, 0.014006453731213753, 0.01621621013367785, 0.03061928618804194, 0.01093545961896427, 0.021972906504849305, 0.014686378778125782, -0.007241200725158339, -0.022437522822806883, 0.017916022750957925, 0.010482175633474568, 0.026653057368603447, -0.04007024098735806, -0.019876471564418897, 0.026857035627735074, -0.008017448269740985, -0.020998348264352755, -0.0716640910038317, -0.05339676967165979, -0.0006696552370283347, -0.00720720419341598, 0.01867527226250002, -0.009762588354247505, 0.056433767717828175, 0.0755169946359464, -0.031163225107984534, -0.030166002202552236, -0.04254063731129316, 0.023253432134043298, 0.035084126460196575, -0.0056235456556253, 0.012510618441742782, 0.0018683771046189663, 0.010289530638133338, -0.03263639480119723, 0.004589493135333677, -0.03707857227106117, 0.026607728038731952, -0.012057335387575604, 0.021451632249842457, 0.007212870359649917, 0.012136659852205672, -0.010601163261742192, 0.029508741820575952, 0.024160000105022703, -0.007076885164003007, 0.04272195090548903, -0.005765197017506148, 0.007150543928060399, 0.05530056054807149, -0.015298310761553096, 0.0055867165064272355, -0.007416847687459022, -0.02857951104730585, 0.004742476364021135, -0.021123002058854316, -0.015411631292264258, -0.03497080686080794, -0.049543862314254984, 0.013167879755041589, -0.05149298252053818, -0.018595945935224907, -0.03077793511730207, 0.00966626632223815, -0.005093770754283761, -0.016590167791892436, -0.06631534183769826, 0.012238648981771485, 0.0010496341281890041, 0.005598048373233847, 0.003433620834979983, 0.002903846166469075, -0.003178648942387972, -0.011592720000940552, -0.02785425853316737, -2.143578486577989e-05, -0.021236321658242956, -0.003238142523691153, -0.007416847687459022, 0.036262662959824755, -0.009796585351651125, 0.0068729078361939025, -0.04890926659721445, 0.02429598436934709, 0.026698384835829893, -0.06033200440510447, 0.027536958812002056, 0.012204652915690388, -0.009864577483813319, 0.04292592543933057, 0.010856135154334203, -0.004631988450765678, 0.007943789971344853, -0.013009229894458931, 0.049317223115477704, 0.00807977423566924, 0.03857440662920962, 0.009161988703288066, 0.027944915330265312, -0.0247039390249653, 0.03324832957859211, 0.017292757503740215, 0.005164596435224185, -0.011116772281837627, 0.023525402525337122, 0.10289530638133337, -0.027378309882741925, -0.02361605932243506, 0.015615609551395886, 0.011564390101093393, -0.0038954031384980667, -0.029463414353349506, -0.015128329499825087, 0.025361199406941582, -0.02319677233434898, 0.03934499033586464, 0.002810356286254166, 0.06114791371634089, -0.03012067473532579, -0.02964472608490034, -0.00692390240097681, -0.04136210081166498, -0.03474416393674056, 0.024726603689901046, -0.028806152108728177, -0.022346866025708942, 0.0016941463346308219, -0.021077672728982824, 0.004971950974221693, 0.014097110528311694, 0.01981981176472458, -0.029259436094217876, 0.005994671627706705, -0.007830468509311166, -0.015944239742384028, -0.0067369226405469915, 0.0012274061356580435, -0.00995523428091126, -0.003274971672889218, 0.0005963508411911947, 0.025837148057367032, -0.025587842331008956, -0.05661508131202406, -0.027174333486255343, -0.008646378751870108, -0.04371917381092133, -0.00711654739631804, -0.01592157507744828, 0.007195872326609369, 0.01810866681497663, -0.01141707257297861, 0.001191285140823905, -0.0348574835361292, -0.007637823513969936, 0.02989403367390346, 0.023276096798979046, -0.0058813506313342805, 0.021576284181698973, -0.010663489227670448, 0.00850472738998926, 0.0009023170657354818, -0.0001869793529762135, -0.004147541947973109, -0.009977898014524483, 0.0029208441995096234, -0.000502861135599259, -0.01018187627365611, 0.02402401397805327, -0.00624397735406478, 0.035628067242784216, 0.025021236883485565, -0.028035572127363254, -0.0155022880893622, 0.0028556846848031363, -0.011213095245169504, -0.010765478357236263, 0.01908322691811823, 0.045237672834005524, 0.0007897044565576138, 0.05398603978411892, 0.009161988703288066, 0.0029973358138533526, 0.01739474663330603, -0.001146665013054177, 0.012929905429828865, 0.008153433465387895, 0.009802251517885063, -0.022856809810892963, 0.0658620634401437, -0.007921125306409108, 0.030347315796748115, 0.011065778648377244, 0.0009016087949562396, 0.007343189389062891, 0.020465739814232987, 0.015196322563309805, -0.009983564180758419, 0.005110769252985572, -0.00989290738366048, 0.07266131390926399, 0.004532832869978094, 0.0003760834891863244, 0.017576060227501907, 0.036965252671672534, -0.002861350851037073, 0.012136659852205672, -0.017734709156762042, -0.010153545442486426, -0.011332081942114604, 0.03691992334180104, 0.020114444958309097, -0.03478949326661206, 0.011876021793379724, -0.04333388195759382, -0.01623887293596855, 0.0309819133764337, 0.006119324490885742, -0.02576915406255979, -0.019264540512314108, -0.0036999248272092367, 0.03145785830156905, 0.03347497250265949, 0.004592326218450645, 0.0007719980945301656, -0.00880502768113024, 0.004249530611877661, -0.004954952941181145, 0.020760374870462554, 0.04129410681685774, 0.01759872302979261, -0.01486769144099914, 0.02307211853984742, -0.0033061348886839776, -0.015864915277753962, 0.011898686458315471, 0.004294859010426632, 0.003189981042025214, 0.011694709130506367, 0.016714821586393997, 0.00950195122674408, 0.006787917205329899, -0.0018825421709578619, -0.024953244751323374, 0.03136720336711616, -0.000876819841551686, 0.016737486251329745, 0.014527728917543125, 0.013190543488654814, -0.021474295052133156, -0.010612494662887542, 0.009649267823536341, -0.022074895634415122, -0.0247039390249653, -0.004552663986135611, 0.013983789066278006, 0.014391744653218737, -0.0021672606213708327, -0.014346416254669769, 0.028874146103535416, -0.00270695108079113, -0.03311234531426773, 0.011932682524396568, 0.026494408439343312, -0.005847354565253184, 0.0006671763475086451, -0.004116378965008981, -0.06513680906336017, -0.031117897640758087, -0.03358829210204813, 0.021179661858548637, 0.02257350708713127, -0.024341311836573537, -0.06318769258236707, -0.004801969712493685, -0.014403076054364089, 0.0006855909803153354, -0.012170655918286769, -2.605050979837812e-05, 0.0034251218184597086, -0.011422738739212545, 0.006436622815067273, 0.00740551582065241, -0.0047283114140975555, 0.014301087856120798, -0.005464896726365166, 0.0050597746882026645, -0.017587390697324734, -0.004309024426011473, 0.02409200611021546, -0.00887868597952637, -0.01102611641606221, 0.03707857227106117, 0.01713410857448008, -0.0019491181108075174, 0.009683263889617438, -0.011638048399489523, -0.0012189071191377693, -0.0014944182822512239, -0.01486769144099914, 0.02488525261916118, -0.03030198832952167, 0.0328630377252646, 0.009688930055851374, -0.006657598175916925, 0.03240975560241995, 0.022210881761384554, -0.06518213839323167, -0.014425740719299834, -0.010737147526066578, 0.062145140347063275, 0.010487841799708504, -0.0005418151553427082, 0.010272532139431526, -0.00990990588236229, -0.04299391943413781, -0.027672944938971492, -0.0028740992594021688, 0.004935121825023627, -0.012419961644644843, -0.004643320783233551, -0.011150769279241248, 0.017179436041706526, 0.037826491312780444, -0.027151668821319596, 0.055799172000787635, 0.007156210094294336, -0.047685400767714776, -0.008397073025512033, 0.048637298068565676, -0.02710634135409315, 0.007932457638876981, -0.0006484075793123338, -0.009473620395574396, -0.011456734805293642, 0.01885658399405085, 0.013417185481399663, 0.031571181626247787, -0.030324651131812368, -0.018312645074108257, 0.007462176086007992, 0.012068667720043478, -0.022267541561078876, -0.018765927196952914, 0.012034671653962381, -0.009966566613379132, 0.0190945592505861, 0.009314971466314263, -0.008924014378075341, 0.002354240148970019, -0.06853643429792032, 0.027287653085643983, -0.015298310761553096, -0.0030369980461683863, 0.03179782082502507, -0.0043033582597775365, -0.027083676689157402, -0.010720149958687293, -0.009598273258753435, -0.025905140189529222, -0.01513966183229296, -0.0016544839859004728, 0.007139211595592525, 0.020760374870462554, 0.017077446912140713, 0.03197913441922095, 0.0251798858127457, 0.017474071097936094, -0.0024137334974425693, 0.010901462621560649, 0.06690461567544749, 0.024318649034282838, -0.03991159205809793, 0.013020562226926805, 0.03553740858304123, 0.016828141185782637, 0.01689613518058988, -0.00064451214823416, 0.013972457665132656, -0.011473733303995452, 0.001346393065433775, -0.010232869907116493, 0.005020112455887632, -0.005110769252985572, -0.02038641534960292, -0.00864071258563617, 0.01612555333657991, -0.01814266381238025, 0.012181988250754642, -0.03175249522044367, -0.015275647027939872, -0.009541613459059115, 0.0004104338652800154, -0.014618385714641066, -0.014357747655815118, -0.03240975560241995, 0.008011782103507047, 0.01663549712176393, 0.01860727826769278, 0.027740937071133686, 0.0015340806309815727, -0.020216434087874914, -0.0012330721854766648, -0.013235871887203782, -0.0020511067747120697, -0.00043628516664577445, 0.009949568114677322, -0.003476116150411985, 0.004875628476551077, 0.004048386367185525, 0.045101688569681136, -0.008895684478228182, 0.02497590941625912, -0.011830693394830753, -0.006685928541425347, 0.01530964309402097, -0.020261763417746406, 0.0285568463823701, 0.01691879798288058, -0.011400075005599322, 0.016386191395405855, -0.0033344652541923993, 0.007813470941931881, -0.028375534650819267, -0.03651197054882788, 0.011921350191928694, 0.016884802848122004, -0.023026791072620973, 0.008799361514896305, -0.03698791733660828, -0.012657935969857568, 0.011887354125847597, -0.039163676741668756, 0.026857035627735074, -0.022448855155274755, -0.017122776242012205, -0.010380187435231277, 0.03324832957859211, 0.010023226413073452, -0.040568852440074216, 0.001749390174843235, -0.0464615386635052, -0.013439849215012888, 0.03041530792891031, 0.022856809810892963, 0.011139436946773374, -0.027174333486255343, 0.047594745833261884, -0.044512418457222, -0.0017635552411821305, 0.005017279372770663, -0.007892795406561947, 0.015026341301581798, 0.002780609612017891, 0.019049229920714606, -0.019423189441574243, -0.03216044801341683, -0.0013180628163406685, -0.017474071097936094, 0.0006168902281279534, 0.00747917411904854, -0.038529081024628216, -0.03295369638500759, -0.011031781650973623, -0.010470844232329218, -0.023004126407685226, -0.004640487700116583, 0.02128165098811445, -0.014641050379576812, -0.025202550477681447, 0.0032579736398486697, 0.008255421663631185, -0.03957162953464192, -0.03197913441922095, -0.03551474391810548, 0.01010255087770352, -0.01380247640340465, 0.0430392487640093, 0.056751069301638535, -0.02128165098811445, 0.013247204219671656, -0.004085215516383591, -0.015694934016025952, 0.030936584046562205, -0.017474071097936094, -0.0023655722486072618, 0.01801801001787869, 0.008850356079679211, 0.004175872313481531, 0.02817155639168764, -0.029780712211869773, -0.03651197054882788, -0.019400524776638495, 0.009031669673875092, -0.008895684478228182, -0.009694596222085312, 0.0006838203615748879, -0.052762173954619254, 0.019865139231951025, 0.018425966536141945, 0.01618221313627423, 0.017054784109850014, 0.011604052333408426, 0.0020355252832300053, -0.006374296383477754, 0.01422176339149073, 0.05688705356596292, 0.00852172588869107, 0.01549095668821685, -0.014323751589734021, 0.01952517670849501, 0.03551474391810548, 0.007377185455143988, 0.0348121579315478, -0.008249755497397248, 0.032568404531680084, -0.00934896753239536, -0.0011452485879110083, 0.015898910412512533, -0.006668930508384799, 0.002315994225382839, -0.002607795500003546, 0.017417409435596727, 0.006300637619420362, -0.00023638014843476698, -0.0005149015060157436, 0.014550393582478872, 0.06799248979004258, -0.009195984769369163, -0.04115812255253335, -0.05117568466201791, -0.020352420214844347, -0.013961125332664782, -0.011060112482143307, -0.03068727832020413, 0.006379962084050428, -0.007830468509311166, 0.008136434966686085, -0.001980281326602277, -0.026675722033539195, 0.009694596222085312, -0.006153320556966839, 0.010232869907116493, 0.01749673576287184, 0.05371407125547015, -0.031480522966504804, -0.014369079988282992, -0.01677148138608832, -0.005255253232322126, 0.03997958605290517, 0.0020808536817789754, -0.011439737237914355, 0.052762173954619254, 0.04854663940882269, -0.020137109623244845, -0.0075641647499125435, 0.027831593868231624, -0.010068554811622422, 0.012102663786124575, 0.02941808502347801, -0.03614934336043611, -0.02914611463218419, -0.05602581492485501, 0.004657485733157132, 0.05629778345350379, -0.005283583132169286, 0.004405346923682088, -0.06794716791075128, -0.013462513879948634, -0.0030766602784834196, -0.01924187584737836, -0.0014285506131808102, 0.0022607505015857414, 0.003311801054917914, -0.025497185533911015, -0.001234488727035149, -0.02941808502347801, 0.05389538112437593, 0.012918574028683516, 0.011570056267327329, 0.004790637845687074, -0.0095586110264384, 0.036330656954631994, -0.012159324517141419, 0.015298310761553096, -0.0035044465159204067, -0.00541390216158226, 0.01900390245348816, 0.03352029810724089, 0.01983114409719245, -0.008555721954772166, 0.010555834863193222, -0.02819422105662339, -0.01710011157707646, -0.012317973446401552, -0.028806152108728177, -0.006838911770112806, 0.020907691467254817, -0.025134558345519253, -0.010306529136835147, -0.006158986723200776, 0.03957162953464192, 0.002807523435967829, 0.0009235647234514827, -0.023140112534654658, -0.02003512049367903, -0.019513846238672184, -0.03784915597771619, 0.023140112534654658, 0.018323977406576132, 0.012147992184673545, -0.03834776743043234, 0.006385628250284365, -0.03354296277217664, 0.021530956714472527, 0.0010815056147630054, 0.00233724188309884, 0.04804802795610654, -0.0061079921584178696, 0.010051557244243137, -0.010657823061436512, 0.03413223288463577, -0.022063563301947246, 0.011400075005599322, 0.013439849215012888, 0.00431185704346718, -0.006759586839821477, 0.012113996118592449, -0.008051444335822082, 0.0058813506313342805, 0.0032693057394859123, 0.02065838574089674, 0.001419343325881294, -0.024613282227867357, 0.012805252566649827, 0.0042381987450710494, -0.0009618104724156897, 0.02246018748774263, 0.02382003758156669, -0.06400359816831339, -0.0058870167975682165, -0.0015284145811629516, 0.038914369152665634, -0.011626716067021649, 0.00545923056013123, -0.018720599729726468, 0.01554761648791117, -0.006368630217243817, -0.012125327519737798, 0.006646266309110313, -0.02989403367390346, -0.015864915277753962, -0.006442288515639947, -0.005309080414560739, 0.024953244751323374, 0.018947240791148793, -0.0072355345589244025, 0.027264990283353285, 0.01775737195905274, 0.0059776731290048955, 0.016612832456828184, 0.0191172220528768, 0.001031219437174656, -0.032885702390200354, -0.013530506012110827, -0.016680824588990378, 0.013281200285752753, -0.021530956714472527, -0.01248795470812956, 0.016578835459424564, -0.010606828496653606, -0.004886960343357689, 0.006170318590007388, -0.018448629338432644, 0.012147992184673545, 0.010776809758381613, -0.023457410393174928, 0.05661508131202406, 0.009683263889617438, -0.026086453783725105, -0.009331969965016073, -0.023638723987370807, 0.04371917381092133, -0.01592157507744828, 0.001146665013054177, 0.009371632197331106, 0.0034506191008511623, -0.008153433465387895, 0.018573283132934205, -0.020341087882376475, -0.025973132321691416, 0.016828141185782637, -0.01654484032466599, 0.006521613445931276, -0.025701161930397596, -0.021621613511570464, -0.031707165890572174, 0.010833470489398455, 0.010997785584892526, 0.016465515860035924, -0.01869793506479072, 0.012329305778869426, 0.0051249342029091515, -0.0064082924495588505, 0.0012649436720506661, -0.03449485634773744, 0.015887579942689706, -0.011910018790783345, 0.010232869907116493, 0.020443077011942288, 0.02506656621335706, -0.018686602732322845, 0.004345853575209538, -0.02642641630718112, -0.045713619621785925, 0.01874326439466221, -0.0033486302041159793, 0.01728142517127234, 0.025497185533911015, -0.002946341249070446, 0.025247879807552942, 0.02749163134477561, 0.00736018742210344, 0.04238198838203302, 0.026607728038731952, -0.0333843138429165, -0.03769050704845606, 0.013541838344578701, -0.004243864911304986, -0.04249530798142166, 0.0004249530670085319, -0.014289755523652924, 0.00995523428091126, -0.01263527130492182, -0.021236321658242956, -0.0542126827081863, 0.008136434966686085, -0.001776303882377857, -0.012567279172759627, 0.003099324477757905, 0.03608134936562887, 0.013836472469485746, -0.005133433452260057, -0.0247039390249653, -0.048320000210045407, -0.0048274669948851386, 0.05892682870669901, -0.02210889263181874, 0.007909792973941234, -0.01669215692145825, 0.0010942541395434168, 0.02749163134477561, 0.014550393582478872, -0.016578835459424564, -0.024227992237184897, 0.03653463148847353, -0.046914820786349856, -0.0011679126707701778, -0.029984688608356354, 0.030573956858170444, -0.016091556339176288, -0.011371744174429639, -0.020012457691388333, -0.03927699634105739, 0.024046678642989015, -0.003478949233528953, 0.02456795476064091, -0.003079493361600388, -0.0035016134328034383, -0.03735054452500004, 0.011167766846620535, 0.006430956648833336, -0.019842476429660326, 0.012691932035938665, 0.00930363913384639, -0.008578386619707914, -0.004099380931968433, -0.02062438874349312, 0.014255759457571827, 0.0077624763771489734, 0.02731031775057973, -0.01739474663330603, -0.027786266401005177, 0.006226979321024231, 0.03778116198290895, 0.018516621470594838, -0.001912288845194137, 0.0073318570565950175, 0.031888479484768056, -0.019400524776638495, -0.014879023773467013, 0.030709942985139876, -0.0029010130833521065, 0.030936584046562205, 0.006787917205329899, -0.015094333433743992, -0.004623489667076035, 0.009887242148749066, 0.052535534755841974, -0.0003582000303602368, 0.004915290708866111, 0.003164483992464392, 0.00874836788143592, -0.04349253088685396, -0.004835966244236044, -0.008856022245913147, -0.05149298252053818, -0.011320750540969255, -0.020805702337689, 0.031639171895764935, 0.02796757813255601, -0.04201936119364126, 0.007881463074094073, -0.016646829454231803, -0.027196996288546042, 0.011196096746467694, 0.05688705356596292, 0.0210436757315792, -0.011462400971527578, 0.04258596664116465, -0.004263696027462504, 0.022630168749470637, 0.004682983015548585, 0.0027862757782518275, 0.030166002202552236, -0.006085327959143384, 0.047277447974741614, 0.031956473479575295, -0.005731200485763789, 0.010487841799708504, -0.006283639586379813, 0.04127144215192199, 0.01458438964855997, 0.04247264331648591, 0.008312082394648028, -0.033905589960568396, -0.002549718460258849, -0.005773695801195791, 0.029508741820575952, 0.0017678048658575829, -0.013133883688960494, 0.03997958605290517, 0.019151219050280423, -0.009564277192672338, 0.028783489306437475, -0.02529320727477939, -0.0035242776320779236, 0.03877838488834125, -0.0059776731290048955, 0.01615954847133848, 0.028738159976565984, -0.010431182000014184, 0.013371857082850694, -0.014686378778125782, 0.04460307711696499, 0.021814257575589174, -0.017156773239415828, -0.02115699719361289, -0.0049606191074150815, -0.006040000026255676, 0.007632157347735999, 0.030845927249464264, -0.04152074974092511, -0.012884577031279895, -0.01906056225318248, -0.02283414514595722, 0.00549039400875662, 0.024273319704411343, -0.025451856204039523, 0.04138476547660072, 0.031707165890572174, -0.040251554581553946, 0.013394520816463917, -0.007314859023554469, 0.02093035613219056, 0.005481894759405715, 0.029395420358542264, -0.03791714624723334, -0.00470564721482307, 0.04075016603427009, 0.0367612744125409, -0.018527953803062713, -0.0056235456556253, -0.001303189479222531, 0.01384780480195362, -0.021202326523484385, -0.0037990806408274513, 0.03542408898365259, 0.00791545914017517, 0.010363188936529467, 0.019162551382748295, -0.0017352251085043396, -0.02091902379972269, -0.01665815992405463, 0.05312480114301101, 0.006119324490885742, 0.0025015572114235416, 0.023140112534654658, 0.008340412294495189, 0.005139099152832732, -0.004428011122956574, -0.03950363926512477, 0.010555834863193222, -0.005994671627706705, 0.018652607597564274, -0.001582241996232196, -0.007422513853692959, -0.027083676689157402, -0.011876021793379724, 0.0031389867100729382, -0.056660410641895545, 0.03603602003575738, 0.02885148143859967, -0.023502737860401374, 0.0005648334900068142, 0.020239098752810658, -0.030347315796748115, 0.018833921191760153, -0.01248795470812956, -0.013247204219671656, -0.021089005061450696, 0.0285568463823701, -0.04009290565229381, -0.0050569416050856965, -0.023253432134043298, 0.007133545895019851, -0.012306641113933679, 0.022947466607990904, 0.040568852440074216, 0.0035299435654812293, -0.002875515800960653, 0.010663489227670448, -0.022981461742749478, 0.01882258885929228, -0.02817155639168764, -0.013972457665132656, -0.011530394035012296, -0.019219211182442617, -0.024953244751323374, 7.88376521606107e-05, 0.04136210081166498, -0.022392193492935388, 0.03050596472600825, -0.018482626335836267, -0.0024718105371872665, -0.014017786063681627, -0.015116997167357215, 0.0232307693317526, 0.001474587166093707, -0.0014859192657309497, -0.008969342776624312, -0.011315084374735319, 0.03583204550191585, -0.0044336772891905105, 0.05199159397325433, -0.041566079070796604, 0.0232307693317526, 0.00788712924032801, 0.012703264368406537, 0.008674708651717267, -0.01326986795328488, 0.002736697755027405, -0.03154851696131204, 0.022392193492935388, 0.03619466896501752, -0.003818911756984968, -0.012340637180014775, -0.0033146341380348825, 0.026585065236441253, -0.001796134998535374, -0.02205223283212442, 0.03216044801341683, 0.026766378830637136, -0.0224941826225012, -0.008674708651717267, -0.017927353220780748, -0.017768704291520616, -0.011575721502238743, -0.01239729791103162, 0.012374634177418397, 0.0032834709222401234, 0.011150769279241248, 0.04016089964710105, -0.0062496435202987165, -0.014482401450316679, 0.033203000248720624, -0.0015369135976832256, 0.02174626544342698, -0.010731481359832642, -0.003932232287696132, 0.020669718073364613, -0.026267767377920987, -0.018029342350346565, 0.014165102660473886, 0.01825598527441394, -0.016873470515654132, 0.010533170198257474, -0.0037225890264837216, 0.01476570324275585, 0.018210655944542443, -0.04224600411770863, 0.019661162835464444, 0.0032693057394859123, 0.004255196778111598, 0.0031984802913761195, -0.008538723456070357, -0.0047283114140975555, 0.0012288226772165277, -0.036262662959824755, 0.030437972593846056, -0.0188792486589866, -0.0010758395649443841, -0.006283639586379813, -0.006345966017969332, -0.0007351688289167851, -0.02014844195571272, 0.024341311836573537, 0.01761005536226048, -0.005144765319066669, -0.008844689913445274, 0.02121365699330721, 0.010737147526066578, 0.0041333769980495295, 0.007252532591964951, 0.040568852440074216, 0.000747917411904854, 0.012476622375661687, 0.045237672834005524, 0.00708821749647088, 0.009535947292825177, -0.035152120455003814, -0.012646603637389694, 0.026675722033539195, 0.0033514632872329478, -0.009241313167918134, -0.01235196951248265, -0.024182662907313402, 0.005864352598293732, -0.02447729796354297, 0.007473508418475865, -0.00035589820853535776, 0.017383414300838153, 0.006300637619420362, -0.0116153846658763, -0.012827917231585575, 0.0022848310095880797, 0.013133883688960494, -0.01485636003985379, -0.036262662959824755, 0.028012907462427506, 0.0016275702783658506, -0.010538836364491412, -0.012725928102019762, -0.019853808762128198, 0.03145785830156905, -2.2464967195005103e-05, -0.01244262630958059, -0.002671538473151549, 0.025247879807552942, -0.0032636395732519754, -0.0003252661667212012, 0.004544164736784706, -0.0037650843419157237, 0.0019137053867526212, -0.006963564633291843, 0.0026531236657218855]
Process finished with exit code 0
4.3.嵌入多个文档
import os
import numpy as np
from langchain_openai import OpenAIEmbeddings
os.environ["OPENAI_API_KEY"] = 'sk-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' # 你的Open AI Key
# 嵌入多个个文档
def embed_documents(strs):
documents_vector = embeddings.embed_documents(strs)
return documents_vector
if __name__ == '__main__':
embeddings = OpenAIEmbeddings(model="text-embedding-3-small")
strs = ["广州有什么特产？","深圳有什么特产？", "广东的省会在哪里？"]
documents_vector = embed_documents(strs)
print(documents_vector)
调用结果：
[[0.010842610565804609, -0.02262559239159926, 0.05102938170727038, 0.02676096617456796, 0.008593646400412783, -0.028097881529438266, -0.0032318230577054034, 0.037410968996561635, 0.00018286990819383806, -0.04282660951017348, 0.004251504114560155, 0.010848274869433808, -0.02124335888240525, -0.003886118346253133, -0.01785575140958325, -0.038340015374583404, -0.08438428834754245, -0.020053730323054582, 0.002890512908128799, -0.005565759926607342, 0.03448788285010546, -0.011154179861699068, -0.015827718368793407, 0.031383520361064336, -0.004888804862405862, -0.021424635224990198, -0.02253495422030679, -0.017028675535402472, -0.02682894526869858, 0.015521814307850679, -0.02270490195563334, -0.01826362411172191, 0.051573210735025216, 0.0038351342584858005, -0.012813994051044757, -0.01372037762661455, 0.03154213948913249, -0.013777026250841713, 0.03759224906443671, 0.007364364456028871, 0.0014225969112412814, 0.02306745464080323, -0.012202184997836768, -0.042645333167588534, 0.03337756385478887, 0.018059686829330047, -0.028981606027846205, 0.036504587283636904, -0.060727682799370554, 0.0268969243628292, 0.04454874035266565, -0.0009616160074743399, 0.03364948023131135, -0.11637961310520213, -0.003543392120769229, -0.03319628751220392, -0.041784269608987505, 0.045387142971459765, 0.009754950647649871, -0.03453320472971929, 0.01622426060102861, -0.0391104388992469, 0.023226071906226324, 0.06883981496252992, -0.0571927848057388, -0.03813607809219154, -0.01649617697755109, -0.013187877206118108, -0.016450856960582325, 0.013969633063330116, 0.008112130300514305, -0.0022418823888715332, 0.048219592809268526, -0.032811073887227114, -0.01809367637639536, 0.004313817973739047, 0.007789231466038921, -0.02365660368552684, -0.0023211910215830797, -0.038679907119946386, -0.048219592809268526, 0.02476692454348849, 0.0010699572230837505, 0.01467207935650805, -0.004291158430915929, -0.05460959412993572, 0.050757465330747896, -0.037750864467214734, -0.03759224906443671, 0.03079437317898579, -0.012224845006321152, -0.034442564695781754, 0.034397246541458044, -0.012451440434552334, -0.013255855368926197, 0.05025895445731676, 0.06172470454623282, 0.01608830427541243, -0.002601603387888092, 0.06480640609546703, 0.038566609871492054, -0.05610512675022912, -0.024132455481796117, 0.03410267295041877, -0.003364947929998882, 0.04853682734011471, -0.007715588068279103, 0.035983415470398857, 0.026806286191536726, 0.029570755072569812, 0.011782982757117182, -0.006752555402820882, -0.02262559239159926, 0.0511653361702415, -0.010768966236722261, 0.010666998526848862, -0.018954739934996384, -0.06525959508928433, 0.01643952649067887, 0.004803831460403852, -0.014581441185215576, 0.031043628615701358, -0.038226714400838954, -0.00968697155351925, -0.02961607508953858, 0.0008950535131199427, 0.01602032518128181, -0.005268352786769675, -0.03625533184692134, -0.024540328183934777, -0.015261229332554185, -0.04420884488201255, -0.0041608659432676815, -0.025763946290350757, 0.02270490195563334, 0.010819950557320226, -0.05447363594167448, 0.01785575140958325, -0.0283924569831226, -0.002307028865526289, 0.019453250808427518, -0.009607662920807704, -0.0037954801749606596, -0.006435321337635961, 0.02049559257225855, -0.06788810764470124, -0.03988086614920051, 0.02435905184134983, -0.02605851988139003, 0.04713193102846873, -0.024132455481796117, -0.029162882370431152, -0.05837108289518601, -0.05420172329044212, -0.020382295323804225, -0.015646442026208462, -0.00044752675655997137, 0.007624949431325364, -0.004455440465629485, -0.01304058947927594, 0.0030335517087571695, -0.0004507132474935151, -0.0017490365175614963, -0.035077033757474126, 0.012995270393629705, -0.05048554895422542, -0.05814448839827736, -0.002299947554667261, -0.01947591174823443, -0.06308427897826498, 0.028279159734668272, -0.03265245848444908, 0.018071017299233504, 0.012587397691491045, -0.004367634446151611, 0.00531933710736764, -0.002951410691400391, -0.005670560719617871, -0.022840860143894578, -0.050757465330747896, 0.010865269642966463, 0.011986919108186512, -0.0005250650324529319, -0.014445483928276865, -0.03147416039500187, 0.009063832961730335, 0.03353618298285702, 0.00183825861294667, -0.007675933751923329, 0.06503300059237568, -0.004602727726810386, 0.03231256301379598, 0.049896401772146874, -0.007891199175912321, 0.02361128553120313, -0.0466787383093613, -0.009822928810457961, 0.00017065498747681495, 0.030001286851870323, 0.006157741588806813, -0.038090759937867834, 0.014037611226138207, 0.03750160903049917, -0.009715295865632832, -0.033581501137180725, -0.04037937702263164, 0.023497986420103745, 0.054700234163873256, 0.004786836686871197, -0.037093738191005574, 0.0193739431070385, 0.003135519651461202, -0.013459791719995527, 0.0819823702890342, 0.010457396940827804, 0.011998248646767438, 0.06009321373767818, 0.050712147176424194, 0.016416867413517014, 0.06738959677127011, -0.006582608598816862, -0.017153303253760258, 0.004489430012694795, 0.008548327314766548, 0.04574969565662965, 0.02097144436852783, -0.06467044790720579, -0.02320341282906447, 0.002476975669530309, -0.06258576810483385, -0.023905859122242405, 0.004030573455619435, -0.03811341715238463, -0.040402034237148436, -0.015011973895838618, 0.042939910483917924, 0.009505695210934305, 0.026398413489398066, 0.044050229479234516, -0.024857562714780963, 0.003265812371940081, 0.01057069512060466, 0.02435905184134983, -0.01886410176370391, 0.05066682529681037, 0.030749053162017023, -0.030318521382716512, 0.021096072086885614, -0.007381359229561527, 0.014932665263127072, -0.029570755072569812, 0.0010331352913732087, 0.003843631645252128, 0.0070924494764901865, -0.004016410833901379, 0.0073586992210771425, -0.03614203459846701, -0.05007767811473182, 0.014717398442154285, -0.031111607709831977, 0.008831572298547424, 0.0075286464907424275, -0.042803952295656686, -0.018444900454306856, 0.01135245097781667, 0.015249898862650728, -0.011805642765601565, -0.021424635224990198, -0.031383520361064336, 0.0032516502158832904, 0.010825615792271955, -0.02018968851131582, 0.024925539946266523, -0.03960894977267803, -0.00799883305205998, -0.018003038205102885, -0.017085326022274697, -0.013165217197633724, 0.023101444187868542, 0.01507995205864671, -0.047539805593252445, 0.006826199266241965, 0.01947591174823443, -0.055606615876797987, -0.018331603205852528, 0.016790750568590362, 0.055833210373706636, -0.010700988073914171, -0.01620160152386676, 0.013017930402114087, 0.02510681815149653, -0.03353618298285702, -0.014354845756984393, 0.001104654691687394, 0.04269065504720236, -0.03147416039500187, -0.007766571923215802, 0.016042984258443665, -0.02165123158454391, -0.030431818631170837, 0.02449500816696601, 0.008134790308998689, -0.022920167845283595, 0.03385341751370321, -0.022104422441006275, 0.004189190255381264, -0.04037937702263164, 0.022036443346875656, -0.040288736988694104, -0.00830473711300271, 0.016235591070932066, -0.04090054511057957, 0.017357240536152115, -0.02510681815149653, -0.028211180640537653, -0.006514629970347507, -0.005636571172552562, -0.015544473385012532, 0.025084157211689617, -0.02882298876242311, -0.007970507808623867, 0.012428781357390482, 0.04148969601794823, 0.03849863077736144, -0.05270619067014872, -0.0031468494228727613, 0.0285963924028694, -0.019917773997438402, -0.041557675112078855, -0.029162882370431152, 0.01124481803299154, 0.03534895013399661, -0.028211180640537653, 0.03432926744732743, -0.020314316229673605, -0.011256147571572468, -0.012394791810325172, 0.030205224134262184, 0.02648905166069054, 0.02320341282906447, -0.015045962511581398, -0.025560009007958896, 0.01954389084236505, 0.018614846326988344, 0.014626760270861813, 0.006288034076455059, 0.049080656367869555, 0.06575810596271547, -0.0323805421079266, -0.02982001050928538, 0.03355884019737381, 0.0033536181585873226, -0.012723355879752285, -0.003129854882170739, 0.008418035292779565, -0.06399066441647984, -0.008429364831360493, -0.01625825014809392, -0.03208596851688733, 0.006996146070245985, 0.015419845666654748, -0.025356073588212097, 0.024608307278065397, -0.0022645419316946517, -0.01663213330316727, -0.006860188813307275, -0.010338434457421749, 0.015861707915858718, 0.005565759926607342, 0.01491000525464269, -0.0208694757273319, 0.043506396726189556, -0.008134790308998689, -0.005902821382800782, 0.04196554595157245, 0.007477662170144463, 0.01896607040489984, 0.02848309515441507, -0.01124481803299154, -0.03204065036256362, -0.013731707165195476, -0.004631052038923968, -0.01649617697755109, 0.001300801693944046, 0.04781171824448481, -0.039495652524223705, 0.03423863113868002, 0.009199790218669044, -0.021458624772055505, -0.041829587763311214, -0.02103942160001339, -0.06720832415397528, -0.0035632192789471157, 0.017527186408833606, -0.04731320737105368, -0.0012767258423829956, 0.04717724918279243, -0.049987038080794285, -0.04296256769843472, 0.026738307097406107, 0.01372037762661455, -0.03976756890074618, 0.014071600773203517, -0.006237050221518359, 0.02812054246924518, 0.01355043082261053, -0.05538002137988934, 0.01989511305763149, 0.006871518351888202, -0.016280909225255775, 0.0028777670608099407, 0.03469182013249732, 0.025265435416919623, 0.07069790026799322, -0.02039362393106262, -0.017153303253760258, -0.007120773788603768, 0.0042345093410275, 0.009109152047376572, -0.017164633723663714, 0.02565064717925137, 0.03722969265397669, -0.06711768039474762, 0.0015210244313464323, -0.02293149831518705, 0.03306032932394268, -0.020846816650170047, -0.028732350591130638, -0.03222192670514857, -0.03038650047684713, 0.023294051000356943, -0.003163844196405416, 0.05112001801591779, 0.015374526581008512, -0.05837108289518601, -0.02716883887670662, -0.05841640477479984, 0.04386895313664957, -0.012304153639032698, -0.001256898684205109, -0.032969693015295266, -0.04013012158591608, -0.013595749908256767, 0.00962465769434036, -0.020110378947281744, -0.00891088093125897, 0.0006904091823046212, 0.037093738191005574, 0.019022719029127003, -0.07015406751494825, 0.03743362993636855, -0.0074719974008539995, -0.01680208103849382, -0.01676809149142851, -0.02408713546482735, 0.0522529979510413, 0.03505437281766721, 0.015669101103370314, -0.019022719029127003, -0.0563770431267516, 0.025967881710097555, -0.010768966236722261, -0.042214801388288016, 0.02558266808512075, -0.014649420279346195, -0.016054314728347122, 0.0409458669901934, -0.0274407552532291, 0.07958045223052596, 0.0035405597361239972, -0.03086235227311641, 0.01907936765335417, 0.01389032443061857, 0.0161902710539633, 0.03065841499072455, 0.010972902587791591, 0.021945805175583182, 0.014785377536284906, -0.007239736737671088, -0.022376336954883697, 0.017878410486745103, 0.01053670557353935, 0.026602350771789927, -0.040152778800432866, -0.019838464433404323, 0.026851606208505494, -0.008015826894270104, -0.02088080619723536, -0.07160427825562782, -0.0533859778861648, -0.0007017389537161804, -0.007324710139673098, 0.018614846326988344, -0.009771945421182525, 0.056422361281075306, 0.07559236524307689, -0.031156925864155683, -0.030137245040131565, -0.0424867177648105, 0.023294051000356943, 0.03509969469728104, -0.005579922082664133, 0.012553409075748265, 0.001824096340474563, 0.010287450136823783, -0.03265245848444908, 0.004529083863389303, -0.037093738191005574, 0.026625009848951782, -0.012054898202317131, 0.02144729430215205, 0.00726806104978467, 0.012043567732413675, -0.01056503081697546, 0.029457457824115484, 0.02422309365308859, -0.0070358003866017585, 0.04269065504720236, -0.005800853207266117, 0.007171758109201733, 0.0552893813459518, -0.015295217948296965, 0.005534602997017897, -0.007505986947919309, -0.02866437149700002, 0.004761344992233479, -0.021152720711112776, -0.015363197042427586, -0.035031715603150416, -0.04962448539562439, 0.013233196291764344, -0.05152789258070151, -0.018648835874053655, -0.030771712239178878, 0.009675642014938325, -0.005036092123586763, -0.016688781927394435, -0.0662566168361466, 0.012236174544902079, 0.0010260542133448134, 0.005633738555076697, 0.003373445316765209, 0.0029315835332225045, -0.003195001125994862, -0.011539392555353344, -0.027916605186853318, -0.00010267623531618649, -0.02124335888240525, -0.003152514424993857, -0.007488992174386654, 0.036323310941051956, -0.009800269733296106, 0.006871518351888202, -0.04899001633393202, 0.024336390901542916, 0.02676096617456796, -0.06041044826852437, 0.027531393424521575, 0.012202184997836768, -0.009930561755283089, 0.042939910483917924, 0.010887929651450846, -0.004611225113576714, 0.007845880090266084, -0.012927292230821614, 0.04935256901910191, 0.008106465996885108, 0.038430651683230815, 0.009199790218669044, 0.02793926612666023, -0.024744263603681576, 0.03321894845201084, 0.017323250989086807, 0.005121065525588773, -0.010927583502145354, 0.02354330643707251, 0.10296514140217537, -0.027350117081936628, -0.023565965514234365, 0.01572574972759748, 0.01151673254686896, -0.0038747885748415738, -0.029502775978439193, -0.015227239785488875, 0.025356073588212097, -0.023192082359161013, 0.039291715241831844, 0.0028239505883973764, 0.06118087179318786, -0.03015990411729342, -0.029661393243862286, -0.006911172668243975, -0.04142171692381762, -0.03480511738095165, 0.02472160452651972, -0.028755009668292492, -0.02242165697185246, 0.001739122938472553, -0.02114139024120932, 0.004993605655416391, 0.014014952148976353, 0.019804474886339015, -0.02927618148153054, 0.006027449101158566, -0.007777901927457994, -0.01595234608715119, -0.0068035397234188465, 0.001133687274585258, -0.009913566981750433, -0.0032629799872948492, 0.0006256168992496647, 0.025854584461643227, -0.025627988102089515, -0.056603637623660254, -0.027146179799544767, -0.008780587977949459, -0.0436423549144508, -0.007109444250022841, -0.015884366993020572, 0.00726806104978467, 0.018059686829330047, -0.011392104828511176, 0.0012264499089846292, -0.03482777832075856, -0.007607954657792709, 0.029910648680577853, 0.023294051000356943, -0.005851837062202818, 0.021537932473444522, -0.010644338518364478, 0.00853699777618562, 0.0008164530929850203, -0.00023757155901569518, -0.004166530712558145, -0.009941892225186546, 0.002923086146456177, -0.0004981567380389917, -0.010140163341304147, 0.024064476387665498, -0.006191731135872122, 0.03557554463090526, 0.024948200886073437, -0.028097881529438266, -0.015567133393496914, 0.0028990102948951266, -0.011222158024507158, -0.010723647151076024, 0.019090698123257626, 0.04516054847455111, 0.0008249504215436896, 0.05397512506824335, 0.009063832961730335, 0.0030420488626928645, 0.01737989961331397, -0.001117400655421569, 0.012904632222337231, 0.008191438933225851, 0.009743620177746415, -0.022874847828314827, 0.06575810596271547, -0.007947848731462015, 0.030341180459878363, 0.011193833712393577, 0.0009722377409322493, 0.007347369682496216, 0.020370964853900768, 0.015249898862650728, -0.009913566981750433, 0.005084243826708864, -0.009885242669636852, 0.07255598557345651, 0.004463937852395812, 0.00045637816230312375, 0.017515857801575208, 0.036980437217261124, -0.002954243076045623, 0.012111546826544296, -0.017697134144160156, -0.010106173794238837, -0.011278807580056852, 0.03688980090861371, 0.0201217094171852, -0.03475979922662794, 0.011850961851247802, -0.043279802229280906, -0.016246921540835523, 0.03099830859873259, 0.006135082045983694, -0.025763946290350757, -0.01920399537171195, -0.003716171542249113, 0.03147416039500187, 0.033354906640272075, 0.004616889882867177, 0.0008376964434855227, -0.008780587977949459, 0.0042628341188023465, -0.004928459178761635, 0.02080149663320128, 0.04126310152103958, 0.017629155050029537, -0.014921334793223615, 0.02306745464080323, -0.0033904400902978644, -0.015782398351824642, 0.011930270483959348, 0.004373299215442074, 0.0032403202116410984, 0.011681015047243783, 0.016745432414266657, 0.009596333382226778, 0.006769550176353537, -0.0018779129293024432, -0.024948200886073437, 0.03133820220674063, -0.0008582316978247173, 0.016688781927394435, 0.014479473475342177, 0.013199206744699033, -0.021537932473444522, -0.010683993300381516, 0.009607662920807704, -0.022093093833747877, -0.02463096635522725, -0.004628219887109369, 0.014003621679072896, 0.014388835304049703, -0.0021158385946064505, -0.014354845756984393, 0.02889096785655373, -0.002784296272041603, -0.0331283084180733, 0.011930270483959348, 0.02646639258352869, -0.005812182745847045, 0.0006702279469422515, -0.004197687642147591, -0.06498768616334209, -0.03106628769286321, -0.033626819291504434, 0.021220699805243395, 0.022523625613048392, -0.02435905184134983, -0.06322023716652622, -0.004733020214458633, -0.01433218574850001, 0.0007162552451651123, -0.012122876365125221, 3.9897682574468614e-05, 0.0034385915605893323, -0.011426094375576488, 0.006412661794812842, 0.007387023998851989, -0.004724522827692305, 0.014309526671338156, -0.005361823575538012, 0.005084243826708864, -0.017561175955898917, -0.0043563049075706845, 0.024064476387665498, -0.008888220922774586, -0.011012557369808629, 0.037048416311391746, 0.01711931556934001, -0.0019600539466592213, 0.009681306318567522, -0.011567716867466925, -0.0013199206977529666, -0.0015054459665517093, -0.014864686168996452, 0.02490288086910467, -0.030363841399685277, 0.03287905298135774, 0.009749285412698143, -0.006752555402820882, 0.03235788489340981, 0.022229050159364057, -0.06516895878063693, -0.01440016484263063, -0.010746307159560408, 0.06213257538572642, 0.010423408325085023, -0.0005608246744023663, 0.010270455363291128, -0.009885242669636852, -0.04296256769843472, -0.02771266976710652, -0.002857939902632054, 0.004951118721584754, -0.012496759520198571, -0.004628219887109369, -0.01118250417381265, 0.01717596419356717, 0.03779618262153844, -0.027123520722382916, 0.05587853225332046, 0.007188752417073123, -0.04772108193583739, -0.008361385737229872, 0.04862746364876212, -0.02716883887670662, 0.007964843504994669, -0.0006833280460685677, -0.009471705663868995, -0.011431759610528216, 0.018932080857834533, 0.013425803104252747, 0.03161011858326311, -0.030363841399685277, -0.01826362411172191, 0.007347369682496216, 0.012054898202317131, -0.022331018800559987, -0.01877346359241144, 0.011975589569605585, -0.010089179020706182, 0.01913601814022639, 0.009267769312799665, -0.008922210469839896, 0.002418910503734581, -0.06856789858600744, 0.027395435236260333, -0.015329207495362275, -0.0030477138648139605, 0.03181405214036485, -0.0042543367320360195, -0.027123520722382916, -0.010791626245206645, -0.009664311545034868, -0.02587724353880508, -0.01507995205864671, -0.0016456521497042154, 0.007126438557894231, 0.020812827103104736, 0.01714197464650186, 0.031972671268433006, 0.025061498134527762, 0.0174818682545099, -0.0024104131169682534, 0.010853940104385536, 0.06698172965706663, 0.02435905184134983, -0.03994884524333113, 0.013097239034825634, 0.035552883691098346, 0.016745432414266657, 0.01700601645824062, -0.0005367488810489741, 0.014003621679072896, -0.011437423914157413, 0.001355326320725576, -0.010327104918840821, 0.004987940420464663, -0.005067249053176209, -0.02042761347812793, -0.008735268892303222, 0.016144952899639596, -0.018071017299233504, 0.012134206835028678, -0.031768733986041145, -0.015272558871135112, -0.00959066814727505, 0.00041495360554408067, -0.01467207935650805, -0.014286866662853772, -0.03244852120205722, 0.008021492129221833, 0.016688781927394435, 0.018546869095502787, 0.02769001068994467, 0.0015734247114363806, -0.02022367805838113, -0.001230698602367793, -0.01317654766753718, -0.002105924899102191, -0.00039654269789646794, 0.009970216537300127, -0.0034725811076546423, 0.004885972710591263, 0.004075892541265672, 0.04497927213196616, -0.008927875704791624, 0.025061498134527762, -0.011771653218536255, -0.006610933376591709, 0.015272558871135112, -0.020325644836932, 0.028573733325707545, 0.016892719209786293, -0.011346785742864941, 0.016337559712127997, -0.003393272474943096, 0.007783566696748457, -0.028347136966153832, -0.0364592691293132, 0.011918940014055891, 0.016870060132624442, -0.023022136486479525, 0.008746598430884147, -0.03695778000274433, -0.012678036794106048, 0.011862291389828729, -0.03917841799337751, 0.026942244379797968, -0.022512295143144935, -0.01711931556934001, -0.010321439683889093, 0.03328692754614145, 0.010021200857898092, -0.040583310579733384, 0.0018042692987119925, -0.04640682565812894, -0.01361840898541862, 0.030363841399685277, 0.022852188751152976, 0.011159844165328265, -0.02730479706496786, 0.047585123747576154, -0.044435443104211325, -0.0017136308945888868, 0.0050700816706520735, -0.007879869637331394, 0.015000643425935161, 0.0027644691138637165, 0.01903404949903046, -0.019464581278330974, -0.03208596851688733, -0.001356742513048192, -0.017436548237541132, 0.000635884555523091, 0.007568300807098201, -0.03849863077736144, -0.03287905298135774, -0.011035216446970482, -0.010480056949312186, -0.022999475546672612, -0.0046338846563998325, 0.021254689352308707, -0.014683409826411507, -0.025265435416919623, 0.0032403202116410984, 0.008225428480291163, -0.039586292558161235, -0.03201798942275671, -0.03548490459696772, 0.010117503332819763, -0.01375436624235733, 0.04309852588669596, 0.056694273932307665, -0.02131133797653587, 0.013221866753183417, -0.003993751291078261, -0.015646442026208462, 0.030907670427440116, -0.017459209177348046, -0.0023126936348167523, 0.01791240003381041, 0.008786253212901187, 0.004175028099324473, 0.028143201546407034, -0.02984266958644723, -0.03643660818950629, -0.01941926312400727, 0.0091148172823283, -0.008865561845612734, -0.009613328155759432, 0.0006868685850827654, -0.05270619067014872, 0.019929102604696797, 0.018354262283014382, 0.01622426060102861, 0.01711931556934001, 0.01162436549169409, 0.0021215033638969137, -0.006418326564103305, 0.014207558030142226, 0.0568302321205689, 0.008457689143474074, 0.015533143846431605, -0.014252877115788463, 0.01948724035549283, 0.03559820557071217, 0.007341704913205753, 0.034873096475082264, -0.00826508233098567, 0.03251650029618784, -0.009330083171978556, -0.001169092781142551, 0.015839048838696863, -0.006661917231528408, 0.002299947554667261, -0.0025931060011217645, 0.017459209177348046, 0.0062653745336319405, -0.00018163071080772015, -0.0004163698269705255, 0.014558782108053723, 0.06806938771257631, -0.009194125915039847, -0.04119512242690896, -0.05112001801591779, -0.02039362393106262, -0.014003621679072896, -0.011108860776052831, -0.030681074067886404, 0.006491970427524389, -0.007828885316733428, 0.008083805988400724, -0.001994043260893899, -0.026625009848951782, 0.009754950647649871, -0.006123752041741502, 0.010310110145308167, 0.017538516878737063, 0.0537485305713347, -0.03145149945519496, -0.014354845756984393, -0.016790750568590362, -0.005316504489891776, 0.03999416339765483, 0.002130000750663241, -0.011471413461222725, 0.05275150882447243, 0.04858214549443842, -0.02018968851131582, -0.007585295114969591, 0.027803307938398993, -0.010123168567771491, 0.012054898202317131, 0.02943479688430857, -0.036096716444143306, -0.029117564216107446, -0.05605980859590541, 0.004676371124570204, 0.05633172124713777, -0.005265520634955076, 0.004313817973739047, -0.06811470214160989, -0.013459791719995527, -0.0031015303372265244, -0.019294635405649484, -0.001410558985460756, 0.002234801310843138, 0.00330263407081999, -0.02544671175950457, -0.001287347575840905, -0.0293441587130161, 0.05397512506824335, 0.013006600863533162, 0.011635695961597546, 0.0048293236207028346, -0.009562343835161467, 0.036368629095375665, -0.012179525920674915, 0.015351867503846659, -0.003500905419768224, -0.005398645740079187, 0.018988729482061695, 0.03351352204305011, 0.019906443527534946, -0.008593646400412783, 0.01060468466766997, -0.028143201546407034, -0.01714197464650186, -0.012394791810325172, -0.02882298876242311, -0.006848858809065083, 0.02090346527439721, -0.025084157211689617, -0.010338434457421749, -0.006152076819516349, 0.03956363161835432, 0.0028338640510710035, 0.0009056751883701939, -0.023124103265030393, -0.019974422621665565, -0.019589208996688756, -0.037864161715669066, 0.023192082359161013, 0.018342931813110926, 0.012179525920674915, -0.03824937534064587, 0.0063220236235203685, -0.0334682038887264, 0.021594582960316747, 0.0010975734972436823, 0.002363677722584085, 0.04808363462100729, -0.006089762960337457, 0.010077849482125254, -0.010678328065429787, 0.034215970198873104, -0.022025114739617258, 0.011431759610528216, 0.013403143095768363, 0.004288325813440064, -0.0066732472357706, 0.012134206835028678, -0.00806681121486807, 0.005851837062202818, 0.0033167964597074135, 0.02059756121345448, 0.001370904785520299, -0.02469894544935787, 0.012859313136690994, 0.0042996558176822556, -0.0009403726569738374, 0.022478305596079624, 0.023724582779657458, -0.06403597884551342, -0.005823512750089236, -0.0015068622752896414, 0.038861183462531326, -0.011647025500178472, 0.005534602997017897, -0.018784794062314897, 0.015567133393496914, -0.006327688392810832, -0.012111546826544296, 0.006633592919414827, -0.029933307757739704, -0.015839048838696863, -0.006373007478457069, -0.005316504489891776, 0.024857562714780963, 0.018954739934996384, -0.007262396280494206, 0.02728213798780601, 0.017708464614063613, 0.005942475699156556, 0.016620804695908875, 0.019215325841615408, 0.0010055190172132769, -0.03287905298135774, -0.01358441943835331, -0.016643463773070726, 0.013267185838829654, -0.021571922020509834, -0.012542078605844808, 0.016586815148843564, -0.010610349902621698, -0.004871810088873207, 0.00618040113162993, -0.018478890001372164, 0.012100217287963368, 0.01074064192460868, -0.02347532734294189, 0.056603637623660254, 0.009692636788470979, -0.02608117895855188, -0.009335748406930284, -0.02361128553120313, 0.04371033400858142, -0.015986335634216503, 0.0012399040270877702, 0.009284764086332319, 0.003404602246354655, -0.008146119847579616, 0.018580858642568095, -0.02030298575977015, -0.02599054078725941, 0.016881388739882836, -0.016643463773070726, 0.006508965201057044, -0.025695967196220134, -0.021662560191802304, -0.031723415831717436, 0.01080295578378757, 0.011001226899905172, 0.01643952649067887, -0.01866016634395711, 0.012372131801840788, 0.00514939030336362, -0.006373007478457069, 0.0012753096500603797, -0.034510543789912376, 0.01591835654008588, -0.011941600022540275, 0.010134498106352419, 0.020348305776738913, 0.025061498134527762, -0.01867149681386057, 0.004359137059385283, -0.02646639258352869, -0.04579501753624348, 0.018716814968184274, -0.0033904400902978644, 0.017232612817794334, 0.02551469085363519, -0.002951410691400391, 0.02531075357124333, 0.027463414330390953, 0.00735303445178668, 0.042373420516356175, 0.026647668926113633, -0.03328692754614145, -0.03763756721876041, 0.013505110805641764, -0.004186358103566664, -0.04262267595307174, 0.00035706544923676524, -0.014275537124272847, 0.009941892225186546, -0.012723355879752285, -0.021254689352308707, -0.05429235959908953, 0.008157449386160542, -0.0018595019634471725, -0.012644047247040737, 0.003087368181169734, 0.03607405550433639, 0.013799685328003566, -0.005109735987007847, -0.024653625432389102, -0.048264910963592235, -0.004800998842927988, 0.05891491564823097, -0.022070432893940964, 0.007891199175912321, -0.016677453320136038, 0.0011103195773931734, 0.027554052501683426, 0.014570111646634649, -0.016586815148843564, -0.02431373182438106, 0.03654990543796061, -0.04681469649762254, -0.0012597311852656568, -0.03004660686883909, 0.030613096836400844, -0.01608830427541243, -0.011329790969332286, -0.020053730323054582, -0.03926905802731505, 0.02408713546482735, -0.0034385915605893323, 0.02456298726109663, -0.0030590436362255198, -0.0034555863341219875, -0.03727501453359052, 0.011125854618262956, 0.006418326564103305, -0.01989511305763149, 0.012610057699975427, 0.009284764086332319, -0.008548327314766548, -0.004058897767733017, -0.020699527992005348, 0.014241547577207535, 0.007851545325217812, 0.02728213798780601, -0.017402558690475824, -0.027735328844268374, 0.006152076819516349, 0.03779618262153844, 0.018524208155695873, -0.0019147347445976686, 0.007347369682496216, 0.031859374019978674, -0.019385273576941957, -0.014898675716061762, 0.030726394084855172, -0.002880599445455172, 0.030952990444408884, 0.006775215411305265, -0.015215909315585419, -0.00460839249610085, 0.009851253122571542, 0.052524910602273656, -0.0003506924382658487, 0.004962448725826945, 0.003093032950460197, 0.008723939353722295, -0.04357437582032018, -0.0048094962296943156, -0.008905215696307242, -0.051482570701087686, -0.011307131892170433, -0.020846816650170047, 0.0315874576434562, 0.028029904297952705, -0.04207884320002678, 0.007789231466038921, -0.01666612285023258, -0.027191499816513535, 0.011086200767568447, 0.0568302321205689, 0.020994103445689683, -0.01138644052488198, 0.04250937870461741, -0.004274163657383274, 0.022648253331406173, 0.004744350218700824, 0.0027998747368363263, 0.03015990411729342, -0.0061180872724510395, 0.047358529250667504, 0.0319273531141093, -0.005684722875674662, 0.010491386487893113, -0.0062767045378741325, 0.04126310152103958, 0.014558782108053723, 0.0424867177648105, 0.008253752792404744, -0.033921396607833824, -0.002503883905736591, -0.005789523203023926, 0.029548095995407957, 0.0017787772548283262, -0.013221866753183417, 0.03994884524333113, 0.019192666764453557, -0.009522689984466958, 0.02886830877939188, -0.02531075357124333, -0.003571716665713443, 0.038747886214077, -0.005897156147849054, 0.016144952899639596, 0.028777670608099406, -0.010412077855181567, 0.013357824010122128, -0.01470606890357336, 0.044662037601119975, 0.0218211774572254, -0.01711931556934001, -0.0210734111470787, -0.004970946112593273, -0.006084097725385729, 0.007624949431325364, 0.030839691333309497, -0.04148969601794823, -0.012870642675271922, -0.019090698123257626, -0.022886178298218283, 0.005543100383784224, 0.024245752730250442, -0.025356073588212097, 0.041353737829686994, 0.03167809767739373, -0.0402434188343704, 0.01338048308728398, -0.007347369682496216, 0.020914793881655607, 0.00548928391137166, 0.029502775978439193, -0.03788682265547598, -0.004758512374757615, 0.04067395061367091, 0.03668586362622185, -0.018592187249826492, -0.005594084238720924, -0.0012370716424425386, 0.013811015797907023, -0.021152720711112776, -0.0036935119994259947, 0.03539426828832031, 0.007970507808623867, 0.010281785833194584, 0.019192666764453557, -0.0016895551594431526, -0.020960113898624372, -0.01659814375610196, 0.053114061509642325, 0.006112422503160576, 0.0024599808959976537, 0.023078785110706688, 0.008389710049343453, 0.005259855400003347, -0.00452341909409884, -0.039450334369899996, 0.010661333291897133, -0.0059877947848027925, 0.018592187249826492, -0.0016244087992037131, -0.0074606673966118075, -0.027010221611283528, -0.011907610475474966, 0.0031723415831717435, -0.056558319469336545, 0.036028737350012684, 0.0289362878735225, -0.02352064735991066, 0.000551265172497906, 0.020280326682608294, -0.03038650047684713, 0.018750804515249585, -0.012530749067263881, -0.01321053628327996, -0.021062082539820302, 0.028573733325707545, -0.040107460646109164, -0.0050502542796435545, -0.023271391923195092, 0.0070811194722479945, -0.012349472724678935, 0.022886178298218283, 0.04062863245934721, 0.0035207325779461106, -0.002948578073924527, 0.010683993300381516, -0.02301080601657607, 0.018807453139476748, -0.028165860623568885, -0.013912983507780424, -0.011477078696174453, -0.019283304935746027, -0.024925539946266523, 3.516218399434157e-05, 0.041308419675363285, -0.022376336954883697, 0.030499797725301456, -0.01853553862559933, -0.0025194623705313136, -0.013980962601911043, -0.015125271144292945, 0.023226071906226324, 0.001441715915050202, -0.0015210244313464323, -0.009029843414665024, -0.011295802353589506, 0.03580213912781391, -0.0044582730831053494, 0.05198108157451882, -0.04160299326640256, 0.023271391923195092, 0.00789686441086405, 0.012666706324202592, 0.008723939353722295, -0.013153887659052798, 0.002679495711861707, -0.0315874576434562, 0.022331018800559987, 0.03623267090711443, -0.003778485401428005, -0.012326812716194551, -0.0033224612289978767, 0.026647668926113633, -0.0018269288415351107, -0.022047773816779113, 0.03208596851688733, 0.026715648020244256, -0.022478305596079624, -0.008610641173945438, -0.018003038205102885, -0.017753782768387318, -0.01151673254686896, -0.012394791810325172, 0.012349472724678935, 0.003364947929998882, 0.011131519853214684, 0.040266079774177316, -0.006248379760099286, -0.014479473475342177, 0.03319628751220392, -0.001581922098202708, 0.0218211774572254, -0.010695322838962443, -0.0038917833483742286, 0.020586230743551023, -0.02628511624094374, -0.018037027752168196, 0.014150909405915063, 0.018286283188883763, -0.01683607058555913, 0.010519710800006694, -0.003721836544370209, 0.014774047997703979, 0.01815032500062252, -0.04219214417377123, 0.01948724035549283, 0.0033224612289978767, 0.004313817973739047, 0.0032856395301179677, -0.00860497687031624, -0.004744350218700824, 0.0012200768689098836, -0.03634597188085887, 0.030409159554008983, -0.018807453139476748, -0.001030302906727977, -0.006288034076455059, -0.006339018397053024, -0.0006918253746272371, -0.020201017118574218, 0.02435905184134983, 0.01754984734864052, -0.005104070752056118, -0.008876891384193659, 0.021220699805243395, 0.010717982847446827, 0.004146703787210891, 0.007273725819075133, 0.0406059715195403, 0.0005919816039918122, 0.012428781357390482, 0.04518320941435802, 0.007154763335669078, 0.009613328155759432, -0.03516767379141166, -0.012655376785621664, 0.026670328003275488, 0.0033281262311189727, -0.009256439774218738, -0.012372131801840788, -0.024200434575926737, 0.0058858266092681275, -0.02442703093548045, 0.007449337858030881, -0.0003126314401364199, 0.017334581458990264, 0.006350347935633951, -0.011692344585824709, -0.01283665312820661, 0.0022815367052273065, 0.01321053628327996, -0.014943994801707999, -0.03625533184692134, 0.027961925203822086, 0.0015904194849690357, -0.010559365582023732, -0.012859313136690994, -0.019872453980469634, 0.031496821334808786, -3.117905577549736e-05, -0.012485429981617644, -0.0027474743403310617, 0.025288094494081474, -0.0032431528291169626, -0.00029209618579722536, 0.004599895109334522, -0.0038351342584858005, 0.0019260645160092277, -0.006945162215309285, 0.002675247018478543], [0.023225036426370967, 0.01123629091686059, 0.028525915686929065, 0.05705183137385813, 0.035241859447706705, -0.014510033055740938, -0.013746346713302979, 0.04793252226375531, -0.01961998933370574, -0.05826474486698635, 0.018620460460102083, 0.012050514545410113, -0.03598308415321339, 0.018328462905285663, -0.007816550000572034, -0.014352803459867091, -0.060645648579380255, -0.03728584419406671, -0.0292222171185732, -0.005778182526089917, 0.062307787360553674, -0.011601287394719847, -0.02643700952935158, 0.0126906628160486, -0.024842253796326912, 0.02466256256352179, -0.03176034856419588, -0.015105258052516878, -0.014554955398280951, 0.03876828987978994, -0.04842667082566305, -0.027537616700468507, 0.04977435414037892, 0.01758723819977898, 0.02186612508715707, 0.005031342411350414, 0.017946618802744146, 0.004848844172420786, 0.009860532884286968, -0.009680842582804383, 0.0021085593914004458, 0.03162558246789838, -0.001259239455145808, -0.04636022630501684, 0.03236680717340506, 0.003492740072162028, -0.03926244216698783, 0.012488510877634742, -0.04285625564721981, 0.02192227824816272, 0.04173318870181668, 0.014173112227061972, 0.026167473611466433, -0.09424782902019975, -0.022787041025468874, -0.008990156094731798, -0.013196044059067052, 0.028323762817192667, -0.0025704208636186023, -0.0013596136728216107, 0.012656971291974226, -0.03016559469381628, 0.023517033981187388, 0.05857920405873405, -0.03724092092020417, -0.014285419480395805, -0.01737385544289948, 0.025291480947017178, -0.03232188389954251, -0.0016424862458423583, 0.019754757292648313, -0.024729947474315613, 0.012578356494037303, -0.009579766147936186, 0.004798305954986687, -0.01345434915848656, -0.020305060878206774, -0.02068690498074829, 0.014824491316166095, -0.03247911349541636, -0.03995874359863196, -0.000873185018040507, 0.012072976182341388, -0.012488510877634742, -0.04649499612660449, -0.04941497167476868, 0.030772051440380394, -0.01182590097006498, -0.05444631501744163, 0.046315306756444435, -0.034320945372039974, -0.015779099709874813, 0.03459048128992512, -0.023247498063302244, -0.049459894948631226, 0.010416451413416983, 0.04218241771515202, 0.021787510289220147, -0.029267140392435748, 0.059657347730274625, 0.04009350969492946, -0.03611785397480104, -0.016565245826598976, 0.02127090009038113, -0.01665509237432407, 0.07088802463488621, 0.015150181326379426, 0.0166438606245359, 0.006131948651144805, 0.013094967624198855, 0.0082152389338282, -0.023786569899072532, -0.026100090563317684, 0.04436116855780953, -0.016846013494272293, 0.015554485203207144, -0.007047248714562524, -0.03968920768074682, 0.020001833436247257, 0.02365180194012996, -0.03227696062567997, 0.04469808752384342, 0.007816550000572034, 0.01830600126835439, -0.00633971646445275, -0.027537616700468507, 0.030996664084402988, 0.009888609464789793, -0.029064987522699353, -0.009197922976717206, -0.024213335412831525, -0.05552445868898221, -0.02578563137156999, -0.03122127859107066, 0.05422170237341903, -0.014352803459867091, -0.08202885499177268, 0.03609539047522469, -0.03429848187246363, -0.002922783252780602, 0.04418147546235933, 0.02636962648120283, 0.018328462905285663, -0.010438913050348256, 0.022438890309646808, -0.030906819399322966, -0.007743550611867929, 0.01051752784828518, 0.0010627026931341336, 0.028121611810101345, 0.013420656703089649, -0.07362831081289034, -0.059657347730274625, -0.012814200887848072, 0.01926060873074057, -0.017463700127979508, 0.01700324309014614, -0.0008100124790785177, -0.0165315543025246, -0.007052864123795343, -0.0025900745631028334, 0.013420656703089649, -0.050807574538056954, -0.030861896125460416, 0.01263450965504295, -0.03337756779679689, -0.018620460460102083, -0.008557774706078719, -0.027178234234858264, -0.033916639632567185, -0.009972840137620804, -0.0406775048045623, 0.035646165187179495, 0.0012873161520639497, -0.011073446377415194, 0.0016312556602073552, 0.0024258258221032804, -0.04004859014635706, -0.04193534157155308, -0.022674732840812506, 0.016924628292209216, 0.019642450970637014, -0.019833372090585236, -0.013139889966738866, 0.01844076922729696, 0.0011736056284984955, 0.007575090663189713, -0.004093581176662688, 0.044922700167866016, 0.04806729208534295, -0.01546464051812712, 0.03124373836535686, 0.002838553278441494, -0.013094967624198855, 0.02623485852226026, -0.02946929139952707, 0.025156712988074606, 0.01562186918267843, 0.023427189296107362, -0.05237987049679542, -0.008726235120418202, 0.0016242363986663322, 0.037690146208249356, 0.0029059372579127805, 0.0015975635540563951, -0.011500211891174186, 0.03202988448208102, 0.058669046881168994, -0.0027290541953853367, -0.02466256256352179, 0.026392088118134104, 0.008063625212848442, 0.012454819353560367, 0.03957690135873552, 0.024280720323625347, 0.036679385584857525, 0.08423006933400654, 0.017632159610996453, 0.00604771890963633, 0.05772567303121606, -0.0074066302488502295, -0.01713801104908871, 0.020664443343817018, 0.011062215558949557, 0.023090268467428395, 0.029671444269263467, -0.03717353414676527, -0.002678515977951238, 0.034208639050028675, -0.0561533770724776, -0.019608759446562637, -0.010927447600006985, -0.029828673865137312, -0.048471594099525596, -0.034028945954578484, 0.035646165187179495, 4.404530592120724e-05, 0.027065927912846968, 0.03941967176286167, -0.0557041517844324, 0.012870354048853722, 0.008922771183937975, 0.043777173448176686, 0.024774870748178163, 0.05687214200369808, 0.038251681543596, -0.012454819353560367, 0.03146835287202453, -0.03571354823532825, -0.045102393263316214, 0.01723908748395691, -0.006429561615194042, 0.041261499914195136, -0.00633971646445275, 0.005873643086064028, -0.028009303625444973, -0.048651287194975794, -0.00021039968713987807, 0.02394379949494638, -0.023876416446797628, -0.006244255438817371, -0.003009820931736119, -0.04874113001741074, -0.04141872951006899, 0.035466472091729304, -0.004242387425856673, 0.007047248714562524, -0.016351863069719478, -0.03092928103625424, 0.019833372090585236, -0.005508646142543505, -0.007007941315594062, 0.007631243824195362, 0.00874308088245539, -0.015442178881195846, -0.05525492277109706, -0.04087965767429869, -0.04413655591378693, -0.04467562774955722, 0.01593632930574866, -0.022506273357795557, -0.024774870748178163, 0.019911986888522158, -0.041778111975679225, -0.017317702281893832, 0.02857083896079161, 0.06922588212842264, 0.013083736805733217, -0.003964428626952934, -0.0028708412994536154, 0.044293785509660774, -0.051706028839437486, -0.04139626973578278, -0.03140096982387578, 0.013667731915366056, -0.05880381670275664, -0.02262981142959503, 0.02762746138554853, -0.032681266365152756, -0.03852121746148114, 0.06140933305917314, 0.0033383181809045906, -0.0012220378928473117, 0.0049414972606091215, -0.009096847473171545, 0.015262487648390725, -0.008164700716394102, -0.011309289839903428, -0.019440299963545692, -0.019283070367671844, 0.0075694752539568946, -0.05408693255183138, -0.010888140201038522, -0.06963018786789543, -0.011758516990593694, -0.012870354048853722, 0.013375734360549637, 0.0114328279117029, -0.0041076194669141, -0.0166438606245359, 0.023809031536003805, -0.019283070367671844, 0.027762229344491105, 0.0019204455104073653, -0.0202713693541324, -0.030143133056885006, 0.045933460791257846, -0.029783750591274763, -0.024033646042671476, -0.0202713693541324, 0.020675673230960118, 0.01570048491193789, 0.001940099209891596, -0.0075020912744856085, -0.03753291661237551, -0.045776231195384, 0.011500211891174186, 0.0017253124842885785, 0.015430948062730208, -0.005166110835954254, -0.027717306070628556, -0.008451083327638971, 0.020619520069954468, 0.0072044783104363705, 0.041239040139908936, 0.00721009371966919, 0.02767238465941108, 0.03605046720136214, -0.03144588937244818, -8.449328395838398e-05, -0.007131478921732266, -0.01398219110711375, 0.015576946840138418, -0.009102462416743095, 0.024752409111246886, -0.03753291661237551, 0.01820492483348619, -0.018036465350469245, -0.032097271255519914, 0.0095123821684649, 0.039352284989422774, -0.029312063666298297, 0.02780715261835365, -0.00324285762093048, 0.012331281281760895, 0.0018404269765775543, 0.0038717753059339644, 0.018687843508250833, 0.0033411258855209998, 0.01522879612431635, -0.0019415030621998007, 0.058624127332596594, -0.013196044059067052, -0.02857083896079161, 0.03194004165964607, 0.0228656558234058, 0.021989663158956542, 0.05727644401788072, -0.0020341560339728194, 0.02091151762477089, -0.0064127158531568544, 0.0032821647870683074, -0.02513425135114333, -0.02335980438531354, 0.02816653322131882, -0.03751045683808931, 0.03474771088579896, -0.00956853532947055, -0.05839951096328385, -0.010730910605164675, 0.002609728262587064, -0.07326892462198996, 0.00794008714104897, 0.004924651032910666, -0.053547860716061095, 0.014386494983941466, 0.02434810523441917, -0.03959936113302172, -0.026998543002053146, -0.0025058443559330913, 0.0019204455104073653, -0.06275701264859887, 0.011129599538420843, -0.005090303509803106, -0.002637804843089889, 0.020832902826833966, -0.036544619488560026, 0.0077379352026351106, -0.024977021755269484, 0.0019457145027090977, 0.02009167812132728, -0.0001316094804240023, 0.037914758852271954, 0.06248747673071372, -0.027178234234858264, 0.004986420068810402, -0.018889996377987227, 0.01047822044931672, 0.05049311534630926, -0.006249870848050189, 0.07237047404589957, -0.0019120225129734545, -0.044787934071568516, -0.007142709740197903, -0.01051752784828518, 0.04503501021516746, -0.001384882665123343, -0.01571171479908099, -0.013701424370762967, -0.06895634993582764, 0.01974352740550521, -0.009748226562275671, 0.05049311534630926, 0.01855307554930826, -0.06235271063441622, -0.035354165769718005, -0.0656769919220532, 0.04662976594819213, -0.046854378592214724, -0.012050514545410113, -0.00394196699002166, -0.014644801014683512, -0.00749647586525279, -0.031782812063772224, -0.021540436008266276, -0.013342042836475262, -0.010624219226724928, 0.019642450970637014, -0.03063728348143782, -0.06140933305917314, 0.016149712062628156, -0.027402848741525935, -0.029132372433493176, -0.014195573863993245, -0.007041633305329705, 0.019889525251590885, 0.03254649654356511, 0.028817913241745482, -0.038251681543596, -0.07695258837523719, 0.008131009192319728, 0.032501573269702565, -0.009068769961346184, 0.0001082707268383928, 0.0002756779900122598, -0.0016144095489242167, 0.0018123502796594127, -0.01802523360068107, 0.04539438895548756, 0.006306024474717107, -0.043597480352726495, -0.007872703161577684, -0.024797330522464363, -0.004116042347932694, 0.02946929139952707, 0.012960199665256283, 0.026347164844271555, -0.01736262369311131, 0.018755228419044655, -0.02686377504311057, -0.013701424370762967, 0.0005569713310496796, -0.0026335934025805917, -0.03744307006465041, -0.011455288617311637, 0.04680945531835218, -0.0027978419107495107, 0.006788943149481748, -0.07407753610093554, -0.021315821501598605, -0.006255486257283008, -0.008613927867084368, 0.02720069587178954, -0.009596611909973374, 0.07506583322475102, 0.062307787360553674, -0.03843137091375604, -0.0061207182983404355, -0.04528208263347626, 0.05013373660598916, 0.07228062749817447, -0.02455025624151049, 0.013903576309176826, 0.03501724680368411, -0.012398665261232181, 0.025853014419718743, 0.0071483246837694536, -0.026616700762156702, 0.05660260236052279, -0.01028168345447441, 0.03809445194772215, 0.01802523360068107, 0.01956383617270009, 0.022551196631658107, 0.025089328077280783, 0.027245619145652086, 0.02086659435090834, 0.04361994385230284, 0.002856803009202203, 0.0030715897348052206, 0.05067280844175945, -0.03106404899519681, -0.011601287394719847, -0.011095907083023932, -0.0073729382591145864, -0.011208214336357766, -0.019541374535768815, -0.028817913241745482, -0.048157134907777906, -0.053637707263786194, 0.02625731829654646, -0.041261499914195136, -0.023045345193565846, -0.012578356494037303, 0.009978455081192354, -0.0023458072882734694, -0.04698914468851222, -0.029851135502068585, 0.0058567973240268405, 0.005109957209287337, -0.0033074338957853567, 0.002500229179530907, -0.005160495426721436, -0.007709858622132286, -0.02594286096744384, -0.025044406666063307, -0.00960784272843901, -0.01914830240872927, 0.0024904023297887914, -0.03710615109861652, 0.04191288179726688, 0.02625731829654646, 0.028054226899307522, -0.0759642912514217, 0.030861896125460416, 0.024617641152304314, -0.037869839303699554, 0.03670184908443388, -0.0005443367766911549, -0.012342512100226532, 0.0037398148187771673, -0.014015882631188125, -0.00721009371966919, -0.019822142203442136, -0.009501151349999263, 0.02904252588576808, 0.015386025720190197, -0.0035853931603503637, 0.027178234234858264, 0.032703726139438956, -0.036679385584857525, 0.017620929723853353, 0.021495512734403727, 0.03185019511192097, -0.016127250425696883, 0.045439312229350104, 0.06145425633303569, -0.016250786634851282, 0.010927447600006985, -0.005000458359061814, 6.804209708639437e-05, 0.00629479365625147, -0.017699544521790275, -0.034927400255959015, 0.013802499874308628, -0.017070626138294888, 0.03995874359863196, 0.0011055196646654485, 0.0405427387082648, 0.006311639418288657, -0.0254711721798223, -0.012892815685784995, -0.05745613711333092, -0.026773930358030548, 0.010590526771328016, -0.022450120196789908, 0.006221794267547365, -0.0062891782470186515, -0.012129129343347035, -0.005868028142492478, -0.027829614255284928, 0.01354419477488912, -0.03703876805046777, -0.02603270565252386, -0.0067833277402489294, -0.01658770746353025, 0.008529698125575894, -0.02686377504311057, 0.011814670151599344, -0.006204948039848909, -0.024797330522464363, 0.018586767073382634, -0.00084089682240541, -0.03670184908443388, -0.03688153845459392, 0.011062215558949557, -0.03277110918758771, -0.012926507209859371, 0.018575537186239534, 0.01885630485391285, -0.019810912316299036, -0.02686377504311057, -0.0012087014705423433, -0.017059396251151788, 0.01885630485391285, 0.04568638837294905, 0.003237242211697661, -0.030188056330747556, -0.004624230597075653, -0.004096388648448464, 0.03591570110506464, 0.022921808984411447, -0.012140360161812674, -0.018732766782113382, -0.008074856031314078, 0.03607293070093849, 0.0009461844067446118, 0.025044406666063307, 0.0355563186394544, -0.02335980438531354, 0.019956910162384708, 0.025875476056650016, -0.01042768223188262, -0.019058455861004176, 0.001586332852006075, 5.150317672109928e-05, -0.0018769266709296067, 0.02109120885757601, 0.01819369494634309, 0.006081410899371974, 0.03243419022155381, 0.021394436299535528, 0.04168826542795413, 0.015498332042201494, -0.009192308033145656, 0.0022700001949529556, 0.022843194186474524, 0.019440299963545692, 0.005225071934406947, 0.04523715935961371, 0.0048769207529236105, 0.04094704444773759, 0.007457168466284328, 0.006805789377180203, -0.012398665261232181, 0.0044445398299318, 0.012825431706313709, -0.016744937059404094, 0.0037201611192929362, -0.0006036488091170694, 0.07416738264866064, -0.0052026102974756724, 0.024011184405740203, 0.015049104891511228, 0.030053288371804984, -0.010438913050348256, 0.024954560118338208, -0.021068747220644734, 0.02086659435090834, -0.03342249107065944, 0.050403272523874304, 0.02175381876514577, -0.014139420702987597, -0.0017477738883892187, -0.053952166455533884, -0.0082152389338282, 0.017216625847025636, 0.020619520069954468, -0.01932799177888932, -0.008383699348167685, -0.03742061029036421, 0.01878891994311903, 0.061903481621080884, -0.01508279734690814, 0.0022966730395628924, -0.048471594099525596, -0.011612518213185484, -0.010231145237040312, 0.008681311846555654, 0.03501724680368411, 0.021225976816518582, -0.016340633182576378, 0.004205887964335255, -0.030053288371804984, 0.01666632226146717, 0.002524094319524435, -0.027941920577296223, -0.00021548857899754675, 0.04433870505823318, -0.00016556472884722036, 0.03598308415321339, 0.01258958731250294, 0.021259668340592956, -0.011736056284984956, 0.035241859447706705, 0.01043329717545417, 0.006957403563821232, 0.020237677830058025, 0.02964898263233219, 0.011152060244029581, 0.0020860979872998056, -0.03407386922844103, -0.04027320279037966, -0.014689723357223523, -0.0228656558234058, -0.0023921338323676373, -0.0028371493097179724, -0.025403787269028477, -0.0028806681491957307, 0.007165170911467909, -0.004048658368461408, -0.023853954809866355, -0.01808138676168672, 0.02169766560414012, 0.04162088237980538, -0.0006552397120555168, -0.02690869831697312, -0.0304575922486327, -0.010747756367201863, -0.04433870505823318, 0.026392088118134104, -0.0028553992733093155, -0.011168906937389304, -0.021742587015357598, 0.0073729382591145864, -0.022944270621342723, 0.0034983554813948466, -0.015419717244264572, 0.0032821647870683074, -0.006221794267547365, 0.004627038068861428, 0.005719221427637225, -0.0074683992847499655, -0.0046186151878428346, 0.0037763145131292195, -0.002408979827235459, -0.007193247491970733, -0.0190247643369298, 0.03596062437892719, 0.05588384115459245, -0.0332652614747856, 0.02228166071377296, 0.031356046550013235, 0.0032540882065654826, 0.012847892411922447, 0.011814670151599344, -0.02002429507317853, -0.024954560118338208, 0.018867534741055954, -0.01726154725824311, -6.304093872203118e-05, -0.022483811720864284, 0.006609252382337895, 0.00787831903647177, -0.01057929595286238, 0.02767238465941108, 0.0038689676013175553, -0.01128682913429469, -0.03490494048167281, -0.024325643597487897, 0.01066914156926494, -0.007839011637503309, 0.004714076213478213, 0.040318126064242205, -0.020889055987839612, -0.030322824289690128, -0.022483811720864284, -0.028121611810101345, -0.0002009238004748138, 0.009338306810553866, -0.0015694868571382535, -0.0022587696093179523, -5.39873031448021e-06, 0.01215159098027831, -0.012645740473508589, 0.015913867668817385, -0.009815610541746957, -0.054131855825693936, 0.0165203244153815, 0.018597998823170807, -0.02857083896079161, 0.02607762892638641, 0.007591936425226901, 0.0025886705943793118, -0.007693012860095098, 0.04761806307200761, 0.002298077008286414, 0.0456190053248003, -0.026773930358030548, 0.0216302806933463, 0.012016823021335738, -0.010612988408259291, -0.030682204892655295, -0.01048383539288827, 0.024033646042671476, -0.006193717687044541, 0.008821695680392313, -0.00735047708784458, -0.01986706547730468, -0.00945622900745925, -0.012072976182341388, 0.021383206412392428, -0.0331529551527743, 0.014498802237275302, 0.019294300254814944, 0.009669611764338747, -0.023112730104359668, -0.0003388505289742492, 0.01531864174071891, -0.016700013785541548, -0.007153940093002272, -0.028503454049997788, -0.029671444269263467, 0.016935858179352316, 0.01383619232970554, 0.02216935252911659, -0.00841177592867051, -0.000894242511625284, -0.030794511214666594, 0.025561016864902322, 0.04211503466700327, -0.008473544964570244, -0.05381739663394624, 0.010410836469845431, -0.0024412680810782144, -0.016194633473845633, 0.021181053542656033, -0.006418330796728405, 0.025853014419718743, 0.04249687690689971, -0.01765462124792773, -0.012701893634514239, 0.03191757816006972, 0.005196994888242854, -0.028278841405975193, -0.01824984810734874, 0.03539908904358055, -0.03542154881786676, 0.031019125721334265, -0.02437056500870537, -0.021663972217420675, -0.005227879406192722, 0.012892815685784995, -0.05067280844175945, -0.013611578754360407, -0.017452470240836404, 0.02434810523441917, 0.004346271332510645, 0.013589117117429132, 0.021248438453449855, 0.022798270912611978, 0.0024019606821097527, 0.008765542519386665, 0.004079542886411276, -0.0035320474711304896, 0.029851135502068585, -0.02630224157040901, 0.01383619232970554, 0.024774870748178163, 0.019698604131642664, 0.0329732620573241, -0.02241642867271553, 0.019249376980952398, -0.046000847564696745, 0.005073457747765919, 0.04382209672203924, -0.016037403877971784, 0.020552135159160646, -0.007030402952525336, -0.03616277352337344, 0.012904046504250633, -0.019283070367671844, 0.006569944983369433, -0.03528678272156925, -0.04274394932520851, 0.01009637727809774, 0.027492693426605957, -0.01665509237432407, 0.002681323682567647, -0.01499295173050558, -0.019721065768573937, -0.009147384759283108, -0.014116959066056322, 0.0191370706589411, -0.0069124807556199515, -0.02821145649518137, 0.014015882631188125, 0.00918669215825157, -0.00677209738744456, -0.011904515768001903, 0.030727128166517844, -0.011168906937389304, -0.018991072812855427, 0.007636859233428181, 0.004882536162156429, 0.016452939504587677, -0.02976128895434349, 0.03131112327615068, -0.031670505741760925, 0.0003107738320561076, -0.03243419022155381, -0.01896861117592415, 0.029356985077515774, 0.005890489313762484, 0.02686377504311057, -0.0032625113204147104, -0.009635919308941835, -0.004065504596159864, 0.0016396786576412662, 0.005376685655386707, -0.005123995499538749, -0.013881114672245553, 0.016700013785541548, 0.01795785055253232, 0.004545615799138729, -0.020552135159160646, 0.00633971646445275, -0.006569944983369433, -0.003919505818751654, -0.024482873193361742, 0.04361994385230284, 0.003127743128641504, -0.030255439378896305, -0.02839114772798649, -0.0083163153686964, -0.01593632930574866, -0.010197453712965937, 0.03915013584497653, 0.06504807353855782, -0.03216465430366867, 0.006760866568978923, -5.926813657543242e-05, -0.021012594059639084, -0.0037089305336579334, -0.015487101223735858, 0.006070180080906337, 0.03214219452938247, -0.009984070024763904, 0.008945232820869248, 0.04218241771515202, -0.028907757926825508, -0.03618523702294978, -0.0017056587848043477, 0.01730647053210566, -0.015183872850453802, -0.03232188389954251, 0.014094497429125047, -0.01802523360068107, 0.010641064988762116, 0.024078567453888953, 0.006137564060377623, 0.0063453314080243, -0.004043042959228589, 0.004725306566282582, 0.018811381580050305, -0.01878891994311903, 0.025853014419718743, 0.04085719790001249, 0.015779099709874813, -0.003127743128641504, -0.0030715897348052206, 0.0456639248733727, -0.0013350465484663222, 0.02185489520001397, 0.015284949285322, -0.006957403563821232, -0.0014389303387049779, -0.02618993524839771, -0.0025353249051594377, -0.005017304121099002, -0.001563871564320752, -0.00677209738744456, 0.022146892754830387, -0.006957403563821232, -0.016048635627759957, 0.0035629317562497235, -0.021136130268793483, 0.036903998228880124, -0.023314882974096066, 0.012499741696100379, -0.052963865606428254, -0.034792634159661516, -0.027335463830732112, -0.01830600126835439, -0.004144119394096787, 0.022843194186474524, -0.0017449661837728094, 0.0016073904037985105, -0.010219914418574673, 0.0019162339534827513, 0.008024317813879979, 0.01537479490172456, 0.006558714630565065, 0.031782812063772224, 0.025650863412627418, -0.04211503466700327, -0.026324703207340282, -0.0043827712596933325, -0.03681415540644517, 0.03396156290642973, 0.026010244015592588, -0.027537616700468507, 0.02446041155643047, 0.03189511838578352, -0.0329508022830379, -0.027470231789674684, 0.02969390590619474, 0.017969080439675423, -0.010742141423630313, 0.02170889549128322, -0.010719679786699039, -0.04231718381144952, -0.05759090320962842, 0.0041188502853797375, 0.03497232352982156, 0.004292925643290772, 0.0008093105529244153, -0.05260448314081802, -0.009562920385899, 0.007490860456019971, -0.042362107085312066, 0.002295269303670005, 0.03232188389954251, 0.0019007918109231344, -0.01648663102866205, 0.02353949561811866, -0.009821225485318507, 0.01601494224104051, 0.014948029387965567, 0.014734645699763535, -0.01744123849104823, -0.0327486494133015, 0.02488717707018946, -0.0035320474711304896, -0.0139260379461081, -0.017059396251151788, -0.017665852997715902, 0.024819792159395636, 0.01908091749793545, 0.015453409699661483, 0.0038689676013175553, 0.03205234798165737, -0.004222734192033711, 0.00525876392414259, 0.007664935813931005, -0.06927080912757533, -0.008922771183937975, 0.003908275000286017, -0.014229265388067621, -0.020641981706885745, 0.0010893755377440707, 0.05525492277109706, 0.0028610144497115, -0.014734645699763535, 0.0055339152512605535, -0.014656031833149149, -0.011994361384404463, -0.026818853631893097, 0.02405610767960275, 0.02158535741948375, 0.03964428440688427, -0.014858183771563007, -0.015599408477069693, -0.04040796888667716, 0.00386616012953178, -0.007052864123795343, -0.007956933834408693, 0.07232554704674687, 0.018047695237612345, -0.005811874515825561, 0.006429561615194042, -0.0074066302488502295, -0.0011848362141334986, 0.013465579976952196, 0.022068277956893464, -0.0005306494204129645, -0.01594755919289176, -0.02191104836101962, -0.006137564060377623, 0.0006970037652518488, 0.01771077440893338, 0.015015413367436854, -0.04418147546235933, -0.010590526771328016, 0.014453878963412754, 0.009102462416743095, 0.0054356467538393995, 0.0028890912630449585, 0.018564307299096434, -0.034635404563787664, -0.0005580241911770039, 0.0027543230712717523, 0.07874949697799825, -0.008715004301952566, 0.002218058474456603, -0.003633123440337419, 0.0003902659649260857, -0.010113223040134926, 0.022180584278904764, 0.017160472686019987, -0.02578563137156999, -0.03459048128992512, 0.007024787543292518, -0.008142240010785364, -0.0101356846770662, 0.02075428802889704, 0.00456526949862296, 0.00224473131906654, 0.011477750254242912, -0.0036190851500860067, 0.01398219110711375, 0.018137539922692368, -0.008299469606659211, 0.0002151376304724102, -0.030075748146091184, -0.04409163263992438, -0.012387435374089081, -0.014341572641401455, -0.029132372433493176, 0.0011974707684920232, -0.03964428440688427, -0.019777218929579586, 0.012802970069382436, 8.668677408612447e-05, 0.003141781418892916, 0.047123914510099875, -0.01028168345447441, 0.06778835971656196, 0.03189511838578352, -0.014554955398280951, -0.04332794443484135, 0.0012648548643786266, 0.008877848841397962, -0.040205819742230905, 0.008484774851713346, -0.019249376980952398, 0.03560124191331695, -0.03870090683164119, -0.001202384193363081, -0.0058231053342911974, -0.006002796101435051, 0.0072381703001720135, -0.025718246460776167, 0.02222550755276731, -0.0035292397665140805, -0.008248931389225111, -0.015970020829823035, 0.019451529850688792, 0.026684085672950525, 0.029289602029367024, 0.00042711662235518926, -0.0047421527939810375, 0.0026981696774354687, -0.019642450970637014, -0.005626568339448889, -0.0030126286363525282, -0.0002635699239250557, -0.014386494983941466, -0.014431418257804016, 0.007749166021100747, 0.021776280402077044, 0.003950389871040254, 0.00021057516867840366, -0.01307250598726758, -0.049684507592653825, 0.01421803550092452, -0.017834312480732847, 0.013151120785204504, -0.005028534939564638, -0.01010199222166929, 0.02009167812132728, 0.033826793084842086, 0.006463253604929686, 0.03232188389954251, 0.01172482546651932, -0.018800149830262132, -0.022236737439910413, -0.0037678916321106258, 0.010422066356988533, -0.06244255718214132, -0.0013715462428183745, 0.02980621222820604, -0.004175003446385387, 0.0020145023344885883, 0.0013589116884598499, -0.024505332967647942, -0.01209543781927266, -0.014027113449653761, -0.01345434915848656, 0.006182486868578903, 0.015970020829823035, 0.023606880528912483, -0.0030435131543023962, -0.00960222778486746, -0.024437949919499193, 0.009012616800340535, 0.055569381962844756, -0.03023297774196503, 0.023314882974096066, 0.010225530293468761, -0.007698627803666648, 0.017823082593589747, 0.027492693426605957, -0.0008275604001004415, -0.009647150127407472, 0.009708919163307208, -0.052963865606428254, -0.0007622820826761452, -0.01906968761079235, 0.05327832479817595, -0.025920399330512565, -0.012106667706415762, 0.00028497838058688386, -0.036903998228880124, 0.013297119562612713, 0.004733729912962444, 0.025853014419718743, -0.01566679152521844, -0.0050088812400804076, 0.013678962733831693, 0.026571777488294153, -0.007075325295065348, -0.01723908748395691, 0.021349514888318055, -0.011926977404933177, -0.008883464716292049, -0.00918669215825157, -0.020237677830058025, 0.013094967624198855, 0.022090737731179665, 0.008619543741978455, 0.005166110835954254, -0.009484305587962075, -0.007277477699140476, 0.009473074769496439, 0.031356046550013235, -0.004478231819667443, -0.018384616066291312, 0.012140360161812674, -0.011449673673740087, -0.009394459971559514, 0.02329242133716479, 0.016160941949771256, -0.005014496649313226, -0.0010676161180051915, -0.01138790463784035, -0.03023297774196503, -0.0013947095148654585, 0.04433870505823318, -0.015509562860667132, 0.004363117560209101, -0.02085536446376524, 0.0003344635632706829, -0.03333264452293434, 0.007518937036522796, -0.0009188096359805725, -0.014689723357223523, 0.009680842582804383, -0.0050088812400804076, 0.04557408205093775, 0.02344965093303864, -0.05588384115459245, 0.006592406620300708, -0.02731300219380084, -0.020114139758258553, 0.018923687902061604, 0.042654106502773556, 0.014330341822935818, 0.005286840504645415, 0.021057517333501634, 0.003998120616688577, 0.0328609557353128, 0.006873173356651489, 0.012578356494037303, 0.010416451413416983, -0.006098256661409162, 0.06868681029265235, -0.0017674275878734496, -0.009821225485318507, 0.026010244015592588, 2.7089616901913895e-05, 0.031558199419749626, 0.05157126274313998, 0.039015366023388884, 0.036769232132582624, -0.02009167812132728, -0.016756166946547198, -0.000476601775935159, 0.02455025624151049, -0.009141769815711558, -0.05435646846971653, 0.015678023275006617, -0.0052643793333754085, -0.032232037351817414, 0.017688314634647175, -0.032681266365152756, -0.021551665895409376, 0.026122550337603887, 0.001586332852006075, 0.026616700762156702, -0.005337378722079514, -0.01010199222166929, -0.009506766293570813, -0.008102932611816903, 0.03117635531720811, 0.005011688711866183, -0.02259611804287558, -0.009703303288413121, -0.014554955398280951, 0.005011688711866183, 0.03396156290642973, 0.027649923022479806, 0.011702363829588044, -0.009944762625795443, -0.013813730692774265, -0.02875052833095166, 0.006519407231596603, 0.015386025720190197, -0.023382266022244816, 0.01226389730228961, 0.05134664637382724, -0.016992011340357965, 0.01522879612431635, -0.023764110124786332, 0.034343405146326174, -0.013914807127642464, 0.03063728348143782, -0.045102393263316214, -0.019507683011694442, 0.038363987865607296, 0.004264849062787947, -0.007013556724826881, -0.01244358853509473, -0.0009124923588013102, -0.009523612986930538, 0.006811404786413022, -0.009619073546904649, 0.03265880286557641, -0.004685999167314121, 0.014981720912039942, -0.014341572641401455, 0.012140360161812674, -0.006850712185381484, -0.023809031536003805, 0.053233401524313405, -0.005795028288127105, 0.016172171836914356, -0.018946149538992877, -0.028233918132112644, 0.0280766885362388, -0.009478689713067989, -0.04424886223579823, 0.03360218044081949, -0.0014361226340885685, -0.0031838965224777875, 0.006193717687044541, 0.0005885576005306743, -0.01713801104908871, -0.003085628025056633, 0.03357972066653329, -0.04584361796882289, 0.0328384959610266, 0.024685024200453064, -0.012578356494037303, -0.021529204258478103, 0.003919505818751654, -0.015026644185902492, 0.03551139536559185, -0.024145952364682775, 0.003728584233142164, -0.013701424370762967, 0.013151120785204504, -0.016149712062628156, 0.02603270565252386, -0.002769765330246686, -0.006221794267547365, -0.019878295364447785, 0.003489932367545619, 0.06702466778618879, 0.009113693235208734, 0.014195573863993245, 0.018699075258039006, -0.01671124553532972, 0.017328932169036936, -0.03856614073534369, 0.004511923809403086, -0.04036304933810475, -0.026212396885328983, -0.026122550337603887, 0.011938208223398814, 0.01743000860390513, -0.024954560118338208, 0.006811404786413022, -0.008434237565601783, -0.0041497348033296055, 0.0017211010437792817, -0.013443118340020923, -0.006525022640829421, -0.011146445300458031, -0.002483383184663085, 0.008496005670178983, -0.00022917596437956638, 0.030861896125460416, 0.0025030368841473163, 0.04209257116742692, -0.011938208223398814, 0.020597058433023195, 0.006474484423395322, 0.011028523103552646, 0.033220338200923044, -0.006468869014162504, -0.011668671374191133, -0.0278520758922162, 0.012117898524881399, 0.035444012317443103, 0.014352803459867091, -0.021742587015357598, 0.01052314279185673, 0.013342042836475262, -0.01436403427833273, -0.01713801104908871, 0.003944774927468703, 0.0006952489789704223, -0.005314917085148239, -0.01926060873074057, -0.03681415540644517, -0.007614398062158175, 0.03216465430366867, -0.008849772260895138, 0.004795498483200912, 0.0379596821261345, 0.024101029090820226, 0.05547953541511966, 0.01942906821375752, -0.03674676863300628, 0.045933460791257846, -0.0043827712596933325, 0.021282129977524232, 0.015296180103787636, 0.014476340600344027, 0.03122127859107066, -0.0292222171185732, -0.0020032717488535855, 0.024685024200453064, 0.004040235487442814, 0.017407546966973858, 0.007900779742080508, 0.005592876349713246, 0.041036887270172545, 0.00024040665187797182, 0.00012748571520035238, 0.046000847564696745, -0.017104319525014337, -0.020821672939690863, -0.009388845027987964, 0.011792209445990605, -0.0014515647766481855, 0.0015891405566224844, -0.04096950422202379, 0.000233562959186962, -0.009315845173622592, 0.02081044118990269, -0.018384616066291312, 0.0021324245313939735, 0.01047822044931672, -0.0019050033678477483, 0.0020453868524384564, 0.028099150173170072, -0.006710328351544824, -0.006429561615194042, 0.0006931432587157739, -0.001773042880690951, -0.002514267469782319, 0.003599431450601776, 0.045304546133052605, -0.0013350465484663222, -0.022461350083933008, 0.026976083227766942, 0.011567595870645472, 0.0011272790844043278, -0.007311169688876119, 0.009826841360212593, 0.02964898263233219, 0.016846013494272293, -0.009203538851611293, 0.013420656703089649, 0.007962548777980243, 0.013184813240601416, -0.01345434915848656, -0.02405610767960275, 0.01593632930574866, 0.03652215598898368, 0.027335463830732112, -0.02531394258394845, 0.00927092283108258, -0.017924157165812873, 0.009051924199308998, -0.012174052617209585, -0.007839011637503309, 0.02821145649518137, 0.003537662647532674, 0.00437434791301347, -0.05166110556557493, -0.0165203244153815, 0.021181053542656033, 0.005314917085148239, -0.016935858179352316, -0.016621398987604622, 0.015363564083258922, 0.01209543781927266, 0.026100090563317684, -0.0009223192085434256, -0.005615337520983252, 0.004191849674083843, 0.005393531883085162, 0.0165427841896677], [-0.01254103839737369, -0.03675000217713745, 0.09699461208385513, 0.022244467412292163, -0.029745277651054388, 0.020934802546429408, -0.0012278112774075998, 0.012183856646991786, -0.011459571767250508, -0.021034020061494258, 0.005789316020135149, 0.00497821651320403, -0.0065284834340039, 0.003983565441593225, -0.014783343620762352, -0.02285961339799112, -0.05976836508934838, 0.027324381086813506, 0.04353645264042601, 0.06782479303994475, -0.03236460924542497, 0.01022927979585259, 0.0042266471427828065, 0.008145721292716134, -0.024387556051938514, -0.04929104243715621, -0.008304468944290877, -0.04131398924366975, 0.008512824422075507, 0.008388803925228252, 0.06016523142431763, -0.0019124091278398749, 0.018305550504403894, -0.030479483909773137, -0.0021244854719870087, 0.04734638510234941, -0.025558317886826536, -0.03260272979146455, -0.04488580488484372, -0.002954188379408103, -0.0032791242511294237, 0.0374246782993463, -0.0432586428531864, 0.023752567308284612, 0.03708734210088695, -0.023276324353560383, -0.03240429476133485, 0.008279665031185933, -0.060601787000486906, 0.02057762172737004, 0.005248583170734826, -0.037960453253225494, 0.04718763931341974, -0.009599252207348693, -0.0036735121039993776, -0.011320667804953242, 0.012302916920011574, -0.01828570588380388, 0.061157402849675975, -0.0007304856833945385, 8.759006961649159e-05, -0.014049137362043605, 0.043973008216595284, 0.09675649153781556, -0.03655157087229789, -0.009678625101813528, 0.015825123803653116, 0.016390660100497115, 0.02599487346299581, -0.013939998468001286, -0.04992602931816503, 0.021450731017063518, 0.012203700336269262, -0.023554132278154914, -0.022780240503526287, 0.04829887101179787, 0.037623113329475995, 0.02109355019800415, -0.013265322345792432, -0.0011044099936315577, -0.029288879316930173, -0.0010944883818234533, 0.022383372305911965, 0.026510801933629924, -0.0007825746692560133, -0.03284085033750413, -0.005962946205837366, 0.04933072795306609, -0.029149976285955444, 0.051791311895861926, 0.02924919380102029, 0.004214245186230334, -0.004804586793163082, 0.002160451751348826, 0.038218414694574945, 0.017313379079045555, 0.043457077883316104, -0.005228739947118617, 0.013245479587837491, 0.0056504120578378825, 0.017829307549679665, -0.030023085575648922, -0.06778510379874472, -0.03260272979146455, -0.033455996323203084, 0.03690875169135726, -0.022184937275782267, 0.014455927869957932, 0.01718439649572576, 0.02383194020274945, -0.009033714047859622, 0.02809827472408721, -0.045481106249942664, 0.05921274924015932, -0.029646061998634614, 0.007515693238550968, -0.016410502858452056, -0.0436555129134458, -0.02543925761380675, 0.0018218735178722153, -0.01029873224266249, 0.039289960877043194, -0.021907129351187736, -0.006240753664770629, -0.017740012344914822, -0.015130603992166786, 0.03877403054376401, -0.013920155710046345, 0.0031302986770240532, -0.01643034747905207, 0.003353537154597426, -0.01368203423268423, -0.0388335606802739, 0.020756212136899724, 0.006409422695322843, 0.027542658874898145, -0.019714432885331496, 0.02158963404803825, -0.014098746119576028, -0.019000069384567688, 0.023276324353560383, 0.02901107139233564, 0.027760936662982783, 0.016866903055221344, -0.005471821648308199, 0.0194465454083919, -0.02984449516611924, 0.0018069909837447416, -0.03250351413904477, -0.028435612785191636, -0.015706061667988255, -0.035083158354860394, -0.009961394181558064, 0.03010246033275883, 0.005174170500097458, -0.0003534608258117429, -0.030598546045437998, -0.008775749812542566, 0.007337102363360017, 0.060681161757596816, 0.0030459641617479466, 0.013453835065622121, 0.04067899863737078, -0.04488580488484372, 0.02287945615594606, -0.028554673058211424, 0.02762203363200805, 0.010219358416875119, 0.0037776900757223275, 0.007986974572463926, 0.018484140913933578, -0.052783483321220265, 0.01092379960733892, -0.0224627452003768, -0.00048337316006089617, 0.00334113496521432, -0.009490113313306374, -0.02889201111931585, -0.06965038637644161, 0.005174170500097458, 0.0230977339440307, 0.007530575772678442, -0.004769860569758131, -0.04373488394526556, 0.014346788975915613, 0.03599595502310883, 0.06258612612591344, 0.052902543594240056, 0.03665078652471767, 0.005422212890775774, -0.025141606931257273, -0.02422880840036377, 0.09778834475379362, 0.062189259790944196, 0.022105564381317434, -0.040758373394480685, 0.04182991957694893, 0.038099354421555154, 0.07119816992569887, -0.04817981073877808, -0.021034020061494258, -0.048656051830857236, -0.0034601954710647433, 0.0018727222149461892, -0.020895115167874453, -0.016073166659992703, 0.03627376108505829, 3.1954873109847984e-05, 0.06992819616368122, -0.0038347398674878543, 0.011945735169629672, -0.0009493833830422926, 0.031551028229596316, 0.031511342713686434, -0.008850162483179935, -0.011796909828354935, 0.00944050455577395, -0.03571814523586923, 0.020041848636135916, 0.016658545714791643, 0.013295087414047379, 0.008101073690333712, 0.03974635734852233, 0.015398489606461311, 0.04821949625468796, 0.06639606231312699, -0.06643575155432702, -0.017045493464751028, 0.021907129351187736, -0.02397084509636925, -0.01755149962508513, -0.001587473139703237, -0.01664862526713671, -0.042345846184937974, 0.0181765679210841, -0.00992170680300311, -0.007173394487957807, -0.0021877364748594057, -0.03724608788981661, -0.004851714973120504, -0.0021703733631569305, 0.04067899863737078, 0.0275823462534531, -0.011290902736698295, 0.04536204597692287, -0.01042771389465975, 0.017382831525855454, 0.021133235713914032, 0.011171842463678505, 0.04048056733253123, -0.02287945615594606, -0.0013270283268111802, -0.017095101290960917, 0.023951000475769237, 0.0007397872672242096, 0.020776054894854665, -0.04329833209438643, -0.0607208472735067, -0.008800554656970046, -0.017214161563980705, 0.0025139126353682273, 0.009619094965303634, -0.009529799760538792, -0.03303928536763382, 0.0060820064788571545, 0.04103617945643015, -0.02434786867338356, 0.001568869972043895, -0.05508531774979629, 0.005417252201287039, -0.0037082380945736943, 0.001351832589162075, 0.02410974812734398, 0.0002596696906075275, 0.013592739027919389, -0.03184867891214579, -0.004869077619161712, 0.04623515712926143, -0.0034577148934897416, 0.010050689386322906, 0.005283308928478508, -0.02335569911067029, -0.005134483587203771, -0.005099757363798821, -0.022700865746416377, 0.03248366951844476, -0.031908209048655684, -0.00921726561253931, 0.02522097982572211, 0.06139552339571555, 0.025280509962232005, 0.016043399729092682, -0.022542118094841634, 0.026570332070139816, 0.0024729854336870407, -0.012600568533883584, -0.01755149962508513, 0.004841793128481766, 0.03514268849137029, 0.026808452616179396, 0.01205487406367199, 0.006786447669320956, -0.04563985203887234, 0.000701960787511775, 0.04933072795306609, 0.017968212443299467, -0.07596058829707072, 0.022938986292455957, -0.04476674461182393, -0.017878917238534624, -0.008597159403012882, 0.004727693544950712, -0.008071308622078764, -0.04107586869763017, -0.0024742257224745416, -0.014455927869957932, -0.017561421935385138, 0.004688006632057026, -0.04028213230240153, -0.036412665978678094, -0.025637690781291373, 0.03948839590717289, 0.0062159497516656856, 0.021450731017063518, -0.012937906594988011, 0.012927984284688004, 0.02448677356700336, -0.012640254981116003, -0.06250675509409367, 0.02498285927968253, 0.01961521537026665, 0.011578632040270298, -0.0094752307791789, 0.05472813693073692, 0.03849622448181455, -0.012511272397796206, -0.012630333602138532, 0.030658076181947894, 0.0261139337360156, 0.0224627452003768, -0.014842873757272248, -0.011836596275587353, 0.006315166801069266, 0.0008557472257288563, 0.015418333295738789, 0.040758373394480685, 0.00771412733735813, 0.04115524345474008, 0.03823825931517496, 0.023435072005135126, 0.003728081551020537, 0.00457142647095097, -0.0005503446800498446, 0.01574574904654321, 0.04230616066902809, -0.02762203363200805, 0.04738607434354944, -0.0023725283283265934, 0.010447557583937226, 0.025181292447167155, 0.00021951777128193133, 0.005883572380049993, 0.01807735040601925, -0.060562101484577024, 0.020091456462345805, -0.000560266408273266, -0.04022260216589164, -0.015954104524327842, -0.018732183770273164, 0.013344696171579804, -0.03484503408353067, 0.0012154090880244937, 0.019625137680566656, -0.006057202100090943, 0.009187500544284362, 0.040956808424610386, -0.014743657173529936, 0.030975569622452306, 0.026669549585204667, -0.00207115631375335, -0.013334774792602333, -0.03728577713101664, 0.026193306630480435, 0.007942326970081506, 0.014138432566808447, 0.007376789276253703, -0.036888907070757246, -0.013860624642213914, -0.001633361030873159, -0.017382831525855454, 0.0024841473342826458, -0.022423057821821846, 0.0011490577124292957, -0.020557777106770026, -0.0476638804054989, -0.024963014659082516, 0.05131507080378277, -0.06413391712575099, -0.03613485619143849, 0.026808452616179396, -0.0045763876261009735, 0.015844966561608057, 0.015805279183053102, -0.05198974692599162, 0.03561892958344945, 0.03913121508811352, -0.044965175916663484, -0.00424152967691028, 0.017611029761595027, -0.01610293172824765, -0.010963486054571338, 0.019009991694867695, -0.012402134435076423, 0.049410102710176, -0.04460799509760412, 0.030181833227223665, -0.0552440672640161, -0.02184759921467784, 0.01041779251568228, -0.00852770695620298, 0.04008369727227183, 0.020676837379789818, -0.03998448161985206, 0.01080473933431913, -0.012828767700945692, 0.028812638224851018, 0.011648084487080199, -0.03266225992797444, 0.03613485619143849, -0.021748381699612993, -0.007267650382211384, -0.056950600327493175, 0.012600568533883584, -0.017095101290960917, -0.025558317886826536, 0.0004055497825693884, 0.008393764149055719, 0.018345236020313776, -0.013136340693795172, -0.00925199183594426, -0.043973008216595284, 0.008329272857395821, -0.0030335619723648403, 0.0009351209351009108, -0.022641335609906485, 0.023633507035264824, 0.0015973948679266585, 0.0048293911719292934, 0.02676876523762444, 0.004509415756866074, -0.004678084787418288, -0.02712594791932888, 0.04433018903565465, 0.032920225094614036, 0.02865389057327627, 0.03022152060577862, 0.04202835088178849, -0.0010237961118873193, 0.022681022988461436, -0.017997977511554415, 0.03617454543263851, -0.011310746425975772, -0.031987583805765586, 0.03877403054376401, -8.696996160252775e-05, 0.024427243430493465, 0.02809827472408721, -0.004970775246140293, 0.022621492851951544, 0.02857451767881144, 0.003862024590998434, 0.048259185495887987, 0.0053329176860109325, 0.017591187003640086, 0.0026391741194948864, 0.0013456314944705222, 0.021411043638508567, 0.014961934961614572, -0.03075729183436767, -0.04933072795306609, 0.005799237864773887, 0.004869077619161712, 0.057347466662462425, -0.01755149962508513, -0.008785672122842572, 0.006409422695322843, -0.00848305935382056, -0.03500378359775049, -0.030519171288328092, 0.01635097272194216, -0.008800554656970046, 0.05353753047524888, -0.055005946717976525, -0.004487091955674863, 0.040758373394480685, 0.013910233399746338, -0.06111771733376609, -0.019049677210777577, 0.019198504414697386, -0.0007459883619157626, -0.024010530612279132, -0.008249899962930985, 0.009227187922839315, -0.00823997765263098, 0.05730778114655254, 0.06603888149406761, -0.029566687241524704, -0.025320197340786957, 0.028257022375661953, -0.014207885013618348, 0.02408990536938904, -0.0019012471108289526, -0.02726485095030361, -0.04413175400552496, 0.01212432651048189, 0.026272681387590344, 0.03192805366925569, 0.003919074149933327, -0.02081574227340962, 0.07234909086527702, 0.03359490121682289, 0.011975500237884618, 0.05119601053076298, 0.02147057377501846, -0.04675108373725046, 0.022244467412292163, 0.003666070836935641, 0.023653349793219765, -0.015329038090973947, 0.0013753966791407864, 0.029923869923229145, -0.06421328815757076, 0.028931698497870806, -0.02186744197263278, 0.048536991557837444, -0.0028748147864513652, -0.016688310783046587, -0.03639282135807808, 0.003524686529894007, 0.031193847410536945, -0.0013109056203115226, -0.01619222693301249, 0.01367211285370676, -0.013007358110475375, -0.017045493464751028, 0.0014175639367788398, 0.004764899880269396, 0.03484503408353067, 0.001772264993170425, -0.02672907972171456, -0.023177108701140606, -0.011588554350570303, -0.026788609858224455, -0.050838829711703615, 0.003740483740403643, 0.011290902736698295, 0.005843885467156308, -0.004883960618950453, 0.005298191462605982, -0.028336395270126786, 0.05857775863386035, -0.019525920165501805, -0.010864269470829026, -0.029308723937530187, 0.003991006708656961, 0.03740483740403643, 0.003100533608769106, 0.00637469693757916, -0.013136340693795172, -0.0039662023298907495, -0.012134247889459361, 0.07250783292891655, 0.01053685278870207, -0.014545223074722774, 0.008899771240712359, -0.0393098054976432, 0.05611717469106451, -0.0037256009734455355, -0.02990402530262913, -0.018087272716319255, -0.001924811200807664, 0.008056426087951292, -0.011340511494230718, -0.046036722099131726, -0.0031302986770240532, -0.03258288517086454, -0.00116518053534427, 0.008488020508970564, 0.02107370557740414, 0.016767685540156497, -0.036591256388207774, 0.011062703569636186, -0.010169749659342696, 0.0040108499322731705, 0.005273387549501038, 0.01316610576205012, -0.016866903055221344, -0.016906588571131226, -0.01205487406367199, 0.043853944218285354, 0.01649979992586197, 0.05488688271966659, -0.04742575985945932, -0.03270194544388432, 0.003968682907465751, -0.04329833209438643, 0.03131290768355673, -0.014475770627912873, -0.05159287686573223, 0.01022927979585259, -6.425855561330864e-05, 0.02909044614944555, 0.027165635297883836, -0.023871627581304403, 0.006910469097490748, -0.02135151350199867, -0.07905616284616554, -0.02154994853212837, 0.01583504425130805, 0.009177579165306891, 0.021748381699612993, -0.0130569668680078, -0.022105564381317434, -0.023038203807520804, 0.022165094517827326, 0.021034020061494258, -0.026391741660610132, 0.019545762923456746, -0.0055115085612018845, -0.013225635898560014, -0.00551646925069062, -0.0036933555604462204, -0.02633221152410024, -0.01212432651048189, -0.013691955611661701, 0.006920390942129487, 0.03210664407878538, -0.0019706992083929026, 0.07223003059225724, -0.005104718518948824, 0.014168197635063393, 0.02071652475834477, 0.005471821648308199, -0.049767283529235366, 0.030300893500243453, 0.017303456768745548, -0.005590881921327988, -0.01286845414817811, 0.034090986929502055, 0.008721180831182675, 0.010139984591087748, -0.0010932480930359524, -0.02839592540663668, 0.01173737969184504, -0.009787763995855847, -0.009490113313306374, -0.015676296599733307, 0.01143972807797303, -0.03530143428029996, 0.027403755843923412, -0.05159287686573223, -0.006389579471706634, -0.004246490832060284, 0.024308183157473677, -0.015239741954886568, 0.012253308162479151, 0.012560881155328631, -0.021371358122598685, 0.008696375986755194, 0.024923329143172638, 0.006885664718724536, -0.011142077395423559, 0.019853335916306225, 0.00586868984592252, 0.03256304427555467, 0.0010975888709615711, -0.01185643996486483, -0.03676984679773746, 0.0056206469895829355, -0.010020924318067958, 0.036253916464458275, 0.05103726101654316, -0.01154886697201535, 0.021788069078167945, -0.048576677073747326, 0.011707614623590093, 0.017511814109175253, -0.0202204390456656, 0.004350668570952599, 0.009247031612116792, -0.02156979129008331, 0.02071652475834477, -0.01942670265043696, 0.0006808771586927483, 0.012828767700945692, 0.03419020258192183, -0.0224627452003768, -0.018305550504403894, 0.009624056120453637, 0.012799002632690746, 0.00471529158839824, -0.019555685233756753, 0.026391741660610132, 0.016132696796502595, -0.0014758539009165506, -0.024308183157473677, -0.009172618010156888, -0.013592739027919389, 0.006414383850472846, -0.011489336835505456, -0.007942326970081506, -0.015289350712418994, -0.025379727477296853, -0.02625283676699033, -0.023196951459095547, 0.0024357790983683563, -0.0028698538641319963, 0.028316552512171845, 0.03885340530087392, 0.005590881921327988, 0.0046135939614196575, 0.011876283654142306, 0.01749196948857524, -0.0039885261310819604, 0.027423598601878353, 0.010125102056960274, 0.02071652475834477, -0.024427243430493465, 0.0014436083715019187, -0.007991934796291393, -0.00187396250373369, -0.007942326970081506, -0.023415229247180185, 0.011965578858907148, -0.023673192551174706, 0.017283614010790607, -0.029943712681184086, 0.01755149962508513, -0.03325756129307339, -0.04250459197386765, 0.041869605092858815, 0.0020537934348815088, 0.000489264182555574, -0.03863512937543435, -0.002820245339430206, 0.007719088026846865, 0.005561116853073041, -0.0202204390456656, -0.0363531358421682, -0.003963722217977016, -0.011290902736698295, 0.002046352167817772, 0.013275244656092438, 0.023792254686839567, -0.0072031595562127545, -0.009862176666493215, -0.01909928689963254, 0.0003875667010961382, -0.008091152311356242, 0.021192765850423928, 0.04944978822608588, 0.004906284420141664, 0.02020059628771066, 0.04933072795306609, -0.01692643319173124, 0.005194013723713666, -0.03311866012474373, -0.022244467412292163, -0.006280440577664316, -0.010095336988705326, 0.029328566695485128, -0.0008656689539522777, 0.01723400618458072, 0.007798461852634236, 0.010645991682744388, 0.023157264080540595, 0.003767768231083589, -0.01143972807797303, -0.007376789276253703, 0.00020230981209321065, 0.04026228768180152, -0.011171842463678505, 0.01141988532001809, 0.012412055814053894, -0.02244290244242186, -0.055879054145024934, 0.030300893500243453, -0.004680565364993289, 0.015190134128676681, -0.02222462465433722, 0.055521873325965566, 0.01172745831286757, 0.010159828280365225, 0.012789080322390739, 0.022046034244807538, 0.006077045789368419, -0.016599015578281747, -0.058934939452919714, 0.014872638825527194, 0.01469404841599751, 0.016132696796502595, -0.0030137185159179974, -0.026451271797120028, 0.010467401273214704, -0.03301944074703381, 0.03869465951194424, -0.003596618855787008, 0.016767685540156497, -0.02661001944869477, 0.024566146461468197, 0.025796438432866116, 0.008701337141905198, -0.04817981073877808, -0.00859219824786288, 0.01142980669899556, -0.014842873757272248, 0.02637189704001012, 0.029507157105014812, 0.0021753342854762994, 0.008651728384372774, -0.02684813999473435, 0.01285853276920064, 0.019982318499626023, -0.01786899492823462, -0.010973408364871344, -0.0130569668680078, -0.002051312857306507, -0.01093372098631639, 0.01826586312584894, 0.013136340693795172, -0.028832480982805955, -0.01989302329486118, 0.01073528688750923, -0.01838492339886873, 0.003646227380488798, 0.005531351784818093, 0.002458102899559567, 0.01629144258543227, 0.0031526224782152637, 0.013741564369194124, 0.031352593199466615, 0.014207885013618348, -0.0012811404356412584, 0.017859072617934613, 0.003963722217977016, 0.018523828292488533, -0.015596923705268472, -0.01661886019888176, -0.020379186697240342, 0.03915105598342339, 0.013513365202132017, 0.06556264040198846, 0.007059294904426753, 0.01886116635359296, -0.03887324992147393, 0.016182304622712484, 0.022780240503526287, -0.007778618629018027, -0.0026292525076867823, -0.02283977064003618, -0.0023923715519428026, -0.039289960877043194, 0.020478404212305193, 0.008998988755777208, -0.01937709482422707, -0.04671139822134058, 0.003157583400534633, -0.026034558978905692, 0.018017820269509356, 0.02913013166535543, -0.01530919440169647, -0.020418874075795297, 0.0203593439392854, -0.043496763399225986, 0.055005946717976525, 0.02027004873452056, 0.028018901829622373, -0.0028599320194932576, -0.01022927979585259, -0.02154994853212837, 0.03617454543263851, -0.034606913537491096, 0.0005174790644491208, 0.002427097542517119, -0.02712594791932888, -0.01654940775207186, 0.016638702956836702, 0.017105023601260923, 0.011122233706146081, -0.021530103911528355, 0.03599595502310883, 0.02244290244242186, 0.0017958289667338193, 0.018513905982188526, -0.007257729003233913, 0.01205487406367199, 0.015160369060421734, -0.01450553569616782, -0.025538475128871595, -0.007590105909188337, -0.0551646925069062, 0.005600803765966726, -0.02901107139233564, 0.01744236166236535, 0.004752497923716924, -0.02682829723677941, -0.015944184076672904, -0.008160603826843606, 0.002451901921283331, -0.02813796210264216, -0.02670923510111455, -0.004618554650908393, 0.0361547008120385, -0.0016606457543837385, 0.01982357084805128, -0.04278240176110725, -0.005203935568352405, -0.0014696529226403147, -0.05572030835609526, 0.0519500576847916, -0.005580960542350517, 0.005094796674310086, -0.004343227303888862, -0.023891470339259344, 0.003437871669873533, -0.03182883801683592, 0.016529564994116917, 0.021291983365488775, 0.004425081241589968, -0.0031278180994490515, 0.005451977959030721, -0.03680953231364734, -0.03478550394702078, -0.024705051355088, 0.023792254686839567, -0.018335315572658842, 0.02990402530262913, 0.00489140188601419, -0.009281756904199207, 0.005228739947118617, 0.0017189358349367664, 0.012699785117625897, -0.0033609784216611627, -0.029328566695485128, -0.046989204283290044, -0.012263230472779158, 0.00669219130940611, -0.004325864192186387, -0.012670020049370949, -0.035222059523190054, 0.008334234012545823, -0.03061838880339294, 0.017452282110020284, 0.014783343620762352, 0.006414383850472846, -0.020279969182175495, -0.03466644367400099, -0.006568170346897586, -0.021788069078167945, -0.016866903055221344, 0.018027742579809363, -0.028276865133616894, -0.006736839377449799, 0.00012479647769474884, -0.010338418689894909, -0.020061691394090857, -0.036412665978678094, -0.020478404212305193, 0.0392304307405333, 0.020399029455195283, 0.029745277651054388, 0.027602189011408037, -0.00771412733735813, -0.005030305382650188, -0.0060075938082197865, 0.007857991989144131, 0.03480534856762079, 0.012699785117625897, -0.02011130108294582, -0.04671139822134058, -0.005967906895326101, 0.03675000217713745, -0.006235792975281895, 0.02696720026775414, -0.0069799210786393815, 0.024288338536873663, -0.021669008805148156, 0.008939458619267312, 0.042901462034127036, 0.004958373289587821, 0.009748077548623429, -0.008101073690333712, 0.025340040098741898, 0.000550964824443595, -0.0068608603399583235, -0.01564653153147836, -0.020875272409919515, 0.04012338278818171, 0.02601471622095075, -0.04034166243891143, -0.0030310816276204727, 0.010566617856957016, -0.024526460945558316, 0.012967671663242959, -0.01115199877440103, -0.0172736917004906, -0.06310205645919263, -0.014604753211232668, -0.026629862206649712, -0.0403019731977114, -0.0022832328907311174, 0.009807607685133325, -0.012967671663242959, 0.02222462465433722, 0.03915105598342339, 0.004067899956869332, 0.0037256009734455355, -0.0019446546572545068, -0.02260164823135153, 0.01022927979585259, 0.011786988449377464, 0.03397192665648227, -0.004134871360442963, -0.01619222693301249, -0.017799542481424718, -0.012382290745798946, 0.016321207653687213, -0.008701337141905198, -0.03740483740403643, -0.005000540314395241, -0.00817548636097108, -0.054926571960866616, -0.03381317714226245, 0.002259668800752406, 0.013116497004517695, -0.03589673564539891, -0.018533748740143467, 0.013195870830305066, 0.02212540713927237, 0.029784965029609343, 0.01807735040601925, -0.01273947249618085, 0.02337554186862523, -0.02260164823135153, -0.04055993836435099, -0.0015849926785435524, 0.027443441359833294, 0.05738715590366245, 0.006672348085789902, 0.01991286605281612, 0.040877433667500476, -0.02940793958994996, -0.008706298297055201, -0.014098746119576028, -0.01091387822836145, 0.009346248195859105, -0.012918062905710534, -0.028276865133616894, 0.01406898105132108, 0.003819857333360381, 0.0062159497516656856, 0.020756212136899724, -0.023573976898754928, -0.027006887646309093, -0.0654832693701687, 0.03510299925017026, -0.06409422788455096, 0.009232148146666782, -0.008383842770078248, 0.01205487406367199, -0.036452351494587976, 0.03339646618669319, -0.03639282135807808, -0.004906284420141664, 0.0026143699735593083, 0.001493216896203709, -0.0015725906055757634, -0.008919614929989836, 0.021986504108297642, 0.042068040122988516, -0.001701572839649608, -0.0013121457926837065, 0.022740553124971332, -0.03224554897240518, 0.009504995847433848, 0.0010932480930359524, 0.010189593348620171, -0.006072084634218416, -0.02230399754880206, -0.0074710456361685475, 0.02625283676699033, 0.01838492339886873, 0.012025108995417044, 0.033713961489842674, 0.018126958232229137, 0.0039885261310819604, -0.015090916613611833, 0.0419092906087687, -0.0067219568433223255, 0.010368183758149855, 0.021391200880553626, 0.006707074309194852, -0.003899230926317118, 0.015279429333441523, -0.022780240503526287, -0.00354452998634085, -0.01564653153147836, -0.005600803765966726, 0.05119601053076298, -0.027760936662982783, 0.010854348091851556, -0.007689322958591918, 0.06091928230363639, -0.00391163288286959, -0.03367427597393279, -0.0014721332673846821, 0.02131182798608879, -0.029209506422465337, 0.020399029455195283, -0.03178914877563589, 0.011300824115675765, 0.013414148618389705, -0.02258180547339659, 0.016132696796502595, -0.00979272515100585, 0.020974489924984362, -0.018960382006012733, 0.028058587345532255, -0.021986504108297642, 0.013870546952513921, 0.02498285927968253, 0.019049677210777577, 0.007312298450255073, -0.023891470339259344, 0.002775597504217151, -0.02206587700276248, 0.005853807311795046, -0.0039959673981456965, -0.02232384216940207, 0.002107122593115167, 0.020438716833750238, -0.028673733331231212, 0.02337554186862523, 0.0210538628194492, -0.010125102056960274, -0.0025573199489631474, 0.004859156240184241, 0.056434669994213996, 0.026391741660610132, -0.012997436731497905, 0.003909152770955856, 0.01855359336074348, 0.05357721971644891, -0.006850938960980853, -0.027959371693112477, -0.013116497004517695, 0.03137243782006663, -0.010368183758149855, 0.02462567659797809, -0.02813796210264216, -0.01398960722553371, 0.001428725837374445, 0.005179131189586192, 0.02748312873838825, -0.025895655947930963, -0.013414148618389705, 0.020875272409919515, -0.023871627581304403, -0.00858227686888541, 0.007118825040936647, -0.025578160644781477, 0.0334163108072932, -0.029943712681184086, 0.020914959788474467, 0.01317602714102759, 0.0007546698595593417, 0.0034601954710647433, -0.002375008673070961, 0.012074717752949467, -0.012074717752949467, 0.03726593251041663, 0.012094561442226945, 0.0016569251208518702, -0.053180349656189514, -0.004095184447549277, -0.026689392343159608, 0.009683586256963531, 0.024526460945558316, 0.022681022988461436, 0.03462675815809111, 0.01591441900841796, 0.019496155097246858, -0.024784424249552833, 0.053497844959339, 0.012402134435076423, -0.011062703569636186, 0.011459571767250508, -0.006518561589365162, -0.0064391882292390585, -0.044290499794454624, 0.01154886697201535, -0.03857559923892446, 0.000647391398698274, -0.036630941904117656, -0.00481450863780182, 0.01073528688750923, 0.03196773918516557, -0.022482587958331742, -0.016638702956836702, 0.038932780057983826, -0.0013431511497261545, 0.0026069284736649377, -0.034825193188220804, -0.0027011848335797826, -0.008051465864123825, -0.02045855959170518, 0.06588013943042809, -0.024566146461468197, 0.01744236166236535, -0.002491588834177017, -0.0033709000334692673, 0.03557924034224942, -0.019049677210777577, 0.009063479116114569, -0.006994803612766855, 0.0022770319124548817, -0.004648319719163341, 0.017620952071895034, -0.02287945615594606, -0.005372604598904618, 0.008631885626417833, -0.014525379385445297, 0.01934732975597212, 0.02059746448532498, 0.023772410066239553, 0.02823717961770701, 0.026629862206649712, 0.0609986570607463, -0.006265558043536842, -0.02260164823135153, -0.004598711427292184, -0.023058048428120818, -0.005595843076477991, -0.025637690781291373, -8.541000726843378e-06, -0.006017515652858524, 0.009877059200620689, -0.005050149071927665, 0.01576559366714322, -0.02897138587642576, 0.012223543094224203, 0.02420896564240883, -0.003316330586448108, 0.039210586119933284, 0.024585991082068208, -0.03964714169610256, -0.008800554656970046, -0.026193306630480435, 0.014346788975915613, -0.01770032496635987, -0.03470613291520102, -0.0036363057686806936, 0.030201675985178606, -0.008939458619267312, 0.012848610458900633, 0.01349352151285454, -0.00551646925069062, 0.03905184033100361, 0.017611029761595027, -0.005819081088390096, 0.0026714197653248356, 0.02635205428205518, 0.013572895338641911, -0.013404226308089698, 0.004447405042781178, 0.014515458006467826, -0.015924339456072894, 0.012650176360093473, -0.013880468331491392, -0.016509720373516903, 0.03657141176760776, -0.016321207653687213, 0.017283614010790607, 0.011816753517632412, 0.0009642659171697662, -0.020776054894854665, 0.07171410025897805, 0.04837824576890778, 0.06457046897663012, 0.02787999693600257, 0.03452754250567133, -0.0012395933223969553, 0.003695835905190588, -0.022403215063866905, 0.024447086188448406, -0.024149435505898934, 0.025697220917801265, -0.00032958672184381485, 0.007857991989144131, 0.00669219130940611, -0.014436084180680455, 0.0024221368530283837, 0.02418912288445389, 0.05071976571339368, -0.019337407445672115, 0.011757223381122518, 0.012283073230734099, 0.015140525371144256, 0.011161921084701034, -0.013463756444599592, -0.013433991376344646, 0.015517549879481101, 0.039369335634153096, -0.005000540314395241, 0.00658305288102506, -0.02206587700276248, 0.0194465454083919, 0.030380268257353363, 0.0003215253394901569, -0.020934802546429408, 0.000276257534506327, -0.004970775246140293, 0.03569830434055936, -0.008607080781990352, 0.015775514114798158, 0.05841901284493067, -0.005630568834221673, -0.02724500819234867, -0.04786231543562859, 0.009435543400623947, 0.009504995847433848, -0.01267994142834842, 0.03553955482633954, -0.0010442597127279126, -0.011767144760099987, -0.010085415609727857, 0.025617848023336432, 0.03952808142308277, -0.01716455373777082, 0.0504816451673541, 0.0013989607691194978, -0.042425220942047884, -0.0008073789316069084, 0.017303456768745548, -0.030539014046283033, 0.04115524345474008, -0.005744668417752728, -0.04202835088178849, 0.01653948544177185, -0.007600027753827076, 0.0577840222386317, 0.015071072924334355, -0.03794060863262548, 0.022760395882926273, -0.021232453228978883, -0.009777842616878377, -0.01080473933431913, 0.03798029414853536, -0.007753814250251815, -0.003576775399340165, 0.0002655606839983761, -0.010824583023596608, -0.03458707264218123, 0.0058736505354112555, -0.0033584978440861614, -0.012769237564435798, -0.00508983598482135, 0.02988418254467419, -0.013473678754899599, 0.022780240503526287, -0.04262365597217758, -0.0037057577498293267, 0.012947827973965481, -0.001861560314350584, -0.0064540707633665316, -0.018752026528228105, 0.02071652475834477, -0.01141988532001809, 0.0061861846834107385, 0.010199514727597642, -0.014604753211232668, -0.0032047113476614216, 0.01928779961946223, 0.01696611870764112, 0.0001818462840121905, -0.015190134128676681, -0.02109355019800415, 0.0078034225421229715, 0.004742576079078185, 0.013195870830305066, -0.017571344245685145, -0.0007515693122135652, -0.02186744197263278, -0.046433588434100975, -0.0004309741602102047, -0.007862953144294135, -0.07346032256365516, 0.001111231232716861, 0.022264310170247104, -0.0023402826824966447, -0.004053017422741858, 0.01908936458933253, -0.006702113154044849, 0.010556696477979546, -0.0038868287369340122, 0.014555144453700245, 0.001989302376052245, 0.007977052262163921, -0.023514446762245036, -0.023058048428120818, 0.02422880840036377, -0.019000069384567688, -0.001678008749670897, 0.0017065336455536603, 0.04127430372775987, -0.00812091737961119, 0.002840088795877049, -0.0035122843405109012, 0.029784965029609343, -0.030896196727987473, 0.013017279489452846, -0.03978604658972236, 0.016073166659992703, -0.002038910900754035, 0.02599487346299581, 0.010259044864107537, -0.027046573162218975, 0.022780240503526287, -0.010447557583937226, -0.010963486054571338, 0.00514440543184251, 0.00017456003849497664, 0.01349352151285454, -0.0024618235330914353, 0.013612582717196864, 0.04034166243891143, -0.010606305235511971, -0.0036685511816800086, -0.01654940775207186, -0.04115524345474008, -0.013146262072772643, 0.04639390291819109, 0.002257188456008039, 0.004688006632057026, -0.007585145219699602, -0.00852770695620298, 0.007654597200848235, -0.014574988142977722, 0.02764187638996299, -0.0061861846834107385, 0.014981777719569513, 0.011826674896609882, 0.02337554186862523, 0.04464768433880414, -0.027006887646309093, 0.03887324992147393, 0.03831763407228486, 2.9687608413387015e-05, 0.02863404781532133, 0.011558789282315357, 0.05210880719901141, -0.0034651561605534786, -0.01897030431631274, -0.02863404781532133, -0.007843109455016657, -0.00423160829793281, 0.01645019023700701, 0.002676380454813571, 0.010388027447427332, 0.018345236020313776, -0.03218601883589529, 0.05464876217362701, 0.05909368896713953, 0.0067566826010660086, 0.021748381699612993, -0.0007218041857509594, -0.04925135319595618, 0.03268210454857445, -0.0025126723465807264, 0.013285166035069908, -0.0007993175201494212, 0.014396396802125502, 0.019129051967887483, -0.02069668200038983, -0.01104285988035871, -0.04222678591191818, 0.02371287992972966, -0.0015378646150014468, 0.003385782567596741, -0.005194013723713666, 0.03401161217239215, -0.02524082258367705, -0.009123010183946999, 0.017918602754444506, 0.05937149502908899, 0.009043636358159628, -0.026887827373289302, 0.007743892405613077, -0.057903082511651494, 0.022661180230506495, 0.006726917532811061, -0.009633977499431108, 0.0031104552205772104, 0.023137421322585654, 0.027106103298728867, -0.011995343927162096, -0.009886981510920696, 0.007972092038336452, -0.025816283053466126, 0.0009072161254042392, -0.023038203807520804, -0.03073744907641273, 0.000520889625784114, 0.005804198554262622, -0.00020804579848945087, 0.02924919380102029, 0.01428725883940572, -0.014555144453700245, -0.028475300163746588, 0.014059058741021075, 0.020776054894854665, 0.0015267027144058416, -0.005466860493158195, -0.016162461864757543, 0.014009450914811187, -0.003251839527618844, 0.003410586946362953, -0.018841321732992945, -0.0005044567888799228, 0.039389176529462964, 0.012580724844606107, -0.0334163108072932, 0.03133275230415675, -0.0058587680012837815, -0.01770032496635987, -0.02158963404803825]]
Process finished with exit code 0
4.4.计算两个向量的相似度
import os
import numpy as np
from langchain_openai import OpenAIEmbeddings
from numpy.linalg import norm
os.environ["OPENAI_API_KEY"] = 'sk-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' # 你的Open AI Key
def cosine_similarity(vector1: list, vector2: list) -> float:
dot_product = np.dot(vector1, vector2)
vec1 = norm(vector1)
vec2 = norm(vector2)
return dot_product / (vec1 * vec2)
# 嵌入单个文档
def embed_query(str):
query_vector = embeddings.embed_query(str)
return query_vector
# 嵌入多个个文档
def embed_documents(strs):
documents_vector = embeddings.embed_documents(strs)
return documents_vector
if __name__ == '__main__':
embeddings = OpenAIEmbeddings(model="text-embedding-3-small")
str1 = '我叫张无忌，我会九阳神功'
str2 = '张无忌会九阳神功'
str3 = '我是蜘蛛侠，我会爬墙'
documents_vector = embed_documents([str1,str2,str3])
query_vector1 = documents_vector[0]
query_vector2 = documents_vector[1]
query_vector3 = documents_vector[2]
print(f'query_vector1与query_vector2的余弦相似度为：{cosine_similarity(query_vector1,query_vector2)}')
print(f'query_vector1与query_vector3的余弦相似度为：{cosine_similarity(query_vector1, query_vector3)}')调用结果：
结论说明：
第一句和第二句相似度的值更接近 于1，所以语义最接近。
五、附带说明
5.1.优先使用text-embedding-3-small模型
OpenAIEmbeddings类模型使用text-embedding-ada-002模型，但无论性价比以及性能均不如text-embedding-3系列的模型
扫一扫
6万+
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
