- 博客(11)
- 收藏
- 关注
RSS订阅原创 2020-12-29 bert state dict
the teacher layer ids to distill is: [0, 1, 2, 3, 4, 5]odict_keys([‘bert.embeddings.word_embeddings.weight’,‘bert.embeddings.position_embeddings.weight’,‘bert.embeddings.token_type_embeddings.weight’,‘bert.embeddings.LayerNorm.weight’,‘bert.embedding
2020-12-29 21:08:30
322
原创 HuggingFace的DistilBERT学习笔记-MyToolkit
HuggingFace的DistilBERT学习笔记-顺序版学习DistillBERT My Toolkitpython 代码规范os模块argparse 模块logging 模块shutil 模块深浅拷贝 地址引用还是值引用 函数 循环读写 json pickle numpy torch等todo torch的DistributedParall多机多卡训练todo from torch.utils.data import BatchSampler, DataLoader, RandomSampler, D
2020-09-16 11:11:31
868
原创 bash命令行积累
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main/conda config --add channels ht...
2019-11-19 22:24:37
242
转载 Google SDE Predoc
Software Engineering Prep DocBest of luck in your upcoming interview! Here are some tips to help you prepare. We hope you’ll take the time to review the links and tips in this document. Please keep i...
2019-11-19 22:23:42
349
转载 A Tutorial on Torchtext 【转载】
A Tutorial on Torchtextreference: http://anie.me/On-Torchtext/这个网页有时候打不开，所以粘贴过来。October 29, 2017About 2-3 months ago, I encountered this library: Torchtext. I nonchalantly scanned through the READ...
2019-01-02 15:07:27
352
原创 那些年pytorch走过的坑
pytorch 注意 torch.Tensor.normal_(mean,std) 以及torch.nn.init.normal(tensor,mean,std) 有一个容易错的点a=torch.zeros(16655,200)b=torch.FloatTensor(1,200)for i in range(4): a[i].normal_(mean=4, std=5) #只会重复...
2018-12-18 22:53:19
198
原创 C++输入输出
只有数字scanf/printf("%.5f",a);cin>> cout<<只有字符串stringstring.hscanf("%s",a.c_str())cin coutstr.assign(100,’\n’);getline(cin,a) #接收空格char a[10];scanf("%s",a);...
2018-12-17 22:42:43
147
原创 C++数据结构与算法
C++数据结构与算法面向对象的抽象封装继承多态（刷题用不到就不写了）指针（不知道要用到多少 复制构造函数、析构函数、函数引用变量、函数指针）STL容器（即数据结构）概述vectorstack queue priority_queue dequestackqueuepriority_queuedequelist 刷题好像不常用到就不写了STL算法面向对象的抽象封装继承多态（刷题用不到就不写了）指...
2018-11-21 18:33:10
1180
1
原创 python一些包的学习
argparse[argument parser]http://www.cnblogs.com/lovemyspring/p/3214598.htmlmultiprocessing
2018-11-20 17:06:01
186
原创 pytorch零星笔记
pytorch marktensorlayer torch.nn.function torch.nn.functional.stacked layerstensorimport torchx=torch.empty(5,3)x=torch.rand(5,3)torch.randint(5, (3,), dtype=torch.int64)x=torch.zeros(5,3)x=tor...
2018-11-14 20:02:22
1319
原创 这个是默认标题吗？是的呀！找了大半天！
呀呀呀一些网页教程各种二叉树的定义C++数据结构理解与运用一些网页教程问题复杂性分类：P,NP,NPC,NPH,PSPACE,EXPTIME等http://swarma.blog.caixin.com/archives/191332C++ stl库的学习https://www.cnblogs.com/CnZyy/p/3317999.htmlhttps://www.cnblogs.com...
2018-11-12 12:53:13
131
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人