DL工程技巧
小鹏聊智驾
上汽智驾搬砖
展开
-
gnutls_handshake() failed: The TLS connection was non-properly terminated
Errorchiyukunpeng@chiyukunpeng: ~$ git clone --recursive https://github.com/mrnabati/CenterFusion.git正克隆到 'CenterFusion'...fatal: unable to access 'https://github.com/mrnabati/CenterFusion.git/': gnutls_handshake() failed: The TLS connection was non-pro原创 2021-07-05 09:38:38 · 466 阅读 · 0 评论 -
Docker pull加速
打开配置文件cp@ubuntu:~$ sudo vi /etc/docker/daemon.json编写配置文件{ "registry-mirrors": ["<your accelerate address>"]}加速地址有:https://registry.docker-cn.comhttp://hub-mirror.c.163.comhttps://3laho3y3.mirror.aliyuncs.comhttp://f1361db2.m.daocl.原创 2020-12-11 14:29:53 · 973 阅读 · 0 评论 -
Linux下CUDA版本切换
cp@ubuntu:/usr/local$ lsbin cuda cuda-10.0 cuda-10.1 etc games include lib man sbin share srccp@ubuntu:/usr/local$ sudo rm -rf cuda[sudo] cp 的密码: cp@ubuntu:/usr/local$ lsbin cuda-10.0 cuda-10.1 etc games include lib man sbin share原创 2020-11-10 20:33:55 · 895 阅读 · 0 评论 -
Pycharm+MobaXterm远程GUI调试
文章目录前言问题1问题二前言你是否遇到过以下困境:利用远程服务器资源训练网络时,本地需要查看tensorboard利用本地PyCharm+远程服务器环境调试代码时,无法实时显示图片流本文将利用MobaXterm软件帮你解决上述问题。问题1Mobaxterm连接服务器,开启训练任务,开启tensorboardMobaxterm开启端口转发功能,如下图打开本地浏览器,输入127.0.1.1:转发端口号,即可查看tensorboard问题二Mobaxterm终端输入以下命令查看原创 2020-11-02 16:12:29 · 2511 阅读 · 1 评论 -
Python之xml转txt(yolo)
import os, reimport xml.etree.ElementTree as ETclass_index = {"car": 0, "truck": 1, "chemical_vehicle": 2, "bus": 3, "chemical_sign": 4}def getbox(box, w, h): xmin = float(box.find("xmin").text) / w ymin = float(box.find("ymin").text) / h原创 2020-10-30 16:47:30 · 838 阅读 · 0 评论 -
Pandas_profiling数据分析
import pandas_profilingimport pandas as pdimport argparsedef eda(in_file, out_file): data = pd.read_csv(in_file, sep=',') pfr = pandas_profiling.ProfileReport(data) pfr.to_file(out_file)if __name__ == '__main__': parser = argparse.A原创 2020-09-29 13:51:35 · 169 阅读 · 0 评论 -
Python视频分帧
import cv2import argparsedef main(in_path, out_path, name): cap = cv2.VideoCapture(in_path) frames = int(cap.get(7)) count = 0 while cap.isOpened(): _, image = cap.read() if count % 600 == 0: cv2.imwrite(out原创 2020-09-28 14:22:21 · 424 阅读 · 0 评论 -
Tensorboard远程访问服务器
连接ssh时,将服务器的6006端口重定向到本地ssh -L 16006:127.0.0.1:6006 username@remote_server_ip在服务器上使用6006端口正常启动tensorboard$ tensorboard --logdir=xxx --port=6006在本地浏览器中输入地址:https://127.0.0.1:16006...原创 2020-09-26 09:15:15 · 523 阅读 · 0 评论 -
PyTorch训练过程可视化
logger.pyimport tensorflow as tfimport warningswarnings.filterwarnings("ignore")# 注释部分适用于tf2.0以下class Logger(object): def __init__(self, log_dir): """Create a summary writer logging to log_dir.""" # self.writer = tf.summary.File.原创 2020-09-24 15:42:26 · 592 阅读 · 0 评论 -
Python改写xml文件
# -*- encoding=utf-8 -*-import globimport xml.etree.ElementTree as ETdef main(path): value_list = [] info_list = [] for xml_file in glob.glob(path + '*.xml'): print(xml_file) tree = ET.parse(xml_file) root = tree.g原创 2020-09-16 10:43:48 · 222 阅读 · 0 评论 -
linux软连接显示broken link
解决方案sudo ln -s 源文件 目标文件原创 2020-09-12 10:40:04 · 1602 阅读 · 0 评论 -
Python+OpenCV读取json文件并显示
import osimport jsonimport cv2underwater_classes = ['holothurian', 'echinus', 'scallop', 'starfish']root_dir = '/media/chiyukunpeng/CHENPENG01/contest/underwater_object_detection20200827/data/test-A-image/'images = [os.path.join(root_dir, f) for f i原创 2020-09-02 19:41:12 · 1641 阅读 · 0 评论 -
Linux下gcc多版本共存切换
安装$ sudo apt-get install gcc-4.8 g++-4.8 配置$ sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-4.8 50$ sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-4.8 90切换(py37torch11) chiyukunpeng@chiyukunpeng:/media/chi.原创 2020-08-31 15:13:07 · 831 阅读 · 0 评论 -
conda清华源安装cudatoolkit超时
问题描述(py37torch11) chiyukunpeng@chiyukunpeng:~$ conda install pytorch==1.1.0 torchvision==0.3.0 cudatoolkit=9.0Fetching package metadata .......Solving package specifications: .Package plan for installation in environment /home/chiyukunpeng/anaconda3.原创 2020-08-31 14:34:41 · 9702 阅读 · 4 评论 -
Python数据集随机抽样划分
import shutilimport osfrom tqdm import tqdmimg_path = './train-A/image/'xml_path = './train-A/box/'val_img_path = './coco/images/val/'val_label_path = './coco/labels/val/'img_list = os.listdir(img_path)val_img_list = []for i in tqdm(range(1, 65原创 2020-08-29 13:54:15 · 2287 阅读 · 0 评论 -
Python+opencv读取xml文件并显示
代码import osimport xml.dom.minidomimport cv2ImgPath = './train-A/image/'AnnoPath = './train-A/box/'imagelist = os.listdir(ImgPath)for image in imagelist: image_pre, ext = os.path.splitext(image) # 分离文件名与扩展名 imgfile = ImgPath + image .原创 2020-08-28 10:25:05 · 2121 阅读 · 1 评论 -
Linux查看CPU工作情况
查看CPU使用$ top2. 退出请按CTRL+C原创 2020-08-22 09:25:34 · 215 阅读 · 0 评论 -
Linux下pip换阿里源(比清华源6)
创建目录$ mkdir ~/.config/.pip创建文件$ touch ~/.config/.pip/pip.conf编写文件[global] timeout = 60000index-url = https://mirrors.aliyun.com/pypi/simple/原创 2020-08-21 16:33:24 · 990 阅读 · 0 评论 -
jupyter notebook 切换kernel
激活想要更换的环境$ source activate pytorch(你的环境名)安装ipykernel$ pip install ipykernel讲环境加入ipykernel$ python -m ipykernel install --user --name pytorch(你的环境名)原创 2020-08-15 16:10:16 · 224 阅读 · 0 评论 -
一文搞定github仓库上传维护
1 上传项目新建github仓库项目文件夹处打开git鼠标右键git bash here即可。初始化$ git init添加文件到仓库,.表示所有文件,也可以指定单个文件$ git add .上传说明,引号内容自定$ git commit -m "first commit"关联远程仓库,远程仓库链接即上面创建的新仓库地址$ git remote add origin https://github.com/xxx/xxx.git上传到github$ gi原创 2020-08-14 14:21:04 · 136 阅读 · 0 评论 -
Python多模融合—投票法
import numpy as npimport pandas as pdfrom tqdm import tqdm# 预测结果csv文件路径df3 = pd.read_csv('./voters/submit621.csv')df8 = pd.read_csv('./voters/submit622.csv')df9 = pd.read_csv('./voters/submit623.csv')df10 = pd.read_csv('./voters/submit624.csv')df1原创 2020-08-13 15:30:24 · 964 阅读 · 0 评论 -
Matlab解帧视频&合成视频
视频解帧clcclear allfileName = 'C:\\Users\\15151\\Desktop\\1.avi'; % 视频路径obj = VideoReader(fileName);numFrames = obj.NumberOfFrames ;% 帧的总数 for k = 100 : 140 % 读取数据 frame = read(obj, k); frame = imresize(frame, [720, 1280]); %imshow(fra.原创 2020-08-11 20:25:34 · 597 阅读 · 0 评论 -
Python创建动图
import cv2import imageioimages = []# 多帧图片路径filenames = [ 'flow_official_caffe.png', 'flow_pytorch.png', 'flow_tf2.png']names = [ 'Official Caffe', 'Pytorch', 'This TF2']for i, filename in enumerate(filenames): im = im原创 2020-08-11 20:20:40 · 111 阅读 · 0 评论 -
Python把xml文件转为csv文件
import osimport globimport pandas as pdimport xml.etree.ElementTree as ET def xml_to_csv(path): xml_list = [] for xml_file in glob.glob(path + '/*.xml'): print(xml_file) tree = ET.parse(xml_file) root = tree.getroot()原创 2020-08-11 20:18:29 · 3435 阅读 · 0 评论 -
Python获取海康威视电警视频流
import cv2import numpy as npurl = 'rtsp://admin:admin12345@192.168.2.132:554/Streaming/Channels/101' # 请更换地址cap = cv2.VideoCapture(url)i = 0while(cap.isOpened()): ret, frame = cap.read() if not ret: break frame = cv2.resize(frame, (1280,原创 2020-08-11 20:13:34 · 710 阅读 · 0 评论 -
Linux下Python多版本共存
查询本机Python路径root@root: whereis python打开.bashrc文件root@root: vim .bashrc编写python路径,添加如下内容(注意修改自己的路径)alias python2="user/bin/python" # alias起别名alias python="user/bin/python3.6"alias python3="home/ccc/anaconda3/bin/python3.7"按esc退出编辑模式,按:wq保存.原创 2020-08-11 20:08:29 · 276 阅读 · 0 评论 -
Python点云可视化
import numpy as npimport mayavi.mlab pointcloud = np.fromfile(str("/home/chiyukunpeng/document/Pseudo_Lidar_V2/kitti/data_object_velodyne/testing/velodyne/005800.bin"), dtype=np.float32, count=-1).reshape([-1, 4]) x = pointcloud[:, 0] # x position of原创 2020-08-11 15:26:07 · 1310 阅读 · 0 评论 -
Python批量重命名
import osfrom tqdm import tqdmtrain_path = '/media/chiyukunpeng/CHENPENG01/contest/street_view_house_number_identification20200805/YOLOv5/coco/label/'dst_path = '/media/chiyukunpeng/CHENPENG01/contest/street_view_house_number_identification20200805/YOL原创 2020-08-11 13:53:49 · 72 阅读 · 0 评论 -
GPU显存释放
有时训久了,会报错CUDA:out of memory查看GPU使用情况$ nvidia-smi逐个kill掉表格中的PID$ kill -9 PID原创 2020-06-20 22:05:18 · 555 阅读 · 0 评论 -
一文搞定Ubuntu客户端与Linux云服务器数据传输
文章目录1 连接Linux服务器1.1 Linux服务器端1.2 Ubuntu客户端2 数据传输2.1 客户端传给服务器端2.2 服务器端传给客户端1 连接Linux服务器1.1 Linux服务器端安装openssh-server,修改配置文件(添加一行 PermitRootLogin yes)root@iZuf6h46wfpiw8f4h2b8wkZ: ~# sudo apt-get install openssh-serverroot@iZuf6h46wfpiw8f4h2b8wkZ: ~# su原创 2020-05-23 17:34:20 · 452 阅读 · 0 评论 -
Ubuntu实时显示GPU情况
watch -n 0.1 nvidia-smi #每隔0.1s更新原创 2020-05-04 15:50:14 · 542 阅读 · 0 评论 -
Ubuntu批量修改文件拓展名
chiyukunpeng@chiyukunpeng:~/document/Pseudo_Lidar_V2/kitti/testing/image_2$ rename 's/\.jpg/\.png/' *原创 2020-05-04 15:24:21 · 159 阅读 · 0 评论