2020年03月_数学工具构造器

原创 category_encoders调研

例子：https://www.kaggle.com/discdiver/category-encoders-examples讲解：https://towardsdatascience.com/smarter-ways-to-encode-categorical-data-for-machine-learning-part-1-of-3-6dca2f71b159

2020-03-23 15:09:36 641

原创 catboost 与 lightgbm 超参调研

catboostcatboost 超参官方文档https://catboost.ai/docs/concepts/python-reference_parameters-list.html用HyperOpt调参的博客https://effectiveml.com/using-grid-search-to-optimise-catboost-parameters.html "...

2020-03-21 20:35:55 489

原创 paramiko登录服务器

private = paramiko.RSAKey.from_private_key_file('/home/tqc/.ssh/id_rsa') # 实例化SSHClient client = paramiko.SSHClient() # 自动添加策略，保存服务器的主机名和密钥信息，如果不添加，那么不再本地know_hosts文件中记录的主机将无法连接 ...

2020-03-08 10:12:18 312

原创 StackEnsembleBuilder废弃代码

在原来的实现中，我采用将数据库转存为csv，且保存模型文件到文件系统中。在现在的实现中，数据库不实时转存，且模型文件有可能存储在数据库记录中from typing import List, Union, Dictimport numpy as npimport pandas as pdfrom joblib import loadfrom pandas import DataFram...

2020-03-07 13:52:07 313

原创 dsmac中废弃的mapreduce方案

import multiprocessing as mpfrom copy import deepcopy# import rayfrom frozendict import frozendictfrom joblib import parallel_backend, delayed, Parallelfrom dsmac.runhistory.runhistory import R...

2020-03-06 11:54:09 313

原创 resource manager中废弃的直接操作数据库代码

原代码中直接用SQL操作数据库，现在改为用peewee做ORM def init_db(self): conn = sqlite3.connect(self.db_path) cur = conn.cursor() cur.execute( "create table if not exists record(tr...

2020-03-06 11:52:48 260

原创 docker安装postgresql

docker pull postgres:9.6docker volume create pgdataroot@tqc-PC:/var/lib/docker/volumes/pgdata# ls_datadocker run -it --rm -v pgdata:/var/lib/postgresql/data -p 5432:5432 -e POSTGRES_PASSWORD...

2020-03-04 14:26:24 381

One promising approach constructs explicit regression models to describe the dependence of target algorithm performance on parameter settingshowever, this approach has so far been limited to the opti...

2020-03-03 21:31:53 364

原创理解smac的intensify

进入对应区域 smac.optimizer.smbo.SMBO#runself.aggregate_funcOut[9]: <function smac.optimizer.objective.average_cost(config, run_history, instance_seed_pairs=None)>找到这个函数，只有一句话：return np.mean(_c...

2020-03-03 21:31:37 387

原创 auto-sklearn 日志管理分析

def setup_logger(output_file=None, logging_config=None): # logging_config must be a dictionary object specifying the configuration # for the loggers to be used in auto-sklearn. if logging_...

2020-03-03 21:31:16 363

原创魔改smac记录

dsmac/tae/execute_func.py:160在这里添加try catch，或者在evaluate中try catch

2020-03-02 11:55:48 310

using namespace 数学工具构造器;