记录汇总一下读code过程中遇到的函数。
- torch
torch.gt(): greater than
FlopCountAnalysis(): count flops(evaluating model flops)
torch.numel(): number of elements
torch.cuda.synchronize(gpu): wait for gpu to finish kernels(used in timing)
torch.lazylinear(): needs to be initialized in first call of forward(), needs to specify out_features
torch.nn.init: a bunch of initializations of model parameters
torch.amp: automatic mixed precision(use GradScale to prevent gradient from underflow)
torch.flatten(): flatten a tensor, may start from a given dimension
silu(): Swish activation function
torch.multiply(): alias for torch.mul(), multiplication with broadcasting
- numpy
np.percentile(): find percentile in an array, used for elinimating outliers
- python string
str.startswith(): prefix matching
- multiprocessing
mp.Manager(): generates a space for shared instances.
mp.Process(target, args): create process which executes function "target", with arguments args
process.start(): start a process
process.join():
- sklearn
metrics.roc_auc_score: compute the Area Under the Receiver Operating Characteristic Curve (ROC AUC) from prediction scores.
- tensorboard
summarywriter.add_scalar():