High Performance Computing
SciPioneer
WHU -> OSU -> Google Research
展开
-
Comparison Between NetCDF and HDF5
The netCDF file chooseslinear data layout, in which the data arrays areeither stored in contiguous space and in a predefined order or interleaved in aregular pattern. This regular and highly predict转载 2013-11-03 13:16:47 · 2022 阅读 · 0 评论 -
Golden Rules in HPC
1. Even with multi-terabyte local disk sub-systems and multi-petabyte archives,I/O can become a bottleneck in HPC.2. Users download 10x more data than needed3. While data volumes转载 2013-11-03 13:26:16 · 1204 阅读 · 0 评论 -
Array DB 摘记
1. Array DB needs to support traditional DBMS operations, along with powerful user-defined operations, including linear algebra (presented in BLAS or LApack).BLAS:The BLAS (Basic Linear Algeb原创 2013-11-03 13:28:46 · 1233 阅读 · 0 评论 -
MPI学习笔记
MPI Notes开头要注明 #include 以引入MPI函数库。 MPI_Comm_size: 进程个数MPI_Comm_rank: 进程ID,从0到size-1。 HelloWorld(MPI)#include “mpi.h”#include int main(int argc, char *argv[]){ intrank原创 2013-11-04 20:58:40 · 3268 阅读 · 0 评论 -
SciDB使用笔记(根据项目需要,主要针对的聚合操作)
1. SciDB Basics1. 进入AQL/AFL界面:1)使用AQL:到bin目录下,使用./iqueryAQL% 输入AQL语言,并且以分号结尾。2)使用AFL:到bin目录下,使用./iquery –aAFL% 输入AFL语言,并且以分号结尾。按Ctrl+C或者输入quit/exit退出界面。命令对大小写不敏感,一条命令可以拆分成任意多行。可原创 2013-11-03 13:04:41 · 3581 阅读 · 0 评论 -
玩转MapReduce的10条建议
转自This piece is based on the talk “Practical MapReduce” that I gave at Hadoop User Group UK on April 14.1. Use an appropriate MapReduce languageThere are many languages and frameworks that转载 2013-11-04 20:58:06 · 1129 阅读 · 0 评论 -
OpenMP学习笔记
编译命令:gcc –O XXX.c -fopenmp1. Multi-thread Programming1. 首先要import相应的API,因此必须在首行写上#include “omp.h”。2. 对于要并行执行的部分,用#pragma omp parallel{…} 标记并行块范围。3. 在并行块里面,用int ID = omp_get原创 2013-11-04 20:59:14 · 4136 阅读 · 2 评论 -
简介Intel MIC上的分布式开发以及Offload模式下的各种限制
最近要在MIC机群上做分布式开发,发现有两种模式可以用:1) offload模式:该模式和GPGPU编程思想类似,把并行度高的代码转移到local的MIC处理器上执行,其它代码仍然在CPU上执行。MIC只负责本地计算,分布式通信必须在CPU上执行。2)symmetric模式:编译出在MIC和CPU上执行的两份二进制代码。该模式逻辑上允许MIC进行分布式通信,虽然物理上消息还是从CPU走的。原创 2015-03-07 03:36:16 · 3596 阅读 · 0 评论