数据处理(工具)

2019独角兽企业重金招聘Python工程师标准>>>

Format(Source/Staging/Target)

CSV
Json
XML (GEXF)
Table/View

Memory
  Vector/Matrix
  RDD/DataFrame/DataSet
  NDArray/DataFrame

Store(Source/Staging/Target)

Txt file
CSV file
Json file
XML file (GEXF)
DB table
Memory Map
Memory List
Memory Object
  NDArray/Matrix(Numpy)
  Series/DataFrame/Panel(Pandas)
  RDD/DataFrame/DataSet(Spark)
Special file
  parquet
  ...

Generator(Source)

spawner

kettle

CLI Tool

Programming CLI: octave/gnuplot (script for plot)

Format CLI: Graphviz (Dot for network)

Format CLI: plantuml(Sequence/UML for network)

Format CLI: vega (json for plot)

WUI/GUI Tool

Refine: Excel,Weka,DataCleaner

Refine WUI: DataWrangler

Aggresive GUI: Excel ggobi（高维可视化） pspp(gnuspss, 统计) sofastats(统计) sagemath(python, 代数)

ETL: Kettle

Mining: JDMP(java) Weka(java) Orange2(python2, 推荐) Orange3(python3, 推荐) knime(java, 推荐) RapidMiner(java)

Visual GUI: Excel/PPT/AI, Weka, TableauPublic(windows&mac推荐)

Gis/Map: qgis, udig

Visual GUI: ParaView

Programming GUI: Processing

Design GUI: Inkcape(矢量) GIMP(位图) ImageMagick(处理)

Design GUI(2d/动画): Synfig/SynfigStudio

Design GUI(3d/动画): Blender 

Timeline GUI: timeflow 

Time-Series WUI: Facette

Relation GUI: Gephi, cytoscape, Excel(NodeXL)

Circos/Genue GUI: Circos

Visual WUI(Dev): phpMyAdmin(php推荐, dev)  SqlPad(nodejs推荐 dev)

Visual WUI(BI): 
   raw(python推荐 design)
   datawrapper(php推荐 design)
   metabase(java推荐 dev)
   superset(python推荐 dev), redash(python推荐  dev)
   lyra2(nodejs推荐  design) voyager(nodejs+vega推荐, dev)
   spark-notebook(java/scala推荐 dev)
   zeppelin(java/scala推荐，支持几乎所有数据源，支持大数据 dev)
   jupyter(python推荐，支持几乎所有数据源，支持大数据 dev)

Online/Cloud Web Visual Tool

rawgraphs.io（python, open source, local web version is raw，可做报表）

www.datawrapper.de （php, open source, local web version is datawrapper，可做报表）

chartblocks.com (免费版本功能过于简单)

wolframalpha.com (画公式，适合分析公式)

infogr.am (付费版本可导出pdf和png，适合做报表)

canva.com (偏向于平面设计，免费导出的pdf和png带有水印)

moojin.com(国内，个人用户免费，非常值得推荐)

tushuo.com(百度)

tubiaoxiu.com(国内，个人用户免费，数据量受限，非常值得推荐)

bluemix.net(IBM，收费，但很推荐)

apex.oracle.com(oracle，收费,评估版免费，但很推荐)

visualizefree.com

Java/Scala tool&sdk

Hive
Spark
Kylin

Javascript sdk

echart.js     (chart)
datavis/g2.js (chart)
flotr2.js     (chart)
jsxgraph.js   (science)
vis.js        (timeline,network,chart&chart3d)
three.js      (3d)
leaflet.js    (map)
plotly.js     (plot) 
list.js       (list)
jquery.dataTables.js(table)
bootstrap-table.js  (table)
strapdown.js  (markdown with <xmp>)
datavis/g6.js (relation graph from text) 
arbor.js      (relation graph from text) 
sigma.js      (relation graph from json or gexf)
gexfjs.js     (relation graph from gexf)
linkurious=>ogma.js    (商业，relation graph based on sigma.js)
popoto.js     (relation graph from neo4j rest with cypher)
keylines.js   (relation graph from neo4j with cypher)
alchemy.js    (relation graph from json)
viz.js        (relation graph from dot)
dygraph.js         (finance)
smoothie.js        (realtime chart)
TimeLine/Timeplots (time)
labella.js         (timeline)
metricsgraphics.js (realtime chart)
envision.js        (timeseries + finance)
Tangle             (formular)
datatables.js      (table) 
express.js         (ppt) 
cytoscape.js       (genue)
jit.js             (graph&tree) 
d3-cloud.js        (wordcloud)
three.js
raphael.js
d3.js
procesing.js

Other

SVG (xml)
VizJSON(IBM)
NetLogo(jvm language, model, simulation)
matplotlib(python)
breeze-viz(scala)
ggplot(R)
HTML/CSS
FF chartwell (Font)
Tikz (PGF/LaTeX)
Markdown (markdown)
scrot(截图)
istanbul(录屏)
vatic(video label)
LabelImg(image label)
Anafora(text label)

 

转载于:https://my.oschina.net/igooglezm/blog/857126