这一节全是干货,值得认真学习。
1. 模型化数据(传统数据)和原始数据(大数据)的特性对比
Modeled Data vs. Raw Data | |
Modeled Data | Raw Data |
Standardize, control, and automate processes | Discover, form, and test hypotheses |
Information is preorganized and modeled for intended use as defined by business requirements | Information is organized at the moment of use, flexible to use for multiple requirements that are not predefined |
Operates on relational and dimensional tables | Operates on key attribute-value pairs |
Structured access through predefined language and interfaces such as SQL | Data access is via MapReduce process at the point of use, uses a number of interfaces |
Designed to run the business with stability and predictability, but takes much effort and a long time to change | Designed to provide agile flexible capabilities that have the potential to change the business |
Takes a long time for forming and testing hypotheses and experimentation | Faster for forming and testing hypotheses and experimentation |
Less noisy data | More noise in the data |
Modeled analytics—slice/dice dimensional SQL query, reporting and analytics | Discovery and exploratory analytics using various languages and tools |
2. 2025年物联网(IOT)的经济效益预测(如,医疗领域每年可节省数万亿美元的10%至20%,即数千亿美元)
Potential Economic Impact by 2025 by IoT Applications | ||
Sized Applications of Mobile Internet | Potential Economic Impact in 2025 ($ in trillions, annually) | Potential Productivity or Value Gains in 2025 |
Healthcare | 1.1–2.5 | 10–20% cost reduction in chronic disease treatment through remote health monitoring; 80–100% reduction in drug counterfeiting and 0.5–1.0 hour time saved per day by nurses |
Manufacturing | 0.9–2.3 | 2.5–5.0% saving in operating costs, including maintenance and input efficiencies |
Utility - Electricity | 0.2–0.5 | 2.0–4.0% reduction in demand peaks in the grid, reduction of total load on grid and operating/maintenance savings and shorter outage time through automated meters |
Urban Infrastructure | 0.1–0.3 | 10–20% reduction in average travel time through traffic and congestion control, 10–20% reduction in water consumption and leaks with smart meters and demand control, and 10–20% reduction in the cost of waste handling |
Security | 0.1–0.2 | 4–5% crime reduction through improved surveillance |
Resource Extraction | 0.1–0.2 | 5–10% saving in operating costs from productivity gains |
Agriculture | ~0.1 | 10–20% increase in yields from precision application of fertilizer and irrigation |
Retail | 0.02–0.10 | 1.5–2.0% increased sales |
Vehicles | ~0.05 | 25% reduction in cost of vehicle damage from collision avoidance and increased security |
还有很多内容,可参考原书。这里给个我整理的本章目录。
Table of Contents - Big Data Governance |
Introduction of Big Data Governance |
Key Elements of Enterprise Data Governance |
Business Outcome |
ILM (Information Lifecycle Management) |
Regulatory Compliance and Risk Management |
Metadata Management |
Data Quality Management |
Master and Reference Data Management |
Data Security and Privacy Management |
Business Process Alignment |
How Does Big Data Impact Enterprise Data Governance? |
Modeled Data vs. Raw Data -1 |
Modeled Data vs. Raw Data -2 |
Modeled Data vs. Raw Data -3 |
Modeled Data vs. Raw Data -4 |
Types of Big Data |
Human-Generated Data |
Machine-to-Machine (M2M)–Generated Data -1 |
Machine-to-Machine (M2M)–Generated Data -2 |
Machine-to-Machine (M2M)–Generated Data -3 |
Machine-to-Machine (M2M)–Generated Data -4 |
Process-Generated Data |
Applying Data Governance to Big Data -1 |
Applying Data Governance to Big Data -2 |
Applying Data Governance to Big Data -3 |
Applying Data Governance to Big Data -4 |
Leveraging Big Data Governance -1 |
Leveraging Big Data Governance -2 |
Leveraging Big Data Governance -3 |
Leveraging Big Data Governance -4 |
Leveraging Big Data Governance -5 |
Industry-Specific Use Cases |
Utilities -1 |
Utilities -2 |
Healthcare |
Financial Services -1 |
Financial Services -2 |
Retail |
CPG (Consumer Packaged Goods) |
Telecommunications -1 |
Telecommunications -2 |
Telecommunications -3 |
Oil and Gas -1 |
Oil and Gas -2 |
How Does Big Data Impact Data Governance Roles? |
Governance Roles and Organization |
An Approach to Implementing Big Data Governance -1 |
An Approach to Implementing Big Data Governance -2 |