第一篇? 算力网络与大数据 第 1 章 算力概述 ············································································2 1.1 算力是什么················································································· 3 1.1.1 计算工具的发展历史 ······································································ 3 1.1.2 算力的内涵和外延 ········································································· 5 1.2 无处不在的现代算力····································································· 6 1.2.1 算力的分类 ·················································································· 6 1.2.2 典型算力平台 ··············································································· 8 1.3 算力,新时代的生产力·································································10 1.3.1 算力成为数据经济新引擎 ·······························································10 1.3.2 信息消费持续释放算力需求 ····························································11 1.3.3 算力助力数字世界和物理世界无缝融合 ·············································12 第 2 章 算力网络 ·········································································· 14 2.1 算力网络因何而生·······································································15 2.1.1 连接算力“消费方”和算力“提供方” ·············································15 2.1.2 从“云网”到“算网” ··································································16 2.2 理解算力网络·············································································18 2.2.1 算力网络的概念 ···········································································18 2.2.2 算力网络功能需求 ········································································19 2.2.3 算力网络关键技术 ········································································20 2.2.4 算力网络的体系架构 ·····································································23 2.3 算力网络发展展望·······································································25 2.3.1 算力网络发展阶段 ········································································26 2.3.2 算力网络面临的挑战 ·····································································26 第 3 章 算力网络提升大数据发展 ····················································· 28 3.1 数据融入经济社会发展各领域························································28 3.2 跨地域数据协同··········································································30 3.2.1 云边数据协同 ··············································································30 3.2.2 分布式云数据中心 ········································································31 3.3 跨行业数据流通··········································································33 3.3.1 全链路数据治理,提供高品质数据供给 ·············································34 3.3.2 开展数据资产化作业,释放数据要素化价值 ·······································34 3.3.3 充分利用已有资源与能力,开创数据增值服务体系 ······························35 第二篇? 面向算力网络的大数据关键技术 第 4 章 边缘计算 ·········································································· 38 4.1 边缘计算简介·············································································38 4.1.1 边缘计算的定义及发展趋势 ····························································38 4.1.2 边缘计算与传统云计算的区别 ·························································40 4.2 边缘计算技术特点分析·································································42 4.2.1 低延时性 ····················································································42 4.2.2 去中心化 ····················································································43 4.2.3 低带宽消耗 ·················································································44 4.2.4 高安全可靠性 ··············································································44 4.2.5 非寡头化 ····················································································44 4.2.6 绿色节能 ····················································································45 4.3 边缘大数据技术··········································································45 4.3.1 边缘计算参考技术架构 ··································································45 4.3.2 边缘计算核心技术 ········································································47 4.4 边缘大数据技术应用场景······························································55 4.4.1 智慧园区边缘大数据应用 ·······························································55 4.4.2 平安城市边缘大数据应用 ·······························································58 第 5 章 分布式协同计算 ································································· 64 5.1 分布式协同计算简介····································································64 5.2 分布式协同计算架构····································································66 5.3 分布式协同计算关键技术······························································67 5.3.1 数据跨域协同交换 ········································································67 5.3.2 分布式任务编排调度 ·····································································73 5.3.3 节点分区可用性保障 ·····································································78 5.3.4 异常任务按需重做 ········································································78 5.3.5 协同控制代理 ··············································································79 5.4 分布式协同计算应用场景······························································81 5.4.1 协同计算在智慧交通场景中的应用 ···················································81 5.4.2 协同计算在智能家庭场景中的应用 ···················································82 第 6 章 数据编织 ·········································································· 84 6.1 数据编织技术·············································································84 6.1.1 数据编织的起源 ···········································································84 6.1.2 数据编织的定义 ···········································································85 6.1.3 数据编织需要具备的能力 ·······························································88 6.1.4 数据编织架构关键组成 ··································································93 6.2 数据虚拟化技术实现····································································94 6.2.1 数据虚拟化的定义及能力 ·······························································94 6.2.2 数据虚拟化的技术实现 ··································································97 6.2.3 数据虚拟化开源技术介绍 ····························································· 100 6.3 数据虚拟化应用场景·································································· 104 6.3.1 电信行业应用场景 ······································································ 104 6.3.2 在线教育行业应用场景 ································································ 105 6.3.3 物联网行业应用场景 ··································································· 106 第 7 章 隐私计算 ········································································ 108 7.1 隐私计算的起源与发展······························································· 109 7.1.1 隐私计算的起源 ········································································· 109 7.1.2 隐私计算的政策环境 ··································································· 109 7.1.3 隐私计算的市场发展 ··································································· 111 7.1.4 隐私计算的发展展望 ··································································· 113 7.2 隐私计算体系··········································································· 114 7.2.1 隐私计算的概念 ········································································· 114 7.2.2 隐私计算体系架构 ······································································ 115 7.3 隐私计算技术介绍····································································· 116 7.3.1 多方安全计算 ············································································ 118 7.3.2 联邦学习 ·················································································· 123 7.3.3 可信执行环境 ············································································ 124 7.3.4 区块链技术辅助隐私计算 ····························································· 126 7.4 隐私计算应用场景····································································· 129 7.4.1 金融行业 ·················································································· 129 7.4.2 医疗健康行业 ············································································ 130 7.4.3 政务行业 ·················································································· 131 第三篇? 大数据技术赋能算力网络 第 8 章 湖仓一体的算网数据中心 ··················································· 134 8.1 算力网络数据存算需求······························································· 134 8.1.1 算力网络中的数据 ······································································ 134 8.1.2 数据存算需求 ············································································ 136 8.2 湖仓一体技术介绍····································································· 137 8.2.1 湖仓一体技术发展背景 ································································ 137 8.2.2 湖仓一体技术架构 ······································································ 139 8.2.3 湖仓一体关键技术 ······································································ 143 8.2.4 湖仓一体开源技术 ······································································ 152 8.2.5 湖仓一体应用场景 ······································································ 163 8.3 算力网络数据中心的定位及作用··················································· 166 8.3.1 算力网络数据中心定位 ································································ 166 8.3.2 数据赋能算力网络运行 ································································ 169 8.4 基于湖仓一体技术的算力网络数据中心 ········································· 172 8.4.1 为什么选择湖仓一体技术 ····························································· 172 8.4.2 算力网络数据中心基于湖仓一体技术的具体实现 ······························· 174 第 9 章 算力网络中的数据治理 ······················································ 176 9.1 算力网络数据治理需求······························································· 176 9.2 数据治理技术发展····································································· 177 9.2.1 跨域数据治理 ············································································ 177 9.2.2 调度能力互通与治理应用 ····························································· 179 9.2.3 数据全生命周期安全保障机制 ······················································· 183 9.3 算力网络中数据治理的实践价值··················································· 187 第 10 章 算力网络交易运营中的隐私计算 ········································· 189 10.1 算力网络运营交易介绍 ····························································· 189 10.1.1 算力网络交易模式 ····································································· 189 10.1.2 算力网络交易中的隐私计算架构实现 ············································· 192 10.1.3 算力网络交易中的隐私计算流程 ··················································· 195 10.1.4 算力网络交易中的隐私计算核心功能 ············································· 196 10.1.5 算力网络交易风险及评估 ···························································· 199 10.2 隐私计算技术在算力网络交易中的价值体现 ·································· 202 10.2.1 数据可信流通 ··········································································· 202 10.2.2 数据价值释放 ··········································································· 204 10.2.3 数据存证溯源 ··········································································· 207 第四篇? 算力网络时代大数据应用场景和发展展望 第 11 章 东数西算 ······································································· 212 11.1 东数西算,国家政策引导 ·························································· 212 11.2 围绕五个一体化推进东数西算的实施 ··········································· 214 11.2.1 网络一体化建设,保障大数据的高效传输 ······································· 215 11.2.2 能源一体化,推动大数据的低碳运营 ············································· 217 11.2.3 算力一体化,构建算力一张网 ······················································ 220 11.2.4 数据安全保障数据的安全流通共享 ················································ 222 11.2.5 基于数据要素构建城市大脑 ························································· 224 11.3 东数西算,典型应用场景 ·························································· 225 11.3.1 在线推理向东,离线分析向西 ······················································ 226 11.3.2 资源托管 ················································································· 226 11.3.3 数据存储与灾备 ········································································ 228 第 12 章 加速数字化转型 ······························································ 230 12.1 云边协同数据应用 ··································································· 231 12.1.1 车路协同应用场景 ····································································· 231 12.1.2 IoT 数据本地处理助力智能制造 ···················································· 232 12.1.3 云边协同在云游戏场景中的应用 ··················································· 234 12.2 赋能 AI,推动智能应用 ···························································· 237 12.2.1 助力生命科学 ··········································································· 237 12.2.2 助力绿色计算 ··········································································· 238 12.2.3 推动自动驾驶落地 ····································································· 239 12.3 数字化、智能化推动企业发展 ···················································· 240 12.3.1 知识管理,助力企业智能化“蜕变” ············································· 241 12.3.2 从企业数字化到管理决策智能化 ··················································· 241 第 13 章 让生活环境更美好 ··························································· 244 13.1 智慧家庭 ··············································································· 244 13.1.1 以家庭宽带作为智慧家庭服务的入口 ············································· 245 13.1.2 以互联网电视作为家庭娱乐操作系统 ············································· 245 13.1.3 以能力开放来构筑智慧家庭产业生态 ············································· 246 13.2 智慧社区 ··············································································· 247 13.2.1 智慧物业 ················································································· 248 13.2.2 智慧社区生活 ··········································································· 249 13.2.3 智慧社区管理平台服务 ······························································· 249 第 14 章 “算力网络 + 大数据”发展展望 ········································ 251 14.1 数据安全与隐私保护 ································································ 251 14.2 绿色计算,数字减碳 ································································ 253