本教材积极响应“数字化”时代的要求，以任务为载体，以实施过程为主线，将知识点穿插到任务实施过程中，从大数据平台运维工程师角度由浅入深、全方位地介绍大数据平台运维的相关基础知识和基本实操，知识体系的构建循序渐进、由易到难、由浅入深，符合普遍认知规律。 <br>本教材共包括导论和5个项目：项目1为搭建大数据平台，包括平台操作系统的使用、Hadoop软件安装、配置平台基础环境等；项目2为配置大数据平台，包括配置Hadoop文件参数、运行Hadoop集群；项目3为配置大数据平台组件，包括Hive、HBase、ZooKeeper、Sqoop和Flume组件的安装与配置；项目4为监控大数据平台，包括大数据平台的监控命令、合理使用监控界面和报表、监控日志和告警信息；项目5为运维大数据平台，从平台部署、数据业务采集、数据分析到数据可视化的整体实施过程角度介绍运维的常见故障及处理流程。 <br>本教材本书既可作为高职院校大数据技术、人工智能技术应用、软件技术等计算机类专业教材，也可供运维从业人员参考。

王法辰，副教授，现任职临沂科技职业学院，主要教授“大数据平台的部署与运维”“Linux操作系统”“数据库基础与应用”“Spark大数据技术与应用”等课程，指导数据分析与可视化大赛获得国际总决赛二等奖、优秀指导专家。先后发表国家级论文多篇，专利3个，软著3个，从事企业大数据应用、信息系统安全管理、智慧企业数据分析与挖掘技术的应用，“大数据”技术在教育管理和课堂教学中的应用研究，数据流及复杂事件处理、异构数据源集成等工作。

导 论 平台系统基础 ······················································································· 1 <br>知识点1 虚拟机 ······················································································································1 <br>知识点2 操作系统 ··················································································································4 <br>项目1 搭建大数据平台 ··················································································· 15 <br>任务1.1 学习Hadoop 生态 ··································································································16 <br>任务1.2 平台操作系统环境设置 ···························································································26 <br>任务1.3 安装Hadoop 软件 ··································································································34 <br>任务1.4 配置平台基础环境 ···································································································39 <br>项目2 配置大数据平台 ··················································································· 51 <br>任务2.1 修改Hadoop 配置文件参数 ····················································································51 <br>任务2.2 运行Hadoop 集群 ··································································································61 <br>项目3 配置大数据平台组件 ············································································· 71 <br>任务3.1 安装与配置Hive 组件 ·····························································································72 <br>任务3.2 安装与配置ZooKeeper 组件 ··················································································83 <br>任务3.3 安装与配置HBase 组件 ··························································································89 <br>任务3.4 安装与配置Sqoop 组件 ························································································100 <br>任务3.5 安装与配置Flume 组件 ·························································································107 <br>项目4 监控大数据平台 ··················································································113 <br>任务4.1 大数据平台监控 ····································································································113 <br>任务4.2 合理使用监控界面和报表 ······················································································131 <br>任务4.3 监控日志和告警信息 ·····························································································139 <br>项目5 运维大数据平台 ················································································· 153 <br>任务5.1 安装与部署大数据平台及组件 ···············································································154 <br>任务5.2 大数据平台的运行及应用 ······················································································160 <br>参考文献 ······································································································· 175 <br>附 录 考核评价 ·························································································· 177