| 基于Hadoop的高效率海量电子通信信息存储方法 |
| |
| 引用本文： | 刘苏英,张晴晴.基于Hadoop的高效率海量电子通信信息存储方法[J].安阳师范学院学报,2021(2):32-35,45. |
| |
| 作者姓名： | 刘苏英 张晴晴 |
| |
| 作者单位： | 安徽机电职业技术学院 |
| |
| 基金项目： | 2019年安徽省质量工程项目“安徽机电职业技术学院、广东东莞顶贴电子有限公司(芜湖分公司)产教融合示范实习实训中心项目”(项目编号2019xqsxzx72)。 |
| |
| 摘 要： | 电子通信信息是当代社会运行的重要信息组成之一,提高电子通信信息存储能力对于各行业高效率处理事务意义重大。基于Hadoop集群环境设计了单节点双层Hadoop结构,分担主节点存储信息的压力;构建MapReduce信息并行计算模型分担海量存储任务,基于动态优先级负载均衡调度算法均衡存储节点的负载量,避免个别或者少数节点负担过重,延长Hadoop存储系统节点的使用寿命。测试结果显示,该方法有效均衡了海量信息存储时间,存储大规模电子通信数据的耗时较少。
|
| 关 键 词： | HADOOP 高效率 海量 电子通信 信息存储 |
Hadoop-based Efficient Storage Method for Massive Electronic Communication Information |
| |
| LIU Suying,ZHANG Qingqing.Hadoop-based Efficient Storage Method for Massive Electronic Communication Information[J].Journal of Aayang Teachers College,2021(2):32-35,45. |
| |
| Authors: | LIU Suying ZHANG Qingqing |
| |
| Institution: | (Anhui Technical College Of Mechanical and Electrical Engineering,Wuhu 241002,China) |
| |
| Abstract: | Electronic communication information is one of the important information components in the operation of contemporary society.Improving the mass storage of electronic communication information is of great significance for the efficient processing of various industries.Based on the Hadoop cluster environment,a single node double-layer Hadoop structure is designed to share the pressure of the primary node to store information.A MapReduce information parallel computing model is built to share the massive storage tasks,and a dynamic priority load balancing scheduling algorithm is used to balance the load of the storage nodes,so as to avoid the overload of individual or a few nodes and prolong the service lives of Hadoop storage system nodes.The test results show that this method effectively balances the storage time of massive information,and the storage time of large-scale electronic communication data is short. |
| |
| Keywords: | Hadoop high efficiency massive electronic communication information storage |
| 本文献已被 维普 等数据库收录！ |
