共查询到20条相似文献，搜索用时 15 毫秒
1.
电子通信信息是当代社会运行的重要信息组成之一,提高电子通信信息存储能力对于各行业高效率处理事务意义重大。基于Hadoop集群环境设计了单节点双层Hadoop结构,分担主节点存储信息的压力;构建MapReduce信息并行计算模型分担海量存储任务,基于动态优先级负载均衡调度算法均衡存储节点的负载量,避免个别或者少数节点负担过重,延长Hadoop存储系统节点的使用寿命。测试结果显示,该方法有效均衡了海量信息存储时间,存储大规模电子通信数据的耗时较少。 相似文献
2.
提出基于云计算平台（以Hadoop为例）应用布尔矩阵Apriori算法进行大数据关联规则挖掘的MR_B_Apriori算法。将Hadoop平台与布尔矩阵Apriori算法相结合,利用MapReduce框架分块处理布尔矩阵,计算出分块数据的频度,合并融合得到大数据集的频繁项集。分析表明MR_B_Apriori算法能够适用于大数据的频繁项集挖掘。 相似文献
3.
云计算通过互联网提供随需应变的资源或服务,通常依据数据中心的规模和可靠性水平而定。MapReduce是一个为并行处理大量数据设计的编程模型,在云环境中实现HadoopMapReduce框架,使用虚拟的负载平衡来改进单节点和多节点系统的性能。 相似文献
4.
周建华 《西安文理学院学报》2014,(4):75-81
海量数据给微博舆情实时监控预警带来了严峻的挑战,将Hadoop关键技术引入微博舆情分析研究领域,以探寻分布式环境下的高效率短文本数据查询与推理方法,以微博数据结构为基础,结合云计算Hadoop关键技术特性,提出了一种海量微博数据分析预警框架.HDFS为海量微博的数据提供了存储,而MapReduce为海量微博的数据提供快速运算.采用Map(映射)和Reduce(规约)规则,对微博用户关系和内容数据的大规模数据集进行并行运算,以实现并行化高效预处理、深度分析和舆情实时五级预警.为验证计算效率与Reduce任务数之间关系,对Reduce任务数进行实验,结果表明,在Map一定的情况下,随微博数据集的增大到2 GB后,多任务数Reduce执行时间相比少任务数Reduce大大缩短. 相似文献
5.
当前,高职教育正在实现由规模扩张向提高质量转变。教学质量管理是规模扩张向高质量转变的核心,信息化建设有助于高职院校提高教学质量管理的工作效率和管理水平。高职院校教学质量管理信息化工作开展得比较晚,在很多方面还是基于纸质存档的形式。为了提升高职院校教学质量管理效率和水平,构建了基于Hadoop的教学质量管理平台:使用SSM(Spring+Spring MVC+MyBatis)技术完成平台开发,使用Hadoop的核心组件HDFS存储教学质量管理文件,使用MySQL存储后台数据,使用Docker完成分布式部署。 相似文献
6.
面对众多的大数据技术与研究领域,需要设计合理的学习路径和线索。通过在教学过程中划分多层次(基础层、提高层、综合层),让学生可以有针对性地由浅入深学习,掌握诸如安装维护、基本操作、应用开发、平台调优、架构设计等不同层面的知识。针对大数据工程实践中的常用技术方向,设计了不同层次的实践教学内容,并以工程中常用技术HDFS知识点为例进行阐述。在课程实施过程中该设计内容满足教学需要,使学生能够更加清晰地了解大数据技术在实际中所面对的不同业务需求。 相似文献
7.
Preparing a Data Scientist: A Pedagogic Experience in Designing a Big Data Analytics Course 
下载免费PDF全文
下载免费PDF全文 Daniel Adomako Asamoah Ramesh Sharda Amir Hassan Zadeh Pankush Kalgotra 《Decision Sciences Journal of Innovative Education》2017,15(2):161-190
In this article, we present an experiential perspective on how a big data analytics course was designed and delivered to students at a major Midwestern university. In reference to the MSIS 2006 Model Curriculum, we designed this course as a level 2 course, with prerequisites in databases, computer programming, statistics, and data mining. Students in the class were mostly seniors or at the graduate level, and had a strong technical and quantitative background. We include details of concepts covered in the course, as well as summaries of four major sample course assignments used. Some of the concepts covered include large‐scale data collection and management using the Hadoop ecosystem, stream mining, visual analytics, and social network analytics. Besides Hadoop, the course also introduced various IBM and Teradata big data tools. We show how the course modules align with the intended learning goals and course objectives. A post‐course survey indicated that the structure and organization of the course helped students clearly and concisely assimilate the course content. 相似文献
8.
为了提升电商大数据平台复杂数据操作性能,通过分析电商业务特点,从数据重新组织与平台参数调优两个方面对数据平台进行优化。在数据重新组织方面,使用 ORC 数据格式存储数据,并对数据表进行合理的分区、分桶;在平台参数调优方面,对业务涉及到的主要组件参数进行针对性调节。最后,通过搭建具有 32个节点的 Hadoop 集群,并使用 TPC-DS 测试集进行仿真实验,验证调优思路及方法的有效性。结果表明,调优之后的平台性能大约是未进行任何优化平台的 7.5 倍,优化效果显著。 相似文献
9.
王正才 《贵州广播电视大学学报》2020,(1):5-9
远程教育内部质量诊改信息系统是远程教育质量保障工作落到实处和常态化的关键所在。根据远程教育数据分散、数据杂乱、考量对象个性化等因素,基于Hadoop大数据框架,设计远程教育内部质量诊改信息系统架构,对关键问题进行分析并提出策略,为今后远程教育质量保障工作的信息化和现代化奠定基础。 相似文献
10.
11.
Osvaldo Jiménez 《理论付诸实践》2015,54(2):101-108
With games captivating the minds of many children in the United States, educators may be interested in trying to introduce games into their classrooms. This article offers educators insights into how to understand and incorporate games that are inherently social, promoting effective discourse in their classrooms. Although educational games and more generally educational technology are largely seen as being designed for individuals, tools exist that are designed for group play that can spark both peer-group and intergenerational play and discussion. Games that promote conversation and cooperation allow children to develop social skills, build community, and practice various modes of mentorship. Knowing about both the history and the research concerning how social games can be used helps educators critically analyze the effective use of games in the classroom and augment students learning of difficult concepts. 相似文献
12.
Christelle Devos Gentiane Boudrenghien Nicolas Van der Linden Assaad Azzi Mariane Frenay Benoit Galand Olivier Klein 《European Journal of Psychology of Education - EJPE》2017,32(1):61-77
A central trend in qualitative studies investigating doctoral students’ dropout is to stress the importance of students’ integration and socialisation in their working environment. Yet, few of these studies actually compared the experiences of doctoral students who completed or quit their PhD. In order to overcome this limitation and identify the factors that differentiate these two groups, the present study interviewed 21 former doctoral students: 8 completers and 13 non-completers. The results show that what best differentiates these two groups of participants is the extent to which they feel that they are moving forward, without experiencing too much distress, on a research project that makes sense to them. We assume that this set of factors is central in the dropout process. Support from doctoral peers was found to play a positive role overall but did not contribute to differentiating the two groups, presumably because peers have a limited impact on dissertation progress. Supervisors’ support was central to the participants’ stories; it is thus assumed to play a role in the process, but this role is complex and needs further investigation. These results call for a stronger consideration of the doctoral task itself when investigating the process of persistence and attrition and for a more integrated framework that considers jointly both task- and environment-related aspects. 相似文献
13.
李国峰 《北京城市学院学报》2021,(1)
随着教育大数据应用愈发广泛,智慧学习成为现阶段信息化教育的突出成果。依托于教育大数据背景,智慧学习能够为学习者提供更为优化的学科知识架构、统筹整合各类教学资源、提高专业知识的适应性。为充分发挥智慧学习的现实价值,在构建其系统模型时应当遵循科学合理、简便易行、稳定可靠等原则。因此,在教育大数据背景下,智慧学习系统模型的构建可从框架规划、测试开发规范搭建以及明确目标等四方面进行,为学生提供科学有效的学习帮扶工具。 相似文献
14.
Higher education institutions increasingly recognise the need to develop both disciplinary knowledge and soft skills to foster the employability of their graduates. For students in International Studies programmes, the workplace opportunities to develop soft skills relevant to their intended professions are scarce, costly and unavailable to many. This paper argues that universities can harness the power of ICTs in ways that students find engaging and offer opportunities to gain professional experience that prepares them for an international workplace. We describe a new work-integrated learning model that embeds a multi-layered in-person simulation within an academic context. Facilitated by cross-national pedagogical collaboration, students participate live in cross-campus experiential learning with online peers. Students’ reflections on the model indicate that this model can foster a range of generic soft skills that enable them to apply their academic knowledge, collaborate with a culturally diverse group and work in a digital world. To refine this blended learning model, more attention needs to be paid to designing appropriate evaluation tools and harnessing cultural diversity more effectively. 相似文献
15.
Much research attention has been focused on learning through game playing. However, very little has been focused on student learning through game making, especially in science. Moreover, none of the studies on learning through making games has presented an account of how students engage in the process of game design in real time. The present study seeks to address that gap. We report an exploratory embedded case study in which three groups of students in one classroom created a computer game designed to teach peers about climate science, while drawing on scientific knowledge, principles of game design, and computational thinking practices. Data sources were student design sheets, computer video, and audio screen capture while students created their game, and interviews after completing the curriculum unit. A theme-driven framework was used to code the data. A curricular emphasis on systems across climate systems, game design, and computational thinking practices provided a context designed to synergistically supported student learning. This embedded case study provides a rich example of what a collaborative game design task in a constructionist context looks like in a middle school science classroom, and how it supports student learning. Game design in a constructionist learning environment that emphasized learning through building a game allowed students to choose their pathways through the learning experience and resulted in learning for all despite various levels of programming experience. Our findings suggest that game design may be a promising context for supporting student learning in STEM disciplines. 相似文献
16.
With increasingly rigorous standards and mounting high stakes testing, it seems harder than ever to motivate and engage struggling readers. In this article the authors provide an overview of the inquiry learning process, which details how providing students with choice and opportunities to collaborate with peers can keep students invested in their own learning and progress. Within the framework of standards and/or a unit of study, students are coached toward choosing a personally meaningful research question in which they are given freedom to explore the answer through a variety of self-selected texts. Inquiry learning can be woven into already existing units of study or can be used to create an entirely new classroom project. The authors walk readers through the inquiry process with a teacher vignette that provides a step-by-step plan that can be implemented in any classroom. 相似文献
17.
在大数据时代背景下,高校可以利用大数据技术,整合教育管理相关信息更好开展促进大学生心理健康、实施多元化评价、关注大学生生活以及为大学生提供个性化就业指导等服务。高校应采取转变思维、培养专业人才、加强校企合作、保护敏感信息等措施迎接大数据时代,以促进学生全面发展,形成高水平的教育治理能力。 相似文献
18.
针对大数据处理框架MapReduce中的任务调度问题,提出一种基于Markov决策过程（Markov Decision Process,MDP）的任务调度算法,通过状态集来描述集群中节点的负载和作业的数据本地性需求,使用状态转移函数表示调度策略对状态的影响,采用值迭代求解算法求取最优策略,实现集群中节点的最优调度．实验结果表明,该算法能够保证数据本地性的同时,减少作业响应时间,提高系统综合性能． 相似文献
19.
Miwa Aoki Takeuchi Venise Bryan 《International Journal of Research & Method in Education》2019,42(2):124-136
Peer collaboration in schools can be a locus for negotiation of power and cultural norms. Set in the context of ethnically and linguistically diverse urban schools, this study discusses the possibilities and limitations of utilizing video-mediated interviews to reveal multiple voices. Our research method is based on video-recorded peer-to-peer interactions wherein a small group of students engaged in mathematics tasks, as well as video-mediated interviews with individual students while watching the video of themselves engaging in group work. Using the theoretical framework of ideological and sociohistorical nature of voice and figured worlds, our analysis revealed the ideologies and sociohistorical norms that influenced the ways in which the students collaborate with their peers. Based on our analyses of the video-mediated interviews, we raise awareness of potential conflicts that could affect the generation and development of ideas through collaboration. We also discuss ways to use video-mediated interviews as a methodology to interrogate the norms underlying collaboration among students in school settings. 相似文献
20.
在语文识字教学中,教师要避免教学形式单一化,尝试用丰富多样的教学策略,促使学生提升识字效率。教师应结合游戏让学生展开思考,联系生活设置语境,展开对比使学生发现规律,利用课外实践使学生学以致用等,让识字教学变得更为多元化,提升学生识字学习的有效性。 相似文献