期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

大数据关键技术 被引量：55

Key Big-Data Technologies
在线阅读 下载PDF
导出
摘要 结合大数据系统的一般结构,介绍和对比了当前大数据领域在文件存储、数据处理和数据库领域的关键技术。通过各种技术的对比,得到了一些分析结果。分析结果表明大数据系统的解决方案必将落地于现有的云计算平台;云计算平台的分布式文件系统、分布式运算模式和分布式数据库管理技术是解决大数据问题的基础;一些大的依靠数据盈利的大公司必然会是大数据应用的主体。 In this paper, we discuss the general structure of a big-data system as well as key technologies in big-data storage, processing, and database. We compare these technologies in order find problems in the big-data system and propose solutions that will be used in the cloud computing platform. We propose distributed file system, computing model, and database management to solve problems associated with big data. Big companies that profit from big data will be the main users of big-data applications.
作者 王秀磊 刘鹏
机构地区 解放军理工大学指挥信息系统学院
出处 《中兴通讯技术》 2013年第4期17-21,共5页 ZTE Technology Journal
基金 国家科技重大专项(2012ZX03002003)
关键词 大数据 分布式文件系统 分布式数据库 MapReduce技术 Ibig data distributed file system distributed database MapReduce
分类号 TP311.13 [自动化与计算机技术—计算机软件与理论]
  • 相关文献

参考文献27

  • 1MANYIKA J, CHUI M, BROWN B, etal. Big data: The next frontier for innovation, competition, and productivity [EB/OL]. [2012-10-02].http://www.mckinsey.com/Insight/MGI/ Research/Technology_and_Innovation/ Big_data The next frontier_for_innovation.
  • 2BARWICK H. The "four Vs" of big data. Implementing Information Infrastructure Symposium [EB/OLI. [2012-10-02]. http:// www.computerworld.com.au/article/396198/iiis four vs_big_data/.
  • 3孟小峰,慈祥.大数据管理:概念、技术与挑战[J].计算机研究与发展,2013,50(1):146-169. 被引量：2407
  • 4GHEMAWAT S, GOBIOFF H, LEUNG S. The Google file system [CI//Proceedings of the 19th ACM SIGOPS Symposium on Operating Systems Principles (SOSP'03), Oct 19 - 22, 2003, Bolton Landing, NY, USA. New York,NY, USA: ACM, 2003:29-43.
  • 5DEAN J, GHEMAWAT S. MapReduce: Simplified data processing on large clusters [C]//Proceedings of the 6th USENIX Symposium on Operation Systems Design and Implementation (OSDI '04), Dec 6-8, 2004, San Francisco, CA USA. New York, NY USA: ACM. 2004:137-150.
  • 6CHANG F, DEAN J, GHEMAWAT S, et.al. Bigtable: A distributed storage system for structured data [C]//Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation (OSDI '06), Nov 6-8,2006, Seattle,WA, USA. Berkeley, CA, USA: USENIX Association. 2006:205-218.
  • 7CHAIKEN R, JENKINS B, LARSON P, et al. SCOPE: Easy and efficient parallel processing of massive data sets [J]. Proceedings of the VLDB Endowment (PVLDB), 2008, 1 (2): 1265-1276.
  • 8HDFS Architecture Guide [EB/OL]. [2012-10-02]. http://hadoop.apache.org/docs/ hdfs/r0.22.0/hdfs_design.html.
  • 9FastDFS [EB/OL]. [2012-10-02]. http://code. google .com/p/fastdfs/w/list.
  • 10OpenAFS [EB/OL]. http://www.OpenAFS.org.

二级参考文献167

  • 1Nature. Big Data [EB/OL]. [2012-10-02]. http,//www. nature, com/news/specials/bigdata/index, html.
  • 2Bryant R E, Katz R H, Lazowska E D. Big-Data computing : Creating revolutionary breakthroughs in commerce, science, and society [R]. [2012-10-02]. http:// www. cra. org/ccc/docs/init/Big_Data, pdf.
  • 3Science. Special online collection: Dealing with data [EB/OL]. [2012-10-02]. http://www, sciencemag, org/site/ special/data/, 2011.
  • 4Agrawal D, Bernstein P, Bertino E, et al. Challenges and opportunities with big data A community white paper developed by leading researchers across the United States [R/OL]. [2012-10-02]. http://cra, org/ccc/docs/init/bigdata whitepaper, pdf.
  • 5Manyika J, Chui M, Brown B, et al. Big data: The next frontier for innovation, competition, and productivity [R/OL]. [ 2012-10-02 ]. http://www, mekinsey, corn/ Insights]MGI[Research/Teehnology _ and _ Innovation]Big _ data The next frontier for innovation.
  • 6World Economic Forum. Big data, big impact: New possibilities for international development [R/OL]. [2012- 10-02]. http://www3, weforum, org/docs/WEF TC MFS BigDataBigImpact_Briefing 2012. pdf.
  • 7Big Data Across the Federal Government [EB/OL]. [2012-10-02]. http://www, whitehouse, gov/sites/default/ files/microsites/ostp/big_data fact sheet_final_ 1. pdf.
  • 8UN Global Pulse. Big Data for Development:Challenges Opportunities [R/OL]. [ 2012-10-02 ]. http://www. unglobalpulse, org/proj ects/BigDataforDevelopment.
  • 9Times N Y. The age of big data fEB/OLd. [2012-10 -02]. http://www, nytimes, com/2012/02/12/sunday review/big- datas-impact in-the-world, html?pagewanted=all.
  • 10Grobelnik M. Big-data computing: Creating revolutionary breakthroughs in commerce, science, and society [R/OL]. [2012-10 -02]. http://videolectures, net/cswc2012_grobelnik_ big_data/.

共引文献2406

同被引文献378

引证文献55

二级引证文献665

中兴通讯技术
2013年 第4期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部