International Journal of Innovative Research in Engineering and Management
Year: 2016, Volume: 3, Issue: 5
First page : ( 422) Last page : ( 430)
Online ISSN : 2350-0557.
Article Tools: Print the Abstract | Indexing metadata | How to cite item | Email this article | Post a Comment
Dr.E.Laxmi Lydia, , M. Vijay Laxmi, Dr. M.Ben Swarup
Many business cases exploiting big data have been realized in recent years: Twitter, LinkedIn, and Face book are case of organizations in the person to person communication area for big data. Likewise, implementation architectures of the utilization cases have been distributed. Notwithstanding, theoretical work coordinating the methodologies into one rational reference architecture has been constrained. Late technological advancements have lead knowledge of data from unmistakable areas in the course of recent decades. The term big data caught the importance of this developing pattern. Notwithstanding its sheer volume, big data additionally exhibits other extraordinary attributes as contrasted and conventional data. For example big data is a normally unstructured data and require all the more constant examination. This improvement calls for new system data procurement, transmission, stockpiling, and vast scale data handling components. In this paper we exhibit a literature Inspection for big data analytics platform. To start with we exhibit brief history of big data, Introduction to big data and hadoop, Map reduce, hadoop distributed file system (HDFS) In the second stage took after by procedures and technologies for dissecting big data and points of interest and contrast between big data and hadoop in the third stage we give security utilizing cloud computing, need of security in big data and big data system architecture (data era, procurement, stockpiling and analytics). These four modules form a big data esteem chain. Big data applications are an incredible advantage to associations, business, organizations and numerous vast scale and little scale ventures. We additionally talk about different conceivable answers for the issues in cloud computing, security and Hadoop. Cloud computing security is creating at a fast pace which incorporates PC security, system security, information security, and data protection. Cloud computing assumes an exceptionally key part in ensuring data, applications and the related framework with the assistance of policies, technologies, controls, and big data devices. In addition, cloud computing, big data and its applications, points of interest are prone to speak to the most encouraging new outskirts in science.
[1]V. MayerSchonberger, K. Cukier, Big Data: A Revolution That Will Transform How We Live, Work, and Think, Houghton Mifflin Harcourt, 2013.
[2]A. Cuzzocrea, Privacy and security of big data: current challenges and future research perspectives, in: Proceedings of the First International Workshop on Privacy and Security of Big Data, PSBD ’14, 2014.
[3]Big data, Nature 455(7209) (2008) 1–136
[4]Dealing with data, Science 331(6018) (2011) 639–806.
[5]R.Sumbaly, J. Kreps, S. Shah, The “Big Data” Ecosystem at LinkedIn, in: 2013 ACM SIGMOD International Conference on Management of Data, New York, New York, USA, 22–27 June, 2013.
[6]X. Amatriain, Big & Personal: data and models behind Netflix recommendations, in: The 2nd International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications, Chicago, Illinois, USA, 11 August, 2013.
[7]G. Mishne, Fast data in the era of big data: Twitter’s real-time related query suggestion architecture, in: The 2013 ACM SIGMOD International Conference on Management of Data, New York, New York, USA, 22–27 June, 2013.
[8]D. Simon celli, M. Dusi, F. Gringoli, S. Niccolini, Stream-monitoring with Block-Mon: convergence of network measurements and data analytics platforms, ACM SIGCOMM Commun. Rev. 43 (2013) 29–35.
[9]C. Zeng, et al., FIU-miner: a fast, integrated, and userfriendly system for data mining in distributed environment, in: 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, Illinois, USA, 11–14 August, 2013.
[10] V. Mayer-Schonberger, K. Cukier, Big Data: A Revolution That Will Transform How We Live, Work, and Think, Houghton Mifflin Harcourt, 2013.
[11]J.Dean,S．Ghemawa．MapReduce：SimplifiedDataP rocessingonLargeCluster．OSDI’04，Sixth Symposium on Operating System Design and Implementation, SanFrancisco，CA，December,2004.
[12] G. Li, X.Cheng, Research status and scintific science thinking of big data, Bull. China. Acad. Sci. 27(6)(2012) 647–657.
[13]A. Thusoo, et al., Data warehousing and analytics infrastructure at Facebook, in: 2010 ACM SIGMOD International Conference on Management of Data, Indianapolis, Indiana, USA, 6–11 June, 2010.
[14]M. Meier, Towards a big data reference architecture, Master’s thesis, Eindhoven University of Technology, October 2013.
[15]R. Schmidt, M. Möhring, Strategic alignment of cloudbased ar
chitectures for big data, in: 17th IEEE International Enterprise Distributed Object Computing Conference Workshops, Vancouver, Canada, 9–13 September, 2013.
[16]Y. Demchenko, C. Ngo, P. Membrey, Architecture framework and components for the Big Data Ecosystem, SNE Technical Report, University of Amsterdam, September 12, 2013.
[17]C.E.Cuesta,M.A.MartinezPrieto, J.D. Fernandez, Towards an architecture for managing big semantic data in real-time, in: 7th European Conference on Soft-ware Architecture, Montpellier, France, 1–5 July, 2013.
[18] Ren, Yulong, and Wen Tang. "A SERVICE INTEGRITY ASSURANCE FRAMEWORKFOR CLOUDCOMPUTING BASED ON MAPREDUCE."Proceedings of IEEE CCIS2012. Hangzhou: 2012, pp 240 –244, Oct. 30 2012-Nov. 1 2012.
[19] Hao, Chen, and Ying Qiao. "Research of Cloud Computing based on the Hadoop platform.".Chengdu, China: 2011, pp. 181 – 184, 21-23 Oct 2011.
[20]Bigdata,http://en.wikipedia.org/wiki/Big_data, 2014.
[21]V.R.Brokar,M.J.Carey,andC.Li,”Bigdataplatforms:Wh at’snext?”XRDS,Crossroads,ACM, vol.19,no.1,pp.44-49,2012.
[22]D.Dewitt and J.Gray,” parallel data base systems: The future of high data base systems,”.Commun.ACM,vol.35,no.6,pp.85-98,1992.
[23](2014).Teradata.Teradata,Dayton,OH,USA[online].Av ailable:http://www.teradata.com/
[24](2013).Netezza.Netezza,Marlborough,MA,USA.[online ].Available:http://www-01.ibm.com/software/data/netezza
[25](2013).AsterData.ADATA.Beijing,China[online].Avail able:http://www.asterdata.com/
[26](2013).Greenplum.Greenplum,SanMateo,CA,USA[onli ne].
[27](2013).Vertica[online].Available:http://www.vertica.co m/.
[28]S.Ghemawat, H.Gobioff, and S.-T.Leung,”The google file system,” in proc.19th ACM symp.operating syst.principles.2003,pp.29-13.
[29]J.DeanandS.Ghemawat,“Mapreduce:Simplified data processing on large clusters,”Commun,ACM,vol.51,no.1,pp,107-113,2008.
[30] T.Hey,S.Tansley and k.Tolle, the fourth paradigm:data-intensive scientific discovery. Cambridge,MA,USA:Microsoft Res.,2009.
[31] A, Katal, Wazid M, and Goudar R.H. "Big data: Issues, challenges, tools and Good practices.". Noida:2013, pp. 404 – 409, 8-10 Aug. 2013.
[32] Lu, Huang, Ting-tin Hu, and Hai-shan Chen. "Research on Hadoop Cloud Computing Model and its Applications.". Hangzhou, China: 2012, pp. 59 – 63, 21-24 Oct. 2012.
[33] Wie, Jiang , Ravi V.T, and Agrawal G. "A MapReduce System with an Alternate API for MulticoreEnvironments.". Melbourne, VIC: 2010, pp. 84-93, 17- 20 May. 2010.
[34] C. O’Neil, R. Schutt, Doing Data Science: Straight Talk from the Frontline, O’Reilly Media, Inc.,2013.
[35] Dealing with data, Science 331(6018) (2011) 639–806.
[36] K, Chitharanjan, and Kala Karun A. "A review on hadoop — HDFS infrastructure extensions.". JeJuIsland: 2013, pp. 132-137, 11-12 Apr. 2013.
[37] Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung, “The Google file system,” 19th ACM Symposium on Operating Systems Principles, Lake George, NY, October 2003 (labs.google. com/papers/gfs.html).
Associate Professor, Department of Computer Science and Engineering, Vignan's Institute Of Information Technology, Visakhapatnam, Andhra Pradesh, India.
No. of Downloads: 10 | No. of Views: 1391
