Software engineering is an engineering discipline that is concerned with all aspects of software production from the early stages of system specification through to maintaining the system after it has gone into use. In this definition, there are two key phrases: Engineering discipline Engineers make things work. They apply theories, methods, and tools where these are appropriate. However, they use […]
Different types of systems need different development processes. For example, real-time software in an aircraft has to be completely specified before development begins. In e-commerce systems, the specification and the program are usually developed together. Consequently, these generic activities may be organized in different ways and described at different levels of detail depending on the type of software being developed. […]
Three VM architecture show in the figure, the host machine is equipped with the physical hardware, as shown at the bottom of the figure. An example is an x86 architecture desktop running its installed Windows OS, as shown in part (a) of the figure. The VM can be provisioned for any hardware system. The VM is built with virtual resources […]
A conventional computer has a single OS image. This offers a rigid architecture that tightly couples application software to a specific hardware platform. Some software running well on one machine may not be executable on another platform with a different instruction set under a fixed OS. A Virtual machine (VM) offer novel solutions to underutilized resources, application inflexibility, software manageability, […]
Like other engineering disciplines, software engineering is carried out within a social and legal framework that limits the freedom of people working in that area. As a software engineer, you must accept that your job involves wider responsibilities than simply the application of technical skills. You must also behave in an ethical and morally responsible way if you are to […]
Now a days MapReduce use mani tech joint company for their data processing. such as: At Google Index construction for Google Search Article clustering for Google News Statistical machine translation wordcount, adwords and pagerank At Yahoo “Web map” powering Yahoo! Search Spam detection for Yahoo! Mail At Facebook Data mining Ad optimization Spam detection At research Astronomical image analysis (Washington) […]
MapReduce is a programming model Google has used successfully is processing its “big-data” sets (~ 20 petabytes per day). MapReduce requires a distributed file system and an engine that can distribute, coordinate, monitor and gather the results. Hadoop provides that engine through (the file system we discussed earlier) and the JobTracker + TaskTracker system. JobTracker is simply a scheduler. TaskTracker […]
Xen architecture is an open source hypervisor program developed by Cambridge University. Xen is a microkernel hypervisor, which separates the policy from the mechanism. The Xen hypervisor implements all the mechanisms. leaving the policy to be handled by Domain 0, as shown in figure does not include any device drivers natively.It just provides a mechanism by which a guest OScan […]
Hadoop is a free, open-source software framework for distributed storage and processing of large datasets on clusters of commodity hardware. It was developed by the Apache Software Foundation and is based on the Google File System (GFS) and MapReduce. Hadoop is designed to handle big data, which refers to extremely large datasets that cannot be processed by traditional data processing […]
This rack setup is idel for Hadoop cluster setup, by which cluser become more fault tolerant. The highest layer of Hadoop is the MapReduce engine that deals with the information stream and control stream of MapReduce occupations over conveyed processing frameworks. Figure shows the MapReduce engine architecture helping out HDFS. Like HDFS, the MapReduce engine also has a master/slave architecture […]
Recent Comments