dr_present 1

Download DR_PRESENT 1

If you can't read please download the document

Post on 09-Jan-2017

95 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

TAB ONETAB TWOTAB THREETAB FOURTAB FIVE

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

FaaS(Food as a service )ICT (Information and Communication Technology)

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Cloud computing

Project objectives1-

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Project objectives2.

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Project objectives3.

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Project objectives4.

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Project Achievements

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

TAB ONETAB TWOTAB THREETAB FOURTAB FIVE

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Introduction to Cloud teamWhat, which, how and why?

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

In the simplest terms, cloud computing means storing and accessing data and programs over the Internet instead of your computer's hard drive.When it's smarter to rent than to buyCloud computing is an emerging computing technology that uses the internet and central remote servers to maintain data and application.

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

But where does The Cloud come in??

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

HardwareOperating SystemAppAppAppTraditional StackHardwareOSAppAppAppHypervisorOSOSVirtualized StackKey Technology: Virtualization

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

A complex system consisting of complex subsystems

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Architecture Cloud ComputingHardwareCentOSKVMOpenStackBig DataWeb Open Shift

Host OS. distro

Why centos?Familiar of deploy and configure recently released RDO.Community support.Performance benchmarks relating to updates.Number of bugs.

Why GO open?Multi-Vendor Virtual.Brings the efficiency, agility, and cost benefits of cloud. prevents one vendor from controlling your access to the greatest innovationLarge supporting community.

Architecture Cloud ComputingHardwareCentOSKVMOpenStackBig DataWeb Open Shift

Virtualization

Architecture Cloud ComputingHardwareCentOSKVMOpenStackBig DataWeb Open Shift

OpenStack Architecture

HorizonNovaNeutronSwiftCinderKeystoneGlanceCeilometerHeat

OpenStack Installation

Preparation for installation:Update OS.Remove Network manager.Add repositories.

Installing services one by one Manual installation Service keystone 1. Installing the service: # yum install openstack-keystone python- keystoneclient 2. Configure the service:# openstack-config--set/etc/keystone/keystone.conf\ sqlconnectionmysql://keystone:KEYSTONE_DBPASS@controller/keystone 3. Start and enable Service#serviceopenstack-keystonestart #chkconfigopenstack-keystone on Service glanceService nova Enable networkingAdd the dashboard horizon

OpenStack scripted deployment RDO An automated installation with minimal user intervention. Answer file is a simple text file contains configurations of OS.Quick start:Getting software repositories.# yum update y # yum install -y http://rdo.fedorapeople.org/rdo-release.rpm 2. Getting Packstack installer.# yum install -y openstack-packstack 3. Run Packstack to install openstack# packstack--allinone

OpenStack administration | cloud imagesVM Image: Virtual disk that has a bootable operating system installed on it.OpenStack supported image formats:RAWQCOW2: commonly used with the KVM hypervisor. The image size is smaller. Support for snapshots.VM Image metadata: CPU architecture. The OS installed on the image (Linux, Windows, ). OS_Distro (Centos, Fedora, Ubuntu,).

OpenStack Linux image requirements to be sure that the image supports the OpenStack features:Resize root partition on boot.No hard-coded MAC address information.Ensure ssh server runs.Access instance by using ssh public key.Use cloud-init to fetch the public key. Inject ssh key into the instance in the first boot.Process user data (host name, ssh key).Disable firewall and use the host firewall.

We built two cloud images:Centos cloud image:LAMP web server cloud Image: Linux operating system (Centos).Apache HTTP Server is the most popular web server.MySQL database.PHP server-side scripting language designed for web. Tools to modify images:Guestfish: modify the files inside image.Guestmount: mount the image's file system directly.

OpenStack administration | Internal Network Architecture

manage project.View and manage quotas.manage user.Manage flavors.OpenStack administration | Admin user

OpenStack administration | End userOverview about menus.Creating network.Creating instances.Setting IPs.Ping instances.

Architecture Cloud ComputingHardwareCentOSKVMOpenStackBig DataWeb Open Shift

What is Platform as a Service (PaaS)?PaaS helps organizations, specifically developers, realize the benefits of cloud computing by providing a fast and scalable way to host applications in the cloud.Technically, a PaaS is an Application Platform comprised of an operating system, middleware and other software that allows applications to run on the cloud with much of the management.Platform as a Service is changing the way developers approach developing software.

What is OpenShift Origin ?OpenShift Origin is Red Hats open source Platform as a Service (PaaS) offering. OpenShift Origin is an application platform where application developers and teams can build, test, deploy, and run their applications.

Code Deploy Enjoy

Flavors of OpenShift

origin

Public Cloud ServiceOn-premise or Private Cloud SoftwareOpen Source Project

Modernizing App Development with PaaS

OpenShift Machines

Key OpenShift Terms Broker Management host, orchestration of Nodes Node Compute host containing Gears Gear Allocation of fixed memory, compute, and storage resources for running applications Cartridge A technology/framework (PHP, Perl, Java/JEE, Ruby, Python, MySQL, etc.) to build applications.

Simple Application Creation

Architecture Cloud ComputingHardwareCentOSKVMOpenStackBig DataWeb Open Shift

TAB ONETAB TWOTAB THREETAB FOURTAB FIVE

Edit the text with your own short phrases. The animation is already done for you; just copy and paste the slide into your existing presentation.

Big Data Architecture Cloud ArchitectureHDFS / MapReduceHiveSqoop

Cloudera PlatformEco Systems

Introduction to hadoop

What Makes it Big Data?

Introduction to hadoop

Big Data

How to store?How to work?

Hadoop environment

High level hadoop architecture

Introduction to HDFS

Introduction to MapReduce

The important thing in hadoop is configuration file

Practice work at lab

Big Data Architecture Cloud ArchitectureHDFS / MapReduceHiveSqoop

Cloudera Manager and New SolutionsEco Systems

Whats the problem ?

2 TB(compresed) raw data per day today

Whats the solution? HIVE

Data Warehousing at Facebook Today

Web ServersScribe ServersFilersHive on Hadoop ClusterOracle RACFederated MySQL

HIVE Components

HIVE x BIG

Big Data Architecture Cloud ArchitectureHDFS / MapReduceHiveSqoop

Cloudera Manager and New SolutionsEco Systems

Sqoop

Why SqoopWhats SqoopHow Sqoop works

Import data

1. Run Import2. Pull metadata3. Lunch MapReduce job4. Pull data from database5. Writ to data sinksqoop import --connect jdbc:mysql://vm2.faas.com/sqoop --username root --password root --table yelid --target-dir /input/

Export data

1. Run Sqoop Export2. Launch MapReduce Job3. Write to staging table4. sql> INSERT INTO target (SELECT*FROM staging)sqoop export --connect jdbc:mysql://vm2.faas.com/sqoop --username root --password root --table location --export-dir location

Big Data Architecture Cloud ArchitectureHDFS / MapReduceHiveSqoop

Cloudera Manager and New SolutionsEco Systems

Whats Cloudera CDH?CDH : Is 100% Open Source Distribution including the core elements of Hadoop plus several open source projects.

What's Inside? Apache Yarn : (Yet Another Resource Negotiator) Is the data operating system of Hadoop that enablesyou to process data simultaneously in multiple ways.

What's Inside?Apache HUE : Hue is a suite of applications that provide web-base