Cloud Fundamentals

This blog would be discussed the simple definition of the cloud computing, its role and IT as services. Furthermore, what organisation should be considered before moving to cloud computing?

What is a cloud?

1

According to the cloud Security Alliance (CSA)- “cloud enhances collaboration, agility, scaling, and availability, and provides the potential for cost reduction through optimised and efficient computing”.

What is the cloud computing?

“Cloud computing enables ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or services provider interaction” – according to the  NIST definition of cloud.

Why use cloud computing?

Untitled

Untitled1

Five Major Characteristics of the Cloud:

Self-services: cloud consumers can provision and manage servers, systems, and resources through a single portal or developer API. There is also an On-Demand component which indicates that resources are always available to the customers.

Broad accessibility: Cloud services are delivered consistently. They are available and accessible through standard, heterogeneous platforms such as laptops, desktops, and mobile devices.

Shared:  Cloud resources are provided for maximum efficiency and then shared across many consumers in a multi-tenant model. This model optimises resources allocation and financial efficiency.

Elastic: Resources can scale based on usage, scaling up/down typically means that server resources allocation (CPU/RAM/Storage) can dynamically change. Scaling in/out is thought of as adding or subtracting host nodes to an application based on demand.

Measured metered: Usage is calculated based on what is consumed by the user. This is typically referred to as a” pay-as-you-go” model and is similar in concept to your basic home utilities, for instance, water and power.

Three Deployment models:

  1. Open public:

Cloud resources are typically rendered over the internet or an open network. Public cloud is typically owned and operated by commercial service providers who own and offer access to consumers, for example, AWS, Rack space, and Salesforce

 2. Hybrid

A combination of one or more public or private clouds bound together by a common fabric. This model allows consumers many options to meet their business requirement and fits the cloud to need.

3. Enterprise Private

Cloud resources built specially for an entity (group, organisation, company, and so on). Infrastructure can be hosted internally or externally and also managed internally or by a third party.

Cloud Services Delivery Methods:

Infrastructure as a service (IaaS)

Infrastructure as a service supply companies with computing resources as well as servers, storage, networking, and data centre space on a pay-per-use basis.

The benefits of IaaS

  • No need to invest in own hardware
  • Infrastructure scales on demand to support dynamic workloads
  • Flexible, innovative services available on demand

IaaS Examples: Amazon Web Services (AWS), Cisco Metapod, Microsoft Azure, Google Compute Engine (GCE), Joyent

Platform as a service (PaaS)

Platform as a service provides a cloud-based environment with everything required to maintain the complete lifecycle of building and conveying online (cloud) applications —without the cost and difficulty of buying and managing the essential hardware, software, provisioning, and hosting.

 The benefits of PaaS

  • Develop applications and grab to market faster
  • Deploy new web applications to the cloud in minutes
  • Reduce complexity with middleware as a service

   Enterprise PaaS Examples: Apprenda

Software as a service (SaaS)

Software as a service in cloud-based application system which run on remote computers that are owned and control by others and that connect to client’ computers via the Internet and, usually, a web browser

The benefits of SaaS

  • the user can sign up and rapidly start using innovative business apps
  • Apps and data are accessible from any connected computer
  • If your computer breaks, usually no data is lost as data is in the cloud
  • The service is able to dynamically scale to usage needs

SaaS Examples: Google Apps, Salesforce, Workday, Concur, Citrix GoToMeeting, Cisco WebEx .

Untitled2

IT as a service:

ITaaS is an operational and organisational shift to running IT like a business and optimising IT production for business consumption.

  • New technology models
  • New consumption models
  • New operational models

Before moving to cloud organisation need to consideration some factors:

Cloud is not a perfect solution and often comes with concerns and questions from the industry and consumers. Five areas where cloud providers typically have to address.

Security and Risk:  1. I f I move to the cloud, are my applications safe? Will I become a target for hackers?

  • Provider security posture
  • Governance
  • Application security
  1. Attacks that affect you, even though you aren’t the target: Users of public cloud run the risk of collateral damage, virus attacks, and services interruptions
  2. Incident response: In a cloud environment, you may not have control over how quickly incidents are handled.
  3. Visibility:
  • You may not be able to see what your provider is doing
  • You may not have visibility to your resources running in the cloud
  1. Multiple cloud vendors: Some cloud providers may actually be storing your data on a different cloud provider’s platform

Privacy:

  • Who can view my data?
  • Where does my data reside?
  • Will an unauthorised entity have access to my data?
  • How will my data be segregated?
  • How will my data be destroyed?
  • Where will it be physically located?
  • How will my data be treated during the move?

Cloud computing risks:

  • Data stored on third-party servers
  • Limited control
  • Inadequate security
  • System breaches
  • Compromised data
  • Legal problems

Compliance: 1. How do we ensure we are meeting all of our compliance and regulatory compliance policies?

  • Compliance can be an increased cost
  • Compliance may require a cloud services audit
  1. Audit and compliance risks
  • Security risks
  • Information risks
  • Billing risks
  • Contract risks

Vendor lock-in: How can we support business continuity and ensure seamless migration between cloud services?

  • Proprietary and incompatibility
  • Inefficient processes
  • Contract constraints
  • Fear of vendor lock-in is a major impediment to cloud service adoption
  • Many customers stay with a provider that doesn’t meet their needs, just to avoid a cumbersome migration process

Performance: How can I be sure I’m getting the right level of performance and services quality from the cloud?

  • Nosy neighbor
  • Provider capabilities
  • Resources disparity
  • An enterprise IT organisation acting as a cloud provider to users of its hybrids cloud need to guarantee services without the control over the performance of public cloud services in its environment.

Question: what could be the reasons that financial organisations are not interested in moving cloud computing?

Answer: a Financial organisation like banks, leasing, depository financial organisation is not keen to move cloud computing because of data security. Cloud computing service is not able provided 100 % data security, privacy and legal compliance as per financial intuition required,   and the main factor is that cloud services have provided the third party vendors so there is a risk that client transaction and financial information can be compromised with any third party and competitor or hackers.

cery.png

Data Network Fundamentals

This blog I would like to give a glance about Data network fundaments.  The different between NAS and SAN, and how iSCSI, SAS, and FC work within SAS systems. In addition, simple explanation of how to data networking relevance the file storage, block storage, high availability (HA), high-performance computing (HPC) .

Data storage and data networking

Data storage:

  • Data over time
  • Information repository
  • Capacity
  • RAID, JBOD

Data Network:

  • Data over distance
  • Information movement
  • Speed
  • Hubs and switches

Untitled

NAS and SAN: Access

NAS = File Access

  • Files managed within the NAS system
  • Management simplified

Untitled1

SAN = Block access

  • Files managed outside the SAN system
  • Configured flexible
  • Performance high

Untitled2

Untitled3

Untitled 4.png

Untitled5

SAN connection: iSCSI, SAS, and FC

iSCSI:

  • Is an IP-based standard that is the primary alternative to FC
  • Is less expensive (uses standard cables and switches)
  • Can send signals longer distances
  • Is a client-server protocol including initiator is the client and target are the servers
  • Works with servers that use iSCSI software initiators or host bus adapter (HBA) cards for connection

SAS:

Uses aerial cable and carries SCSI packets

Is inexpensive and more reliable than iSCSI

Has a limited range and provides a limited number of connections

FC:

Advantages

  • Very reliable
  • Scalable
  • Flexible

Use cases

  • Designed for supercomputers
  • Now used in most enterprise storage application

FC: Topologies and Zoning

Topologies

  • FC –P2P (point to point)
  • FC-AL (arbitrated loop)
  • FC-SW (switch fabric): Single or dual

Zoning: Hard versus soft

Untitled6

Brief of File and Block storage, High availability, and high-performance computing 

File storage versus Block Storage

Block storage:

  • Treats data as standardised chunks of data
  • Provide greater flexibility and higher performance

File storage

  • Handles data in terms of files
  • Easier and simple to deploy

What is the High Availability?

  • Ultimate goal – all data available at all times
  • Method –redundancy
  • Measurement –nines -99% = two nine, 99.99% = four nines

High-Performance computing:  Exceptional large system for example weather forecasting and climate research, oil and gas exploration, and molecular modelling

Characteristics:

  • Small configuration changes produce large benefits
  • Performance is measured in FLOPS (floating point operations per second )

Question: What is the best data network solution for the medium sales based company?

Answer:  For the medium sales based company where employees need to shared file which may be contained the sales figures of different interval or might be client profile. The best solution would be this type of company NAS solutions because NAS is easier to implement and simple to managing and cost effective for medium size organisation. NAS is the best solution for file sharing in the local area network.

certi.jpg

Virtualization Fundamentals

Virtualization breaks the bond between hardware and applications, allowing the customer to realise higher utilisation levels of their physical resources.

untitled

Before virtualization, each server has storage, RAM, CPU, an operating system and an application. After virtualization, it has become a single box with a CPU, RAM, and the help of virtualization software such as VMware ESX Operating system.  A CPU and RAM of the server can be shared multiple server and application together, as a result, processing power can be reduced.

The benefit of Server Virtualization:

  1. Lower server spends due to increased server utilisation
  2. Decreased operating cost including power, cooling, real estate
  3. Lower management costs
  4. Increase flexibility in term of faster implementation of new apps and re-purposing existing servers.
  5. Higher availability because disaster recovery (DR) can be more widely implemented

Server Virtualization challenges:

  • Hardware outrage could be more serious
  • Backup of a virtualized environment could be impossible with the traditional backup window
  • Storage failure can wipe numerous applications

Why we need virtualization?

Untitled

NetApp Storage Virtualization:

  • We do for storage what VMware does for server
  • Pooled storage resources
  • Multiprotocol
  • High utilization
  • Lower TCO such as operational cost, management, and training

How to solving server virtualization challenges with NetApp Storage:

  1. Potential storage failure:

Problem: storage failure can cause downtime for many more users

Solution: need more reliable storage

  • RAID –DP is superior data protection to RAID 5
  • Significantly less expense than RAID 10

2. Backup challenges

Problem: Backup of a visualised environment could be impossible within the traditional backup windows

Solutions: Need faster and more flexible backup

  • Snapshot copies
  • Time for backup is greatly reduced
  • Many snapshot copies can be kept for more flexibility
  • Instant restoration
  • No performance degradation
  • Less storage space needed than competitors

The benefit of NetApp Storage:

  1. Storage utilization

storage utilization

utization.png
2. Storage Virtualization with A-SIS Deduplication:

Dedupication.jpg

3. Multiprotocol architecture: Pooled storage

  • Disaster recovery more accessible
  • Lower overall TCO
  • Investment protection

Question: What is main reason virtualization system becoming more popular in a business organisation? 

Answer: The main factor to consider for the popularity of the virtualization system is minimising hardware, space and reducing resources wasting cost. Example, before virtualization same file, might be shared 300 users with 300 copies but after virtualization, one copy of the same file can access 300 of users from the same location. The destroy recovery solution is another reason f gaining virtualization system day by day.

certi.png

Storage Technologies

This post I would like to overview about the different type of storage technologies including Direct-attached storage (DAS), Network storage, storage virtualization, flash technology and cloud computing, and the components and protocol that underlie those technologies.  Furthermore, the benefits and which type of environment would be best-suited for that technology.

Direct-attached storage (DAS):

DAS is the digital storage system that is directly connected to one computer or server without any storage network in between, and it is not accessible to other clients and servers machines. Example, Hard drive is the form of direct-attached storage for an individual user.  DAS can be a disk on a server, Disk in a client, group of disks internal or external to a server.

In the enterprise solution, individual disk or group of disks that are internal or external are directly attached to a server through SCSI, SATA and SAS interfaces.

DAS sample

 Components:

  • ATA
  • SATA
  • eSATA
  • SCSI
  • SAS
  • FC

Benefit :

  • It can provide better performance than network storage because of the dedication server
  • Server does not need to traverse the network in order to read and write data
  • Proper utilisation of underlying storage during expansion of application server
  • It is one of the famous cost effective solutions for any small organisation

Best-suited environment:

  • Small business organisation or enterprise
  • Small or home office users
  • Localised file sharing with single or few servers in an infrastructure
  • Certain type of application that needs high performance

Limitation:

For the organisation that anticipates rapid data growth, it is important to keep in mind that DAS is limited in its scalability.

Criticised: An inefficient way to manage storage because DAS can’t be shared and it has not failover facilities if server crash occurs. However,  the advantages of the DAS has gained again as virtualization become mainstream.

Network-attached storage (NAS):

It is a kind of dedicated file storage devices that provides local-area network nodes with file-based shared storage through an Ethernet connection. NAS has a processor, Disk array using RAID technology for handling disk failure, the external disk can be connected to NAS system for additional storage. For managing and configured NAS devices do not need a keyboard or a monitor, it can be a browser-based utility program.

From both a cost perspective and an administrative perspective, network storage models such as NAS and SAN are more suited to high scalability requirement and can address the challenges inherent in a DAS implementation.

Components:

  • Ethernet switch
  • Own IP address
  • CFS
  • NFS

How a NAS system functions?

  • Each NAS must reside on the Local area network as an independent network node
  • On a network, the NAS system appears on a file server with an IP address
  • The NAS implements file services by using protocols of CFS and NFS
  • The application servers handle all the processing of data

NAS

Benefit:

  • NAS provide multiple clients to access the same files on the network
  • NAS appliances can be outfitted with larger disks or clustered together which provide both vertical scalability and horizontal scalability
  • File-based storage system that makes data available over the network
  • NAS relieves the server of storage and file sharing responsibility
  • NAS vendors with cloud storage provider may provide customer with an extra layer of redundancy for backup files
  • More flexible to data access

Best-suited Environment:

Ideal for business organisation who wants to

  • Easy to manage, Install and deploy
  • Implementing multiple clients at the file level to get access to faster data in a cost effective way
  • Consolidate DAS resources for better utilisation

DAS-NAS

Storage Area Network (SAN):

It is a dedicated high-speed network storage that interconnects and maintains shared pools of storage devices to multiple servers.  It allows each server to access shared storage even through disk drives directly attached to the server.  It is blocked based storage system that transfers data between servers and storage devices on request from the user end. A host sends out a block- based access request when it wants to access storage on the SAN.

SAN dia

Components:

  • Cabling
  • Host bus adapters (HBAs)
  • Switches

How does it function?

  • Each switch and storage system must be interconnected
  • Physical interconnections must support bandwidth level so that they can handle peak data activities effectively

The different type of SAN:

  • FC-SAN (Fibre Channel) – most common

Untitled

  • iSCSI SAN – Standard IP-based storage access protocolUntitled1
  • FCoE SAN – Fibre Channel over Ethernet

Untitled3

Best suited environment:

  • High data growth Database and Imaging server
  • High volume Transaction processing
  • High performance and 24/7 operation

Storage Virtualization:

Storage virtualization consists of taking several physical storage devices and joining them to appear as one logical unit to manage.

The benefit of storage virtualization:

  • Increase storage utilisation: It is easier for an administrator to managing all of the spaces including in the pool apart from its location by pooling storage into a single resource. This permits for much better storage utilisation.
  • Simplify storage management: Storage management is also easier because virtualization storage can be managed from a single administrate console. A storage administrator can see utilisation trends and growth patterns more clearly and can make better upgrade or capacity planning decisions. Virtualization storage can be thinly provisioned or even dynamically provisioned (increasing or decreasing the storage on demand)
  • Increase storage flexibility: Virtualization storage is also flexible when storage space is decoupled from a physical disk or storage arrays. It’s simple to migrate and copy that virtual storage between systems or geographic locations. For example, the data can be migrated from an older storage system to a newer one for the better performance without making any adjustments to the application. Similarly, data can be copied to another local storage system for backup purposes or replicate to an off-suit location for disaster recovery purposes.

The advantage of flash storage:

  • Memory unit: Stored data
  • Access controller: Manages and controls access to the storage space on the memory unit

Untitled5

  • Superior speed
  • Reliable compare to traditional disk and unlike traditional disk, it uses electricity and read faster
  • Flexible, Cost-effective, Optimise storage

The advantage of Cloud computing:

untitled7.png

Private cloud computing:

Advantages:

  • Relay heavy on own data and applications
  • Have a restricted data security and privacy requirement
  • Can run a need-generation cloud data center efficiently and effectively on own system.

Disadvantage: Organization has to purchases and maintains all software and infrastructure

Public cloud computing:

Advantages:

  • The services and infrastructure are rendered off-site over the internet and are open to public
  • It offers the greatest level of efficiency in shared resources
  • Users don’t need to purchases hardware, software, or any supporting infrastructure because those resources are owned and managed by providers

Disadvantage: Public cloud is more vulnerable than private cloud in term of security and reliability

Hybrid cloud computing: It is a combination of private and public options. It can be the best choice for an organisation who offers services that are tailored for the different vertical market because the business can use a public cloud to communicate and connect with their clients and keep own data secure within a private cloud.

Advantages:

  • With multiple providers offering the benefit of multiple deployment models
  • Users can keep each aspect of their business in the most efficient environment

Disadvantage: Users have to keep track of multiple different security platforms and ensure that all aspects of their business can communicate with each other.

Question: A CEO of the organisation comes to you for a storage solution for his company. As per his requirement, the company has 1200 employees, maintained 8 separate servers for 8 different applications, they have a file server, mail server, database server and in hours software server.  Their data growth rate is GIGAbytes per hours. What is the best solution you would give him and why?

Answer:  The best suggestion I would like to give him to reduce the number of physical servers by using the virtualization storage. It would help him to reduce managing and maintain cost, administrative and controlling server would be easier for the company. Based on his data growth rate and access to operation time Storage Area network SAN  would be best suited for that company because it allows each server to access shared storage even through disk drives directly connected. It is high-speed network storage and maintained a shared pool of multiple servers. It is the best solution for that company has usage data growth database server and live operation 24/7, also required high performance.

storage-certi

Storage Fundamentals

When we think about the requirement of the data storage system of any Business organization, the obvious question comes to our mind what the data growth rate is.

Data growth is the explosion of data comes from human and machine. Data growth has increasing based on the size, quantity, and lifespan of the organization. With the growth of IT and digitalization of the system, organizations are producing more information in electronic format rather than paperwork such as Email, home directories, scanned documents, daily financial transaction, employee’s data, telecommunications, medical image systems, and utility equipment.  Data storage has become increasingly more important area with the growth of data because the industries, enterprises are stored their data in the data center, as a result data center is growing at an unprecedented rate.

The size of the storage capacity has been growing dramatically day by day.  Kilobyte, Megabyte, Gigabyte, Terabyte are commonly used size in last decade but petabyte –size is no longer an rarely.  Not only data is stored in the storage, but also the data must be accessed by various constituencies in a different location, and repeatedly in a fast-paced, collaboration manner. Enterprises depend on accessing a wide variety of data objects to run their mission-critical workflows.

The question is what is the solution of data growth?    – The simple answer: Data storage solution!

The data storage solution is considered based on organization data growth rate. The solutions are disks, disk arrays, JBODS, and Intelligent storage system.

The characteristics of the storage solutions:

Disk:

Diak

Disk array:

disk array.png

JBOD (Just a bunch of Disks)

JBOD

Intelligent storage system

Business IN.png

What factors organisations need to consider when investing in a storage solution: Before investing in a storage solution, organisations need to focus on the following major factors

  1. Applications: what are the organisation application requirement in regards to data stored, performance, capacity and energy consumption? And what applications including SQL, Exchange, Oracle and VMware, among others, need to be supported by the storage?
  2. Data protection: What is the alternative solution of data disaster? What are the organisation growth plans along with data protection requirements? How to organisation will minimise the minimal data loss, how to handle disk failure or natural disaster such as fire, flood?
  3. Data availability: How to recover the lost data and how to make data available to the client as soon as possible? And what is the performance of storage? The factor must be considered such as hardware redundancy, Application availability and disaster recovery systems.
  4. Data Security: How to control Intrusion from outside, Internal security Breaches? And what is the implementation of data security?
  5. Scalability: A good storage solution should be scalable and one way to ensure scalability is to have storage grid.
  6. Performance: Performance must be considered on throughput, response time, capacity and reliability
  7. Cost: Cost of storage is an important consideration for organisations – Cost of buying the storage system and cost of managing the storage system. Cost effective solution is Simple to manage, highly available, reliable.

Factor to consider.jpg