`
lancelotwjq
  • 浏览: 53606 次
  • 性别: Icon_minigender_1
  • 来自: 北京
社区版块
存档分类
最新评论

glusterfs简介

阅读更多
 
GlusterFS is an open source, clustered file system capable of scaling to several petabytes and
handling thousands of clients. GlusterFS can be flexibly combined with commodity physical, virtual,
and cloud resources to deliver highly available and performant enterprise storage at a fraction of the
cost of traditional solutions.
 

GlusterFS是一个开源集群文件系统,能够扩展到PB级存储容量并处理数以千计的客户端请求。GlusterFS可与物理资源、虚拟资源和云资源商品灵活组合,以低于传统的解决方案的成本,提供高可用和高性能的企业存储。

 

Red Hat Storage was designed to achieve several major goals:
Elasticity
Elasticity is the notion that an enterprise should be able to flexibly adapt to the growth (or reduction) of data
and to add or remove resources to a storage pool as needed without disrupting the system. Red Hat Storage
was designed to allow enterprises to add or delete users, application data, volumes and storage nodes, etc.,
without disrupting any running functionality within the infrastructure.
Linear scaling
“Linear scaling” is a much-abused phrase within the storage industry. It should mean, for example, that
twice the amount of storage systems will deliver twice the realized performance—twice the throughput (as
measured in gigabytes per second) with the same average response time per external file system I/O event
(i.e., how long an NFS client will wait for the file server to return the information associated with each NFS
client request).

 

红帽存储解决方案(也就是Glusterfs)有如下设计目标:

 

     弹性存储

 

     弹性存储是指企业应该能够灵活地适应数据的增长(或减少),在不中断系统的情况下,根据需要添加或删除资源存储池。红帽存储解决方案可以在不破坏的基础设施内的任何正在运行的功能的情况下,让企业添加/删除 用户、应用程序数据、卷和存储节点。

 

     线性扩展

 

 

      “线性扩展”是存储行业内的滥用短语。它应当意味着,例如,两倍存储系统容量将提供两倍的性能—两倍吞吐量(GB/s),

并保持相同的外部文件系统I / O事件平均响应时间(如发送请求后,NFS文件服务器客户端将等待多久才能收到文件服务器返回的相关信息)。

 

There are seven fundamental technical differentiators between Red Hat Storage and traditional storage
systems. These are discussed in brief below.
  

      红帽存储和传统存储之间有7个基本的技术差异。下面将简单讨论它们。

 

Software-only 只用软件实现
Open source  开源
Complete storage operating system stack 不仅是分布式文件系统,还提供了应该有的各种功能。
Our belief is that it’s important not only to deliver a distributed file system, but also to deliver a number of
other important functions in a distributed fashion. Red Hat Storage delivers distributed memory manage-
ment, I/O scheduling, software RAID, self-healing, local N-way synchronous replication as well as asynchro-
nous long-distance replication via Red Hat Geo-Replication. In essence, by taking a lesson from micro-kernel
architectures, we have designed Red Hat Storage to deliver a complete storage operating system stack in
user space.
User space  用户模式而不是内核模式,通过fuse实现。
Unlike traditional file systems, Red Hat Storage operates in user space. This makes installing and upgrading
Red Hat Storage significantly easier. And it means that users who choose to develop on top of Red Hat
Storage need only have general C programming skills, not specialized kernel expertise.
Modular, stackable architecture  模块化、可堆放的架构, 通过xlator动态链接库实现。
Red Hat Storage is designed using a modular and stackable architecture approach. To configure Red Hat
Storage for highly specialized environments (e.g., large number of large flies, huge numbers of very small
files, environments with cloud storage, various transport protocols, etc.), it is a simple matter of including or
excluding particular modules.
For the sake of stability, certain options should not be changed once the system is in use (for example, one
would not remove a function such as replication if high availability was a desired functionality).
Data stored in native formats   数据以本地文件系统的格式存储,通过完全兼容POSIX语义实现。
With Red Hat Storage, data is stored on disk using native formats (e.g. EXT3, EXT4, XFS). Red Hat Storage
has implemented various self-healing processes for data. As a result, the system is extremely resilient.
Furthermore, files are naturally readable without Red Hat Storage. If a customer chooses to migrate away
from Red Hat Storage, their data is still completely usable without any required modifications or data
migration.
No metadata with the elastic hash algorithm  没有原数据(即数据的数据信息),通过DHT实现。
In a scale-out system, one of the biggest challenges is keeping track of the logical and physical location of
data (location metadata). Most distributed systems solve this problem by creating a separate index with file
names and location metadata. Unfortunately, this creates both a central point of failure and a huge perfor-
mance bottleneck. As traditional systems add more files, more servers, or more disks, the central metadata
server becomes a performance chokepoint. This becomes an even bigger challenge if the workload consists
primarily of small files and the ratio of metadata to data increases.
Unlike other storage systems with a distributed file system, Red Hat Storage does not create, store, or use
a separate index of metadata in any way. Instead, Red Hat Storage places and locates files algorithmically.
All storage node servers in the cluster have the intelligence to locate any piece of data without looking it up
in an index or querying another server. All a storage node server needs to do to locate a file is to know the
pathname and filename and apply the algorithm. This fully parallelizes data access and ensures linear perfor-
mance scaling. The performance, availability, and stability advantages of not using metadata are significant
and, in some cases, dramatic.
 


    
分享到:
评论

相关推荐

    GlusterFS分布式文件系统

    重点内容包括GlusterFS简介,系统原理剖析,典型应用场景和开放问题讨论。

    glusterfs 管理手册

    glusterfs 管理手册 3.3.0 非常好用的分布式文件系统

    Glusterfs文档分析

    关于Glusterfs分布式文件系统的总结

    GlusterFS Distribution Model.pdf

    2. GlusterFS concepts 3. Introduction to GlusterFS 4. Introduction to DHT - the distribution model 5. Scalability and reliability in GlusterFS 6. Features in DHT 7. Performance translators 8. Demo 9. ...

    glusterfs安装包-centos6.6

    glusterfs安装包-centos6.6

    GlusterFS 101培训课程

    GlusterFS 101培训主要针对企业内训,同时面向IT主管、运维人员、测试人员、研发人员以及售前售后人员,提供GlusterFS相关基本原理、系统运维、软件测试、研发定制、解决方案等培训内容。

    GlusterFS学习笔记.docx

    GlusterFS学习笔记.docx

    glusterfs 结构体系分析

    glusterfs 结构体系分析,挺好的文档。

    glusterfs的那些事-3.4.11

    一些重要的概念与进程前面提到了一些 glusterfs 的数据内存模型,还有一些 posxi 接口的实现,那么 glusterfs 当中其中还有一些其他比较重要

    glusterfs 5.0

    Glusterfs5.0 Ubuntu 18.04离线安装包和安装说明,测试可用

    GlusterFS文件系统的搭建和使用

    GlusterFS文件系统的搭建和使用,运维操作

    GlusterFS开发与学习

    GlusterFS入门学习,了解分布式存储系统

    glusterfs3.7.9

    glusterfs分布式文件系统3.7.9====稳定版====全家桶安装包

    GlusterFS文件系统

    GlusterFS,glusterfs,分布式文件系统

    GlusterFS系统管理手册中文版

    这篇文章主要是自己对英文版的GlusterFS系统管理手册进行翻译,并加入一些自己的理解!希望大家能一起学习一起进步!

    GlusterFS与Ceph 性能测试报告

    GlusterFS与Ceph是不一样的存贮系统,GlusterFS更加针对分布式文件系统,虽然目前开发者也正在努力增加块与对象存贮服务。 由于两者在设计理念等各个方面有所不同,单纯的测试比较从功能应用的角度来说意义不大(如...

    GlusterFS Performance.pdf

    “distributed software RAID” ● Alternative to RAID controllers or 3-way replication ● Cuts storage cost/TB, but computationally expensive ● Better Sequential Write performance for some workloads ...

    GlusterFS分析报告.pdf

    glusterfs分析报告,源码分析,网上下载下来的, 现在上传共享资源。

    Keepalived+GlusterFS多机热备集群方案

    通过keepalived,实现多台GlusterFS高可用的存储配置方案。2个节点的GlusterFS无法避免脑裂问题,多台GlusterFS如何提供统一的挂载服务,通过该技术方案,完美的实现了VIP方式的高可用的GlusterFS存储方案。

Global site tag (gtag.js) - Google Analytics