`
david.org
  • 浏览: 155611 次
  • 性别: Icon_minigender_1
  • 来自: 上海
社区版块
存档分类
最新评论

File Appends in HDFS [HDFS-145]

 
阅读更多
FSNameSystem#addStoredBlock does not handle inconsistent block length correctly

Description:
Currently NameNode treats either the new replica or existing replicas as corrupt if the new replica's length is inconsistent with NN recorded block length. The correct behavior should be
1. For a block that is not under construction, the new replica should be marked as corrupt if its length is inconsistent (no matter shorter or longer) with the NN recorded block length;
2. For an under construction block, if the new replica's length is shorter than the NN recorded block length, the new replica could be marked as corrupt; if the new replica's length is longer, NN should update its recorded block length. But it should not mark existing replicas as corrupt. This is because NN recorded length for an under construction block does not accurately match the block length on datanode disk. NN should not judge an under construction replica to be corrupt by looking at the inaccurate information: its recorded block length.
分享到：
| [HDFS] Hadoop Over Ftp 项目的两点改进
评论
发表评论

您还没有登录,请您登录后再发表评论

相关推荐

    Serial Port Server with sample code

    "Serial Port/Send File" will send the file which it's name is in "Input" box ;; - The file will be splited in 256 bytes for each block to sending. ;; - Between blocks will delay the number of ticks ...

    FileMenu Tools V5.2.0┊用于自定义Windows右键菜单的小工具┊英文绿色免费版

    If a folder is selected, then will be created a file in that folder with the clipboard contents. * New utility: Size of Folders. This utility lets you see the size of the folders.a

    python使用内存zipfile对象在内存中打包文件示例

    复制代码 代码如下:import zipfileimport StringIO class InMemoryZip(object): def __init__... def append(self, filename_in_zip, file_contents): ”’Appends a file with name filename_in_zip and content

    S7A驱动720版本

    - From the S7A power tool it wasn't possible to open the online help file. Now it can be opened and also the context-sensitive help works properly. - When the signal conditioning function "S&M" ...

    trilium-windows-x64-0.51.2.zip

    addTextToEditor appends text to the end instead of the beginning fix "isActive()" detection to work well with splits, #2806 fix doubling of icon tooltips, closes #2811 allow searching within mermaid ...

    Sortable前端框架

    fallbackOnBody: false, // Appends the cloned DOM Element into the Document's Body fallbackTolerance: 0, // Specify in pixels how far the mouse should move before it's considered as a drag. scroll:...

    JAVAssd3选择题答案全

    (d) By always specifying the throws clause in every method header where file I/O is performed 7.All Java exception classes are derived from the class (a) java.lang.Throwable (b) java.lang.Error ...

    cbWorkLoadSuite:一个基于ouchbase-java-sdk-client的写繁重工作负载生成器

    cbWorkLoadSuite 在密钥集上的写操作的分布： x - x - x - x - x - x - x - x - x sets x - x - x - x - x - x - x - x - x - x - x - xx - x deletes x - x x - x - x appends x - x - x x - x prepends x - x x - ...

    LCTF软件备份VariSpec™ Liquid Crystal Tunable Filters

    All files are contained in a single installer file which includes the following: vsdrvr.h declaration file vsdrvr.lib library stub file vsdrvr.dll run-time library vsdrvr_r1p30.pdf (this file) ...

    javalist数据结构-Java数据结构-------List.pdf

    源代码分析 1、添加元素到列表尾端(Appends the specified element to the end of this list.) ArrayList:当所需容量超过当前ArrayList的⼤⼩时，需要进⾏扩容，对性能有⼀定的影响。 优化策略：在能有效评估...

    matlab.rar_arrays matlab_vectors

    Dumps DF2 filter coefficient vectors to file in C language format in forward order. Creates two files "filename.h" which defines the size of the array and declares the arrays as extern, and "filename....

    laravel分页模板.rar

    laravel自定义分页模板，基于框架默认分页添加了跳转页功能，直接复制到resources文件下，页面直接输出分页即可用，详细使用可参考文档

    text-mode:DOM的基于字符的显示

    文字模式 DOM的基于字符的显示 npm install text-mode var TextMode = require ( 'text-mode' ) ; bower install text-mode < script src =" bower_components/text-mode/text-mode-min.js ...//appends to elemen

    nc2zarr:将NetCDF文件转换为Zarr格式的Python工具

    nc2zarr 一个Python工具，可将多个NetCDF文件转换为单个Zarr数据集。 创建Python环境 $ conda install -n base -c conda-forge mamba ... Reads one or more input datasets and writes or appends them to a s

    Messages:留言内容

    Appends.json-附加到消息末尾的消息模板的数据存储库 Bodies.json-作为消息主体的消息模板的数据存储库 Prepends.json-消息模板的数据存储库，该模板位于消息的开头 Messages.json-包含ID的数据存储库到其他存储库，...

    log-lite:小错误处理程序

    错误记录精简版轻量级错误处理程序包库安装使用软件包管理器安装foobar。 通过将以下内容添加到文件中来配置项目.... // return error messege, then create error dir & file("error-log"); appends error mes

    format_ticks.zip_The Handle_format_ticks

    The code replaces or appends XTickLabels and YTickLabels of axis handle h with input tickx and ticky array in MATLAB

    PMP考试技巧

    All entries in this document were taken from Lotus Notes and web site Forum appends. Items shown in bold blue are editorial comments by Larry Jordan, George Lombardi or Gary Davis. Each note is ...

    crc.rar_it

    it is a program that implements Cyclic Redundancy Check to the transmitted data in binary format for error detection in the data at the receiver side (if any). It appends as many CRC check bits to the...

    Android代码-CommonItemDecoration

    A custom ItemDecoration which appends dividers(with same thickness) between items(with same dimension) for RecyclerView 中文版 When using RecyclerView, we often need set dividers between items. ...

Magicbox
Global site tag (gtag.js) - Google Analytics