- 浏览: 675932 次
- 性别:
- 来自: 上海
文章分类
- 全部博客 (254)
- java分布式应用架构 (22)
- SSH框架整合 (6)
- java web 学习笔记 (49)
- java 学习笔记 (56)
- struts 2 学习 (6)
- Hibernate学习 (10)
- spring 学习 (2)
- 客户端编程(javascript) (4)
- IDE使用 (13)
- 生命 人生 (6)
- 系统维护 (3)
- 技术篇 (10)
- MySql (2)
- J2ME (1)
- java网络编程 (4)
- 数据库 (5)
- C/C++ (8)
- Oracle (7)
- 软件测试 (0)
- 软件的安装和部署 (0)
- Java快讯 (1)
- swt (1)
- Flex (1)
- 软件工程 (1)
- PostgreSQL (1)
- sql server2000 (2)
- 嵌入式数据库sqlite (5)
- J2EE (1)
- XML (1)
- ibatis3(MyBatis) (6)
- Linux&Unix (1)
- velocity (1)
- 回报社会 (4)
- 软件项目管理 (3)
- android研究 (3)
- C# (2)
- Objective-C (1)
- 音乐 (0)
- webx (1)
- JMS (1)
- maven软件项目管理 (1)
- 分布式服务 (0)
- 云平台 (0)
- 分布式存储 (1)
- 分布式系统架构 (0)
- 移动互联网 (1)
- ZooKeeper (1)
最新评论
-
liyys:
楼主,可不可以发这个项目的源码工程出来分享一下,少了几个类。楼 ...
仿照Hibernate实现一个SQLite的ORM框架 -
liyys:
少了一些类的源码没有粘贴出来
仿照Hibernate实现一个SQLite的ORM框架 -
honglei0412:
我使用的是这种方式获取db文件的目录但是 URL p = Fi ...
使用sqlite注意事项 -
honglei0412:
大侠 能不能说明下DbFile您是怎么做的吗?
使用sqlite注意事项 -
ahack:
刚写完mapping才发现早就有人写好了。仔细一看还都是针对的 ...
仿照Hibernate实现一个SQLite的ORM框架
什么是BOM
BOM(byte-order mark),即字节顺序标记,它是插入到以UTF-8、UTF16或UTF-32编码Unicode文件开头的特殊标记,用来识别Unicode文件的编码类型。对于UTF-8来说,BOM并不是必须的,因为BOM用来标记多字节编码文件的编码类型和字节顺序(big-endian或little- endian)。
BOMs 文件头:
00 00 FE FF = UTF-32, big-endian
FF FE 00 00 = UTF-32, little-endian
EF BB BF = UTF-8,
FE FF = UTF-16, big-endian
FF FE = UTF-16, little-endian
下面举个例子,针对UTF-8的文件BOM做个处理:
String xmla = StringFileToolkit.file2String(new File(“D:\\projects\\mailpost\\src\\a.xml”),“UTF-8”);
byte[] b = xmla.getBytes(“UTF-8”);
String xml = new String(b,3,b.length-3,“UTF-8”);
..............
思路是:先按照UTF-8编码读取文件后,跳过前三个字符,重新构建一个新的字符串,然后用Dom4j解析处理,这样就不会报错了。
其他编码的方式处理思路类似,其实可以写一个通用的自动识别的BOM的工具,去掉BOM信息,返回字符串。
不过这个处理过程已经有牛人解决过了:http://koti.mbnet.fi/akini/java/unicodereader/
实际应用:
BOM(byte-order mark),即字节顺序标记,它是插入到以UTF-8、UTF16或UTF-32编码Unicode文件开头的特殊标记,用来识别Unicode文件的编码类型。对于UTF-8来说,BOM并不是必须的,因为BOM用来标记多字节编码文件的编码类型和字节顺序(big-endian或little- endian)。
BOMs 文件头:
00 00 FE FF = UTF-32, big-endian
FF FE 00 00 = UTF-32, little-endian
EF BB BF = UTF-8,
FE FF = UTF-16, big-endian
FF FE = UTF-16, little-endian
下面举个例子,针对UTF-8的文件BOM做个处理:
String xmla = StringFileToolkit.file2String(new File(“D:\\projects\\mailpost\\src\\a.xml”),“UTF-8”);
byte[] b = xmla.getBytes(“UTF-8”);
String xml = new String(b,3,b.length-3,“UTF-8”);
..............
思路是:先按照UTF-8编码读取文件后,跳过前三个字符,重新构建一个新的字符串,然后用Dom4j解析处理,这样就不会报错了。
其他编码的方式处理思路类似,其实可以写一个通用的自动识别的BOM的工具,去掉BOM信息,返回字符串。
不过这个处理过程已经有牛人解决过了:http://koti.mbnet.fi/akini/java/unicodereader/
Example code using UnicodeReader class Here is an example method to read text file. It will recognize bom marker and skip it while reading. //import http://koti.mbnet.fi/akini/java/unicodereader/UnicodeReader.java.txt public static char[] loadFile(String file) throws IOException { // read text file, auto recognize bom marker or use // system default if markers not found. BufferedReader reader = null; CharArrayWriter writer = null; UnicodeReader r = new UnicodeReader(new FileInputStream(file), null); char[] buffer = new char[16 * 1024]; // 16k buffer int read; try { reader = new BufferedReader(r); writer = new CharArrayWriter(); while( (read = reader.read(buffer)) != -1) { writer.write(buffer, 0, read); } writer.flush(); return writer.toCharArray(); } catch (IOException ex) { throw ex; } finally { try { writer.close(); reader.close(); r.close(); } catch (Exception ex) { } } }
Example code to write UTF-8 with bom marker Write bom marker bytes to start of empty file and all proper text editors have no problems using a correct charset while reading files. Java's OutputStreamWriter does not write utf8 bom marker bytes. public static void saveFile(String file, String data, boolean append) throws IOException { BufferedWriter bw = null; OutputStreamWriter osw = null; File f = new File(file); FileOutputStream fos = new FileOutputStream(f, append); try { // write UTF8 BOM mark if file is empty if (f.length() < 1) { final byte[] bom = new byte[] { (byte)0xEF, (byte)0xBB, (byte)0xBF }; fos.write(bom); } osw = new OutputStreamWriter(fos, "UTF-8"); bw = new BufferedWriter(osw); if (data != null) bw.write(data); } catch (IOException ex) { throw ex; } finally { try { bw.close(); fos.close(); } catch (Exception ex) { } } }
实际应用:
package com.dayo.gerber; import java.io.BufferedReader; import java.io.BufferedWriter; import java.io.File; import java.io.FileInputStream; import java.io.FileOutputStream; import java.io.IOException; import java.io.InputStream; import java.io.InputStreamReader; import java.io.OutputStreamWriter; import java.io.Reader; import java.util.Properties; /** * * @author 刘飞(liufei) * */ public class Generate4YYQTPScript { private static final String ENCODING = "UTF-8"; private static final String GERBER_CONFIG = "config/gerber4yy.properties"; private static Properties GERBER_CONFIG_PROPS = null; private static final String GERBER_FORMAT_DIALOG_TITLE_SCRIPT = "{#GERBER_FORMAT_DIALOG_TITLE}"; private static String GERBER_FORMAT_DIALOG_TITLE = ""; /* gerber properties parmters keys config */ private static final String QTP_SCRIPT_IN = "script.in"; private static final String QTP_SCRIPT_OUT = "script.out"; private static final String QTP_SYSTEM_PATH = "QTP.system.path"; private static final String QTP_SYSTEM_PATH_SCRIPT = "{#QTPSYSTEMPATH}"; private static final String GERBER_FILE_DRIVER_PATH = "gerber.file.driver.path"; private static final String GERBER_FILE_DRIVER_PATH_SCRIPT = "{#driver}"; private static final String GERBER_FILE_DRIVER = "gerber.file.driver"; private static final String GERBER_FILE_DRIVER_SCRIPT = "{#dr}"; private static final String GERBER_FILE_DIR = "gerber.file.dir"; private static final String GERBER_FILE_DIR_SCRIPT = "{#dirName}"; private static final String GERBER_FILE = "gerber.file"; private static final String GERBER_FILE_SCRIPT = "{#fileName}"; private static final String GERBER_OUT = "gerber.out"; private static final String GERBER_OUT_SCRIPT = "{#gerberout}"; private static final String VB_EXE_PATH = "vb.exe.path"; /* bigBoard props */ private static final String LEAGUE_BOARD_NUM_SCRIPT = "{#LEAGUE_BOARD_NUM}"; private static final String WIDTH_SCRIPT = "{#WIDTH}"; private static final String P_SCRIPT = "{#P}" ; private static final String DY_SCRIPT = "{#DY}"; private Properties BIGBOARD_PROPS = null; public Generate4YYQTPScript(Properties bigboard_props) { super(); BIGBOARD_PROPS = bigboard_props; try { GERBER_CONFIG_PROPS = ConfigHelper .getConfigProperties(GERBER_CONFIG); GERBER_FORMAT_DIALOG_TITLE = GERBER_CONFIG_PROPS.getProperty( GERBER_FILE_DRIVER).trim().toUpperCase() + "\\" + GERBER_CONFIG_PROPS.getProperty(GERBER_FILE_DIR).trim() .toUpperCase() + "\\" + GERBER_CONFIG_PROPS.getProperty(GERBER_FILE).trim() .toUpperCase(); GERBER_FORMAT_DIALOG_TITLE = GERBER_FORMAT_DIALOG_TITLE.substring(0, 17) ; } catch (IOException e) { e.printStackTrace(); } } public static void main(String[] args) throws IOException { Properties bigboard_props = new Properties() ; bigboard_props.setProperty("{#LEAGUE_BOARD_NUM}", String.valueOf(4)) ; bigboard_props.setProperty("{#WIDTH}", String.valueOf(new Double("54"))) ; bigboard_props.setProperty("{#P}", String.valueOf(new Double("2"))) ; bigboard_props.setProperty("{#DY}", String.valueOf(new Double("0.00"))) ; Generate4YYQTPScript generateQTPScript = new Generate4YYQTPScript(bigboard_props); generateQTPScript.generateQTPScript(); // RuntimeUtil.getInstance().run(generateQTPScript.getVBEXE(), 1, 50000); } public String getCheckOutFilePath() { return GERBER_CONFIG_PROPS.getProperty(GERBER_FILE_DRIVER).trim() + "/" + GERBER_CONFIG_PROPS.getProperty(GERBER_FILE_DIR).trim(); } public String getSavePath() { return GERBER_CONFIG_PROPS.getProperty(GERBER_OUT); } public String getVBEXE() { return GERBER_CONFIG_PROPS.getProperty(VB_EXE_PATH); } /** * Generate QTP Script * * @return * @throws IOException */ public File generateQTPScript() throws IOException { return generateQTPScript(GERBER_CONFIG_PROPS .getProperty(QTP_SCRIPT_OUT), GERBER_CONFIG_PROPS .getProperty(QTP_SCRIPT_IN)); } /** * set value to script * * @param source * @return * @throws IOException */ private String scriptConvey(String source) throws IOException { String _source = source; _source = this.replace(this.replace(this.replace( this.replace(this.replace(this.replace(this.replace( _source , GERBER_FORMAT_DIALOG_TITLE_SCRIPT, GERBER_FORMAT_DIALOG_TITLE), GERBER_FILE_SCRIPT, GERBER_CONFIG_PROPS.getProperty(GERBER_FILE)), GERBER_FILE_DRIVER_SCRIPT, GERBER_CONFIG_PROPS .getProperty(GERBER_FILE_DRIVER)), GERBER_OUT_SCRIPT, GERBER_CONFIG_PROPS .getProperty(GERBER_OUT)), GERBER_FILE_DIR_SCRIPT, GERBER_CONFIG_PROPS .getProperty(GERBER_FILE_DIR)), GERBER_FILE_DRIVER_PATH_SCRIPT, GERBER_CONFIG_PROPS .getProperty(GERBER_FILE_DRIVER_PATH)), QTP_SYSTEM_PATH_SCRIPT, GERBER_CONFIG_PROPS .getProperty(QTP_SYSTEM_PATH)); if (this.BIGBOARD_PROPS != null) { _source = this.replace(this.replace(this.replace( _source , DY_SCRIPT, this.BIGBOARD_PROPS.getProperty(DY_SCRIPT)), WIDTH_SCRIPT, this.BIGBOARD_PROPS .getProperty(WIDTH_SCRIPT)), LEAGUE_BOARD_NUM_SCRIPT, this.BIGBOARD_PROPS .getProperty(LEAGUE_BOARD_NUM_SCRIPT)); _source = this.replace(_source, P_SCRIPT, this.BIGBOARD_PROPS.getProperty(P_SCRIPT)) ; } return _source; } /** * Generate QTP Script * * @param target * target file * @param source * source file * @throws IOException */ public File generateQTPScript(File target, File source) throws IOException { return generateQTPScript(target.getAbsolutePath(), source .getAbsolutePath()); } /** * Generate QTP Script * * @param target * target file path * @param source * source file path * @return * @throws IOException */ public File generateQTPScript(String target, String source) throws IOException { File f = new File(target); if (!f.exists()) { f.getParentFile().mkdirs(); try { f.createNewFile(); } catch (Exception e) { } } FileOutputStream fos = null; OutputStreamWriter osw = null; BufferedWriter bw = null; try { final byte[] bom = new byte[] { (byte)0xEF, (byte)0xBB, (byte)0xBF }; fos = new FileOutputStream(f); osw = new OutputStreamWriter(fos, ENCODING); bw = new BufferedWriter(osw); fos.write(bom); bw.write(scriptConvey(getSourceFileContentReader(source))); bw.flush(); bw.close(); return f; } catch (IOException e) { throw e; } } /** * Reader convey to string * * @param source * @return * @throws IOException */ private String reader2String(Reader source) throws IOException { BufferedReader bufferedReader = new BufferedReader(source); StringBuffer result = new StringBuffer(); String buffer = null; while ((buffer = bufferedReader.readLine()) != null) { result.append(buffer + "\n"); } return result.toString(); } /** * * @param source * file path * @return * @throws IOException */ private Reader getReader(String source) throws IOException { return source == "" ? null : new BufferedReader(new InputStreamReader( getInputStream(source))); } /** * get script file content string * * @param source * @return * @throws IOException */ private String getSourceFileContentReader(String source) throws IOException { return source == "" ? "" : reader2String(getReader(source)); } /** * get inputstream * * @param source * file path * @return * @throws IOException */ private InputStream getInputStream(String source) throws IOException { return source == "" ? null : new FileInputStream(new File(source)); } /** * Replace all occurences of a substring within a string with another * string. * * @param inString * String to examine * @param oldPattern * String to replace * @param newPattern * String to insert * @return a String with the replacements */ private String replace(String inString, String oldPattern, String newPattern) { if (!hasLength(inString) || !hasLength(oldPattern) || newPattern == null) { return inString; } StringBuilder sb = new StringBuilder(); int pos = 0; int index = inString.indexOf(oldPattern); int patLen = oldPattern.length(); while (index >= 0) { sb.append(inString.substring(pos, index)); sb.append(newPattern); pos = index + patLen; index = inString.indexOf(oldPattern, pos); } sb.append(inString.substring(pos)); return sb.toString(); } private boolean hasLength(String str) { return hasLength((CharSequence) str); } private boolean hasLength(CharSequence str) { return (str != null && str.length() > 0); } }
发表评论
-
Spring MVC集成velocity扩展
2013-07-23 17:18 32091、扩展velocity的视图 [code=" ... -
eclipse svn 忽略 target等目录
2013-04-22 10:08 2364这个build失败的解决方案就是不要把你项目的 target ... -
Java编程中“为了性能”尽量要做到的一些地方
2012-09-14 10:33 11861. 尽量在合适的场合使 ... -
Java 5.0多线程编程
2012-08-17 19:16 1027概述 1:三个新加的多线程包 2:C ... -
Thread.setDaemon设置说明
2012-06-28 18:00 1110Thread.setDaemon的用法,经过学习以后了解: ... -
JVM运行时数据区
2012-03-07 13:15 972JVM定义了若干个程序执行期间使用的数据区域。这个区域里的一些 ... -
使用ibatis防止sql注入
2011-12-19 19:59 4620为了防止SQL注入,iBatis模糊查询时也要避免使用$$来进 ... -
java的引用探讨
2011-12-18 16:03 1095Reference 是一个抽象类,而 SoftReferenc ... -
ClassLoader
2011-11-04 15:11 1164package org.liufei.neta.lib; ... -
仿照Hibernate实现一个SQLite的ORM框架
2011-09-30 20:06 3137那么先来看看使用 实体对象 package test; ... -
java压缩文件
2011-09-20 11:09 1254package org.liufei.net.util; ... -
获取客户机IP地址
2011-09-07 15:04 992package org.liufei.jweb; imp ... -
Java读取本地机器MAC地址
2011-09-07 15:01 1261package org.liufei.jweb; imp ... -
Java获取客户端信息
2011-09-07 14:48 1622String agent = request.getHeade ... -
使用 jQuery progressBar 做文件上传的进度条指示
2011-09-07 14:18 2086var progress_key = '4cd0f29463e ... -
一个很棒的类似 Facebook 风格的 TextboxList
2011-09-07 14:17 1294TypeHere.keyup(function (e) { ... -
jquery 中国省市信息联动插件
2011-09-07 14:15 1293/*** * 插件名称: 中国省市信息联动插件 */ ... -
获取IP地址
2011-09-07 13:41 2372public String getIpAddrByReques ... -
netty telnet 应用实例server代码
2011-09-07 12:21 1827public class TelnetServer { ... -
Netty中使用Apache Common FileUpload
2011-09-07 12:19 1241/** * 用Netty来实现上传 */ publi ...
相关推荐
Java解决UTF-8的BOM问题
1.首先介绍一下本人应用场景,qt...3.此小工具主要针对utf-8编码文件,能够批量添加删除BOM,无识别转化ASIIC功能,添加BOM时,如果文件是utf-8(BOM),则跳过,删除亦然 4.当不选中添加删除时可用于文件数量统计。
文件的编码格式需要转换,gb2312,utf,utf-8等编码格式的相互转换等
解决PB创建UTF-8文件带BOM问题; 2.字段串直接生成XML文件。 由于项目需要,需要字符串转为XML文件,直接用Fileopen进行EncodingUTF8编码后,发现文件实际为UTF-8 BOM编码 问度娘发现有相同问题,但解决方式是利用...
当上传文件存在中文时,修改上传文件编码为utf-8-bom
NULL 博文链接:https://baobeituping.iteye.com/blog/1280825
php 字符编码转换类,支持ANSI、Unicode、Unicode big endian、UTF-8、UTF-8+Bom 互相转换。
NULL 博文链接:https://itsoul.iteye.com/blog/1488513
去除bom头小工具,工具使用方法: 选择要遍历的文件夹,输入...勾选ANSI转为UTF-8,则会将相应格式但编码为GB2312,GBK,GB18030的文件转为无BOM的UTF-8文件 请确保文件可写!使用前请做好备份,作者不承担任何法律责任
我对之前的去BOM工具和需要的DLL进行了整合
易语言另类数据库读写UTF-8源码,另类数据库读写UTF-8
IDEA支持带BOM的UIDEA支持带BOM的UTF-8编码文件TF-8编码文件
UTF8BOM转换工具
utf-8,去bom头文件gfgadsfdsa
UTF-8不需要BOM来表明字节顺序,但可以用BOM来表明编码方式。字符"ZERO WIDTH NO-BREAK SPACE"的UTF-8编码是EF BB BF。所以如果接收者收到以EF BB BF开头的字节流,就知道这是UTF-8编码了。 Windows就是使用BOM来...
2. 如果你是其他版本的IDEA,那么用压缩工具处理你的DEA安装目录下lib文件夹中的ecj-x.x.x.jar文件(名字根据IDEA版本会有所不同), 将Util.class替换该jar包目录中\org\eclipse\jdt\internal\compiler\util路径下的...
UTF-8文件批量去除BOM标记,不用再一个一个的删除bom标记了。
2. 如果你是其他版本的IDEA,那么用压缩工具处理你的DEA安装目录下lib文件夹中的ecj-x.x.x.jar文件(名字根据IDEA版本会有所不同),将Util.class替换该jar包目录中\org\eclipse\jdt\internal\compiler\util路径下的...
批量将sql脚本批量转换为utf-8无bom格式,sql脚本批量转换字符集,字符集批量转换。可以将脚本放在任意目录,执行批处理脚本进行字符集批量转换。也支持txt文件进行字符集转换