- 浏览: 96085 次
- 性别:
- 来自: HK
文章分类
最新评论
-
Mr.小裤裤:
谢谢,
我生日过的很快乐,
o(∩_∩)o...
system badimageformatexception and its partial solution
I reported a bug on last weekend...This bug can be easily reproduced by sending continuous small chunks data. If we use pb or amp and send any data whose size can't fit the buffer (128K),
iocp reactor will raise a ERROR_IO_PENDING. and close the connection immediately. It looks like many write events are triggered instead of one.
two ways to work around:
1: increase the buffer limit.
2: don't try to send chunks data in a very short period...
after years development, iocp has been improved but not enough...comparing with other reactors like epoll,,,it is still experimental.
update: I have solved this bug. patch will be submitted soon.
This bug actually was triggered when SEND_LIMIT is reaching. IOCP may re schedule the writing operation which will lead to doWrite is called twice for the same data. When PB is unable to deserialize these bytes, it will simply close the connection and raise an exception.
What we need to do is to make sure doWrite being invoked in order. When the callback isn't invoked, we shouldn't call doWrite again.
I introduced an variable to solve this bug. now the test pass.
发表评论
-
static building lxml
2014-08-13 19:15 758well it is not really straig ... -
build pyrun/python from source
2014-08-01 19:39 539quite easy on ubuntu. 1: ... -
build apsw manually
2014-01-06 01:22 507download sqlite sources and co ... -
python, vs 2010 & manifest problem
2013-11-02 13:33 587It looks like python com ... -
numpy 1.7.0 fails with cx_freeze 4.3.1
2013-02-24 16:13 825It is a work around: find ... -
build psycopg2 on windows with mingw64
2013-01-03 20:36 932caution: version match problem. ... -
Determining if a point lies on the interior of a polygon
2012-09-25 02:23 653link: http://paulbourke.net/geo ... -
pypy的一个测试
2012-06-09 16:15 1574pypy-1.9 昨天已经发布,据称性能又有所提高。 ... -
a naive way to use dictcursor of psycopg2 with twisted adbapi
2012-05-03 03:14 1119make a new file called fakedb.p ... -
build psycopg2 on windows with vs
2012-05-02 02:16 832prerequisites: 1: postgresq ... -
One way to speed up Pb invoke.
2012-03-14 21:31 810Pb (stands for Perspecti ... -
change buffer size in order to send chunks data in ampoule
2011-12-03 16:08 763ampoule use name pipe to commun ... -
which one is thread safe?
2011-09-21 12:31 875quote: It's not so much tha ... -
cython的另类用途
2011-08-04 02:30 1515都知道py虽然方便但是却有个不是问题的问题:就是发布时的二进制 ... -
instructions for installing some python's pkgs on ubuntu
2011-07-23 00:54 755make sure python-dev, gcc and o ... -
a tedious way to build the latest pytables
2011-07-17 03:33 688pyTables is a great product. It ... -
再谈twisted
2011-06-29 17:03 1399现在我手头用的是11.0。 很好。没什么很大的问题,原来的版本 ... -
cython的效果
2011-06-29 00:29 769我有个用py写的 crc-ccitt的验证程序(实现效率并不高 ... -
the simplest way to use vs 2010 with python
2011-06-03 15:48 636edit py/Lib/distutils/msvc9comp ... -
speeding up python
2011-06-03 15:36 842python确实是十分慢的语 ...
相关推荐
python3.6 爬虫 window 直接命令行安装 Twisted-17.5.0-cp36-cp36m-win32.whl python3.6 爬虫 window 直接命令行安装 Twisted-17.5.0-cp36-cp36m-win32.whl python3.6 爬虫 window 直接命令行安装 Twisted-17.5.0-...
Twisted python3.5 Twisted python3.5 Twisted python3.5 Twisted python3.5 Twisted python3.5 Twisted-17.9.0-cp35-cp35m-win_amd64.whl Twisted-17.9.0-cp35-cp35m-win_amd64.whl Twisted-17.9.0-cp35-cp35m-win_...
anaconda python3.7 twisted安装包Twisted-19.7.0-cp37-cp37m-win_amd64.whl
解决Python3.6中安装y一些包时出现错误:error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools":...在包的放置路径下,执行pip install Twisted-18.9.0-cp36-cp36m-win32.whl
Twisted-19.2.1-cp27-cp27m-win_amd64.whl,用于不想下载VC++14运行库,pipi install Twisted-19.2.1-cp27-cp27m-win_amd64.whl 直接安装
Twisted-18.4.0-cp36-cp36m-win_amd64.whl 1.pip 安装scrapy报错: building 'twisted.test.raiser' extension error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": ...
python爬虫scrapy模块安装之前的必备模块Twisted-17.1.0-cp35-cp35m-win32.whl,此版本对应的是Twisted-17.1.0、python3.5、win32位 系统。
Twisted- python3.7 Twisted-19.2.1-cp37-cp37m-win_amd64.whl
python爬虫scrapy模块安装之前的必备模块Twisted-17.5.0-cp36-cp36m-win_amd64.whl,此版本对应的是Twisted-17.5.0、python3.6、win64位 系统。
Twisted-19.2.1-cp35-cp35m-win_amd64.whl,用于不想下载VC++14运行库,pipi install Twisted-19.2.1-cp35-cp35m-win_amd64.whl 直接安装
Twisted-18.7.0-cp37-cp37m-win_amd64.whl: window64位
building 'twisted.test.raiser' extension error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools
Twisted-17.9.0-cp36-cp36m-win32.whl Twisted-17.9.0-cp36-cp36m-win32.whl
python爬虫scrapy模块安装之前的必备模块Twisted-16.5.0-cp36-cp36m-win32.whl,此版本对应的是Twisted-16.5.0、python3.6、win32位 系统。
Python工具类 Twisted-19.2.1-cp37-cp37m-win_amd64.whl Twisted-19.2.0-cp27-cp27m-win_amd64.whl
Twisted-10.1.0.winxp32-py2.6
Twisted-19.2.0-cp37-cp37m-win_amd64.whl,用于不想下载VC++14运行库,pipi install Twisted-19.2.0-cp37-cp37m-win_amd64.whl 直接安装
Twisted-18.7.0-cp36-cp36m-win_amd64.whl Scrapy安装Microsoft Visual C++ 14.0 is required
Twisted-17.9.0-cp27-cp27m-win_amd64.whl
安装scrapy前必须先装Twisted,否则可能报错,类似Failed building wheel for Twisted