日志架构（五）WWW的日志采集和展望

确定的方案
统一由前端发送日志到日志中心服务器
确定后端传递到前端的参数格式，参数名要求和日志规范中严格一致；
发送请求的时候，可以设置cookie参数和head参数
发送格式举例:http://analytics.xxxx.com/__utm.gif?a=11&b=222&c=333
公共参数需要写在JS组件中，例如版本信息，时间戳等
参数，统一要有前缀（utm，方便与GA之间的兼容），统一使用简写
开发一个公共的HTML隐藏域，风转参数request.setAttribute有统一的前缀，由日志架构提供统一的组件
1次的页面请求，后端的多次forward只向前传递一条日志，按照一次用户行为计算
WWW/WAP的日志头是可以共用的
公共参数选取几个定义试用：版本，时间戳

遗留问题
安全问题，如何防范其他人的攻击（一定程度上的改进，多一些判断）
前端和后端方案，仍需深入对比；

    本系统采取后端生产日志数据，前端统一发送http跨域请求的形式进行设计。这样的优点非常明显，如下表（此表仅分析WWW的日志架构）：


其他搜索引擎公司行为分析
关键词：奥运会
均为一次请求
其中百度，必应，雅虎，谷歌类似，是一次写入日志
搜狗，即刻均是多次写日志

下面是具体数据

谷歌
www.google.com
http://www.google.com.hk/search?hl=zh-CN&newwindow=1&safe=strict&q=%E5%A5%A5%E8%BF%90%E4%BC%9A&oq=%E5%A5%A5%E8%BF%90%E4%BC%9A&aq=f&aqi=&aql=&gs_l=serp.12...0.0.0.145950.0.0.0.0.0.0.0.0..0.0...0.0..0.1It9Nj6T3tM&bav=on.2,or.r_gc.r_pw.&fp=3c40fc4e2ccc0cd3&biw=1280&bih=427&tch=5&ech=1&psi=7fEqUKeYDMeViAeewoDoCw.1344991726606.5

http://www.google.com.hk/csi?v=3&s=web&action=&ei=jfIqUNHKCai9iAfvgoDgDA&e=17259,24472,37102,39523,39976,40094,4000036,4000054,4000108,4000110,4000115,4000126,4000179,4000242,4000276&cr=n&imp=0&pfa=n.1,ttfc.157,ttlc.0,cbt.193&pfm=n.1,ttfc.157,ttlc.0,cbt.193&imn=11&rt=prt.268,pprt.269,ol.269,jsrt.99,iml.269

百度
www.baidu.com
http://sclick.baidu.com/w.gif?q=%B0%C2%D4%CB%BB%E1&fm=se&T=1344945147&y=EF5E5EDF&rsv_pt=&rsv_ua=Mozilla/5.0%20(Windows;%20U;%20Windows%20NT%206.1;%20zh-CN;%20rv~1.9.2.28)%20Gecko/20120306%20Firefox/3.6.28&rsv_sid=1289_1328_1267_1229_1186_1279_1179_1286_1319_1295_1332&cid=0&qid=fa23fe3d15408a2d&t=1344945150348&path=http://www.baidu.com/s?wd=%B0%C2%D4%CB%BB%E1&rsv_bp=0&rsv_spt=3&inputT=14437

人民搜索（即刻）
www.jike.com
http://logs.jike.com/se.gif?t=0&bt=firefox&sid=b9b09f0f6d5df0e83271e5ecb2b12df9&u=http%3A%2F%2Fwww.jike.com%2Fso%3Fq%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A&r=http%3A%2F%2Fwww.jike.com%2F&bv=3.6.28&ot=Windows7&dp=1280*800&bid=e9604084fcc9b9bb329868b8af5385a4&pre_bid=62fb22a4789cffc9b52cd235e788e0a2&qs=&req_bid=-4229112065218892549&temp=1344945378984&uargs=q%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A

http://logs.jike.com/c.gif?t=0&u=http%3A%2F%2Fwww.jike.com%2Fso%3Fq%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A&clu=null&qs=load&bid=15a901acb23bbd45aeff43a82e68f2a5&pre_bid=e9604084fcc9b9bb329868b8af5385a4&co=0&temp=1344945380499&uargs=q%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A


http://logs.jike.com/c.gif?t=0&u=http%3A%2F%2Fwww.jike.com%2Fso%3Fq%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A&clu=null&qs=load&bid=76c7930b1a3b0b737c5c5a2f773b4d22&pre_bid=e9604084fcc9b9bb329868b8af5385a4&co=1&temp=1344945380692&uargs=q%3D%25E5%25A5%25A5%25E8%25BF%2590%25E4%25BC%259A

搜狗
www.sogou.com
http://pb.sogou.com/pv.gif?uigs_productid=webapp&type=tmon&uuid=36119e02-bed8-417d-96ab-f3cb5726396a&loc=CN1100&abtestid=0&query=%25B0%25C2%25D4%25CB%25BB%25E1&eg=1&cost=29&idc=djt&h_s=1344946163460&h_e=1344946163563&b_e=1344946164697&a_e=1344946164754&w_l=1344946165179&u_c=1344946163337

http://pb.sogou.com/pv.gif?uigs_productid=webapp&uigs_t=1344946165658&type=quan_show_monitor&uigs_pbtag=A&uigs_cookie=SUID%2Csct&abtestid=0&query=%25B0%25C2%25D4%25CB%25BB%25E1&rn=9474959&stype=0&htn=9&qcn=0&hbn=0&uuid=36119e02-bed8-417d-96ab-f3cb5726396a&vr=20104003_0-20104602_1-20009904_2-10000103_3-null_4-30000501_5-null_6-30001005_7-null_8-null_9&sm=d1_0-d1_1-d1_2-d1_3-a1c2d0_4-a6d0_5-a2c1d0_6-a5c3b8d0_7-a3b1d0_8-a4b4d0_9&msrc=sm&loc=CN1100&adn=0&adltbn=0&adltan=0&qflag=0&warnLevel=127&eg=1&cost=29&bl=-1_127_0_0&scrnwi=1280&scrnhi=800&pid=sogou&rw=&idc=djt&jhly=top&inttab=61_0-33_1-43_2-37_3-41_4-40_5-28_6-39_7-62_8-&intcat=web&jhshuxing=0&jhhint=1&legalad=1&uigs_uuid=1344946164702404&uigs_refer=http%3A%2F%2Fwww.sogou.com%2F&pos=3&qtype=shop_sv_fail&uigs_st=907&qv=&subtype=unknown&qtl=null_0-null_1-null_2-null_3

http://pb.sogou.com/pv.gif?uigs_productid=web&uigs_t=1344946164702468&uigs_cookie=SUID%3D287BCF7C62890E0A00000000ADB4474D%26sct%3D1&uigs_uuid=1344946164702404&uigs_pbtag=A&abtestid=0&query=%25B0%25C2%25D4%25CB%25BB%25E1&rn=9474959&stype=0&htn=9&qcn=0&hbn=0&uuid=36119e02-bed8-417d-96ab-f3cb5726396a&vr=20104003_0-20104602_1-20009904_2-10000103_3-null_4-30000501_5-null_6-30001005_7-null_8-null_9&sm=d1_0-d1_1-d1_2-d1_3-a1c2d0_4-a6d0_5-a2c1d0_6-a5c3b8d0_7-a3b1d0_8-a4b4d0_9&msrc=sm&loc=CN1100&adn=0&adltbn=0&adltan=0&qflag=0&qtype=0&warnLevel=127&eg=1&cost=29&bl=-1_127_0_0&scrnwi=1280&scrnhi=800&pid=sogou&rw=&idc=djt&jhly=top&inttab=61_0-33_1-43_2-37_3-41_4-40_5-28_6-39_7-62_8-&intcat=web&jhshuxing=0&jhhint=1&legalad=1&uigs_version=v1.1&uigs_refer=http%3A%2F%2Fwww.sogou.com%2F

http://pv.sogou.com/pv.gif?uuid=36119e02-bed8-417d-96ab-f3cb5726396a?t=1344946164700980?r?=http://www.sogou.com/


必应(bing)
cn.bing.com
http://cn.bing.com/fd/ls/l?IG=e1ba4d42b6124c63a0a05e7dc5a46c8e&Type=Event.CPT&DATA={%22pp%22:{%22S%22:%22L%22,%22PC%22:588,%22FC%22:595,%22BC%22:596,%22BS%22:694,%22H%22:717,%22FE%22:-1,%22LE%22:-1,%22C1%22:-1,%22C2%22:-1,%22BP%22:2030,%22KP%22:661,%22CT%22:2071,%22IL%22:27}}&P=SERP&DA=Bj1

雅虎
www.yahoo.cn
http://click.s.aliyun.com/0.gif?v=100102&c=e0bf379b2d5c44ef3eaf148687d261e4&pt=web&ip=124.192.129.4&q=%E5%A5%A5%E8%BF%90%E4%BC%9A&pg=1&qt=1344946496&hid=b7439ab980054b16b6973d6bd38cd498&ads=google&l=2&id=20123&oq=%E5%A5%A5%E8%BF%90%E4%BC%9A&bs=&from=searchbox&sc=olympic:1,news:2&vr=1&t=1344946498949

展望
JAR包不重启升级
日志中心UI
日志中心备份机制