注册 登录  
 加关注
   显示下一条  |  关闭
温馨提示!由于新浪微博认证机制调整,您的新浪微博帐号绑定已过期,请重新绑定!立即重新绑定新浪微博》  |  关闭

阿弥陀佛

街树飘影未见尘 潭月潜水了无声 般若观照心空静...

 
 
 

日志

 
 
关于我

一直从事气象预报、服务建模实践应用。 注重气象物理场、实况场、地理信息、本体知识库、分布式气象内容管理系统建立。 对Barnes客观分析, 小波,计算神经网络、信任传播、贝叶斯推理、专家系统、网络本体语言有一定体会。 一直使用Java、Delphi、Prolog、SQL编程。

网易考拉推荐

RAMADDA uploding multi-files  

2012-11-13 21:03:58|  分类: Ramadda |  标签: |举报 |字号 订阅

  下载LOFTER 我的照片书  |
Mr He,

- 隐藏引用文字 -

When you are publishing content to your RAMADDA servers  how many simultaneous clients are you running? 
Thare are 3 simultaneous clients running every hours.
one for station point datas ,time series station
point datas in csv format;
one for 2 dim grid datas (element analysis, ontology
analysis) in nc formart, and gif images.
one for 3 dim
images based on DEM data.

How many entries are you creating per hour per RAMADDA?
There are at lest 3000 file upload to 260 RAMADDA instances. I plan recording the working state in 3 csv logs, after finished the work, I will sending it to you.    
Do you execute the client from a script with the command line with the -file argument?
Or do you create an entries.xml file and create a number of entries at a time
Uploading work is finished by my colleague, I`ll tell her the idea.



I can see how things could get hung up with that kind of load. For the time out what would you like to see? We can add a -timeout argument that results in the client exiting if the login takes longer than the time out.

The client is set up do do multiple file uploads at one time. Just do multiple -file ... -file arguments.  But, I will add a -files argument to the client so it will be something like:

client -files <parent entry id> <any number of files>

-Jeff

Every time the client is called it hits the server 3 times - it asks for server information, it logs in and then it uploads the file.

I have just added a -files argument to the client. It is invoked with:
repositoryclient .... -files <parent id> <any number of files>

This will reduce the overhead of accessing and logging in to the server each call.

I have also added a -timeout argument:
.... -timeout <timeout in seconds>

This is used on the server info request and the login request. If the timeout is reached before the request returns the client will print an error message and exit.

-Jeff
  评论这张
 
阅读(772)| 评论(0)
推荐 转载

历史上的今天

在LOFTER的更多文章

评论

<#--最新日志,群博日志--> <#--推荐日志--> <#--引用记录--> <#--博主推荐--> <#--随机阅读--> <#--首页推荐--> <#--历史上的今天--> <#--被推荐日志--> <#--上一篇,下一篇--> <#-- 热度 --> <#-- 网易新闻广告 --> <#--右边模块结构--> <#--评论模块结构--> <#--引用模块结构--> <#--博主发起的投票-->
 
 
 
 
 
 
 
 
 
 
 
 
 
 

页脚

网易公司版权所有 ©1997-2017