Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
梦中观雨
cat
提交
53c758a1
C
cat
项目概览
梦中观雨
/
cat
与 Fork 源项目一致
从无法访问的项目Fork
通知
1
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
C
cat
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
53c758a1
编写于
3月 06, 2012
作者:
S
sean.wang
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
dev...
上级
5b8a62c1
变更
6
显示空白变更内容
内联
并排
Showing
6 changed file
with
54 addition
and
35 deletion
+54
-35
cat-core/src/main/java/com/dianping/cat/message/spi/MessageStorage.java
...ain/java/com/dianping/cat/message/spi/MessageStorage.java
+14
-1
cat-core/src/main/java/com/dianping/cat/message/spi/internal/DefaultMessageStorage.java
...nping/cat/message/spi/internal/DefaultMessageStorage.java
+6
-0
cat-job/src/main/java/com/dianping/cat/job/hdfs/DefaultOutputChannel.java
.../java/com/dianping/cat/job/hdfs/DefaultOutputChannel.java
+1
-0
cat-job/src/main/java/com/dianping/cat/job/hdfs/HdfsMessageStorage.java
...in/java/com/dianping/cat/job/hdfs/HdfsMessageStorage.java
+6
-0
cat-job/src/main/java/com/dianping/cat/job/hdfs/OutputChannel.java
...rc/main/java/com/dianping/cat/job/hdfs/OutputChannel.java
+1
-0
cat-job/src/test/java/com/dianping/cat/job/hdfs/HdfsMessageStorageTest.java
...ava/com/dianping/cat/job/hdfs/HdfsMessageStorageTest.java
+26
-34
未找到文件。
cat-core/src/main/java/com/dianping/cat/message/spi/MessageStorage.java
浏览文件 @
53c758a1
package
com.dianping.cat.message.spi
;
package
com.dianping.cat.message.spi
;
/**
* @author franke.wu
* @author sean.wang
* @since Mar 6, 2012
*/
public
interface
MessageStorage
{
public
interface
MessageStorage
{
/**
/**
* Store a message tree to the storage.
* Store a message tree to the storage.
...
@@ -9,4 +14,12 @@ public interface MessageStorage {
...
@@ -9,4 +14,12 @@ public interface MessageStorage {
* @return relative path to base directory or base URL
* @return relative path to base directory or base URL
*/
*/
public
String
store
(
MessageTree
tree
);
public
String
store
(
MessageTree
tree
);
/**
* Fetch a message tree from the store.
*
* @param messageId
* @return
*/
public
MessageTree
get
(
String
messageId
);
}
}
cat-core/src/main/java/com/dianping/cat/message/spi/internal/DefaultMessageStorage.java
浏览文件 @
53c758a1
...
@@ -132,4 +132,10 @@ public class DefaultMessageStorage implements MessageStorage, Initializable, Dis
...
@@ -132,4 +132,10 @@ public class DefaultMessageStorage implements MessageStorage, Initializable, Dis
m_active
=
false
;
m_active
=
false
;
}
}
}
}
@Override
public
MessageTree
get
(
String
messageId
)
{
// TODO Auto-generated method stub
return
null
;
}
}
}
cat-job/src/main/java/com/dianping/cat/job/hdfs/DefaultOutputChannel.java
浏览文件 @
53c758a1
...
@@ -80,4 +80,5 @@ public class DefaultOutputChannel implements OutputChannel {
...
@@ -80,4 +80,5 @@ public class DefaultOutputChannel implements OutputChannel {
return
true
;
return
true
;
}
}
}
}
cat-job/src/main/java/com/dianping/cat/job/hdfs/HdfsMessageStorage.java
浏览文件 @
53c758a1
...
@@ -138,4 +138,10 @@ public class HdfsMessageStorage implements MessageStorage, Initializable, Dispos
...
@@ -138,4 +138,10 @@ public class HdfsMessageStorage implements MessageStorage, Initializable, Dispos
}
}
}
}
}
}
@Override
public
MessageTree
get
(
String
messageId
)
{
// TODO Auto-generated method stub
return
null
;
}
}
}
cat-job/src/main/java/com/dianping/cat/job/hdfs/OutputChannel.java
浏览文件 @
53c758a1
...
@@ -33,4 +33,5 @@ public interface OutputChannel {
...
@@ -33,4 +33,5 @@ public interface OutputChannel {
* @throws IOException
* @throws IOException
*/
*/
public
boolean
write
(
MessageTree
tree
)
throws
IOException
;
public
boolean
write
(
MessageTree
tree
)
throws
IOException
;
}
}
cat-job/src/test/java/com/dianping/cat/job/hdfs/HdfsMessageStorageTest.java
浏览文件 @
53c758a1
package
com.dianping.cat.job.hdfs
;
package
com.dianping.cat.job.hdfs
;
import
junit.framework.Assert
;
import
org.junit.Test
;
import
org.junit.Test
;
import
org.junit.runner.RunWith
;
import
org.junit.runner.RunWith
;
import
org.junit.runners.JUnit4
;
import
org.junit.runners.JUnit4
;
import
com.dianping.cat.job.hdfs.HdfsMessageStorage
;
import
com.dianping.cat.message.Message
;
import
com.dianping.cat.message.MessageProducer
;
import
com.dianping.cat.message.Transaction
;
import
com.dianping.cat.message.Transaction
;
import
com.dianping.cat.message.io.InMemoryQueue
;
import
com.dianping.cat.message.internal.DefaultTransaction
;
import
com.dianping.cat.message.spi.MessageManager
;
import
com.dianping.cat.message.spi.MessageStorage
;
import
com.dianping.cat.message.spi.MessageStorage
;
import
com.dianping.cat.message.spi.MessageTree
;
import
com.dianping.cat.message.spi.MessageTree
;
import
com.dianping.cat.message.spi.internal.DefaultMessageTree
;
@RunWith
(
JUnit4
.
class
)
@RunWith
(
JUnit4
.
class
)
public
class
HdfsMessageStorageTest
extends
CatTestCase
{
public
class
HdfsMessageStorageTest
extends
CatTestCase
{
private
DefaultMessageTree
newMessageTree
(
String
id
)
{
DefaultMessageTree
tree
=
new
DefaultMessageTree
();
tree
.
setDomain
(
"domain"
);
tree
.
setHostName
(
"hostName"
);
tree
.
setIpAddress
(
"ipAddress"
);
tree
.
setMessageId
(
id
);
tree
.
setParentMessageId
(
"parentMessageId"
);
tree
.
setRootMessageId
(
"rootMessageId"
);
tree
.
setSessionToken
(
"sessionToken"
);
tree
.
setThreadId
(
"threadId"
);
tree
.
setThreadName
(
"threadName"
);
return
tree
;
}
@Test
@Test
public
void
test
()
throws
Exception
{
public
void
test
()
throws
Exception
{
MessageStorage
storage
=
lookup
(
MessageStorage
.
class
,
"hdfs"
);
MessageStorage
storage
=
lookup
(
MessageStorage
.
class
,
"hdfs"
);
MessageProducer
producer
=
lookup
(
MessageProducer
.
class
);
MessageManager
manager
=
lookup
(
MessageManager
.
class
);
InMemoryQueue
queue
=
lookup
(
InMemoryQueue
.
class
);
MessageTree
tree
=
newMessageTree
(
"abcdef"
);
Transaction
t
=
new
DefaultTransaction
(
"t"
,
"n"
,
manager
);
for
(
int
i
=
0
;
i
<
10000
;
i
++)
{
tree
.
setMessage
(
t
);
Transaction
t
=
producer
.
newTransaction
(
"URL"
,
"MyPage"
+
(
int
)
(
i
/
500
));
try
{
// do your business here
t
.
addData
(
"k1"
,
"v1"
);
t
.
addData
(
"k2"
,
"v2"
);
t
.
addData
(
"k3"
,
"v3"
);
Thread
.
sleep
(
1
);
producer
.
logEvent
(
"URL"
,
"Payload"
,
Message
.
SUCCESS
,
"host=my-host&ip=127.0.0.1&agent=..."
);
producer
.
logEvent
(
"URL"
,
"Payload"
,
Message
.
SUCCESS
,
"host=my-host&ip=127.0.0.1&agent=..."
);
producer
.
logEvent
(
"URL"
,
"Payload"
,
Message
.
SUCCESS
,
"host=my-host&ip=127.0.0.1&agent=..."
);
producer
.
logEvent
(
"URL"
,
"Payload"
,
Message
.
SUCCESS
,
"host=my-host&ip=127.0.0.1&agent=..."
);
t
.
setStatus
(
Message
.
SUCCESS
);
}
catch
(
Exception
e
)
{
t
.
setStatus
(
e
);
}
finally
{
t
.
complete
();
}
MessageTree
tree
=
queue
.
poll
(
0
);
storage
.
store
(
tree
);
storage
.
store
(
tree
);
}
MessageTree
actual
=
storage
.
get
(
tree
.
getMessageId
());
Assert
.
assertTrue
(
tree
.
equals
(
actual
));
((
HdfsMessageStorage
)
storage
).
dispose
();
((
HdfsMessageStorage
)
storage
).
dispose
();
}
}
}
}
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录