Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
逝缘~
Rocketmq
提交
da73a1d1
R
Rocketmq
项目概览
逝缘~
/
Rocketmq
与 Fork 源项目一致
Fork自
Apache RocketMQ / Rocketmq
通知
1
Star
0
Fork
0
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
Issue
0
列表
看板
标记
里程碑
合并请求
0
DevOps
流水线
流水线任务
计划
Wiki
0
Wiki
分析
仓库
DevOps
项目成员
Pages
R
Rocketmq
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Issue
0
Issue
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
Pages
DevOps
DevOps
流水线
流水线任务
计划
分析
分析
仓库分析
DevOps
Wiki
0
Wiki
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
创建新Issue
流水线任务
提交
Issue看板
体验新版 GitCode,发现更多精彩内容 >>
提交
da73a1d1
编写于
10月 19, 2018
作者:
S
suiyuzeng
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
log recover issue
上级
a220364b
变更
3
展开全部
隐藏空白更改
内联
并排
Showing
3 changed file
with
288 addition
and
151 deletion
+288
-151
store/src/main/java/org/apache/rocketmq/store/CommitLog.java
store/src/main/java/org/apache/rocketmq/store/CommitLog.java
+102
-90
store/src/main/java/org/apache/rocketmq/store/DefaultMessageStore.java
...n/java/org/apache/rocketmq/store/DefaultMessageStore.java
+68
-61
store/src/test/java/org/apache/rocketmq/store/DefaultMessageStoreTest.java
...va/org/apache/rocketmq/store/DefaultMessageStoreTest.java
+118
-0
未找到文件。
store/src/main/java/org/apache/rocketmq/store/CommitLog.java
浏览文件 @
da73a1d1
此差异已折叠。
点击以展开。
store/src/main/java/org/apache/rocketmq/store/DefaultMessageStore.java
浏览文件 @
da73a1d1
此差异已折叠。
点击以展开。
store/src/test/java/org/apache/rocketmq/store/DefaultMessageStoreTest.java
浏览文件 @
da73a1d1
...
...
@@ -18,9 +18,12 @@
package
org.apache.rocketmq.store
;
import
java.io.File
;
import
java.io.RandomAccessFile
;
import
java.net.InetAddress
;
import
java.net.InetSocketAddress
;
import
java.net.SocketAddress
;
import
java.nio.MappedByteBuffer
;
import
java.nio.channels.FileChannel
;
import
java.nio.channels.OverlappingFileLockException
;
import
java.util.Map
;
import
java.util.concurrent.atomic.AtomicInteger
;
...
...
@@ -29,6 +32,7 @@ import org.apache.rocketmq.common.BrokerConfig;
import
org.apache.rocketmq.common.UtilAll
;
import
org.apache.rocketmq.store.config.FlushDiskType
;
import
org.apache.rocketmq.store.config.MessageStoreConfig
;
import
org.apache.rocketmq.store.config.StorePathConfigHelper
;
import
org.junit.After
;
import
org.apache.rocketmq.store.stats.BrokerStatsManager
;
import
org.junit.Before
;
...
...
@@ -171,6 +175,120 @@ public class DefaultMessageStoreTest {
assertThat
(
getMessageResult45
.
getMessageBufferList
().
size
()).
isEqualTo
(
10
);
}
@Test
public
void
testRecover
()
throws
Exception
{
String
topic
=
"recoverTopic"
;
MessageBody
=
StoreMessage
.
getBytes
();
for
(
int
i
=
0
;
i
<
100
;
i
++)
{
MessageExtBrokerInner
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
}
Thread
.
sleep
(
100
);
//wait for build consumer queue
long
maxPhyOffset
=
messageStore
.
getMaxPhyOffset
();
long
maxCqOffset
=
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
);
//1.just reboot
messageStore
.
shutdown
();
messageStore
=
buildMessageStore
();
boolean
load
=
messageStore
.
load
();
assertTrue
(
load
);
messageStore
.
start
();
assertTrue
(
maxPhyOffset
==
messageStore
.
getMaxPhyOffset
());
assertTrue
(
maxCqOffset
==
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
));
//2.damage commitlog and reboot normal
for
(
int
i
=
0
;
i
<
100
;
i
++)
{
MessageExtBrokerInner
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
}
Thread
.
sleep
(
100
);
long
secondLastPhyOffset
=
messageStore
.
getMaxPhyOffset
();
long
secondLastCqOffset
=
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
);
MessageExtBrokerInner
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
messageStore
.
shutdown
();
//damage last message
damageCommitlog
(
secondLastPhyOffset
);
//reboot
messageStore
=
buildMessageStore
();
load
=
messageStore
.
load
();
assertTrue
(
load
);
messageStore
.
start
();
assertTrue
(
secondLastPhyOffset
==
messageStore
.
getMaxPhyOffset
());
assertTrue
(
secondLastCqOffset
==
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
));
//3.damage commitlog and reboot abnormal
for
(
int
i
=
0
;
i
<
100
;
i
++)
{
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
}
Thread
.
sleep
(
100
);
secondLastPhyOffset
=
messageStore
.
getMaxPhyOffset
();
secondLastCqOffset
=
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
);
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
messageStore
.
shutdown
();
//damage last message
damageCommitlog
(
secondLastPhyOffset
);
//add abort file
String
fileName
=
StorePathConfigHelper
.
getAbortFile
(((
DefaultMessageStore
)
messageStore
).
getMessageStoreConfig
().
getStorePathRootDir
());
File
file
=
new
File
(
fileName
);
MappedFile
.
ensureDirOK
(
file
.
getParent
());
file
.
createNewFile
();
messageStore
=
buildMessageStore
();
load
=
messageStore
.
load
();
assertTrue
(
load
);
messageStore
.
start
();
assertTrue
(
secondLastPhyOffset
==
messageStore
.
getMaxPhyOffset
());
assertTrue
(
secondLastCqOffset
==
messageStore
.
getMaxOffsetInQueue
(
topic
,
0
));
//message write again
for
(
int
i
=
0
;
i
<
100
;
i
++)
{
messageExtBrokerInner
=
buildMessage
();
messageExtBrokerInner
.
setTopic
(
topic
);
messageExtBrokerInner
.
setQueueId
(
0
);
messageStore
.
putMessage
(
messageExtBrokerInner
);
}
}
private
void
damageCommitlog
(
long
offset
)
throws
Exception
{
MessageStoreConfig
messageStoreConfig
=
new
MessageStoreConfig
();
File
file
=
new
File
(
messageStoreConfig
.
getStorePathCommitLog
()
+
File
.
separator
+
"00000000000000000000"
);
FileChannel
fileChannel
=
new
RandomAccessFile
(
file
,
"rw"
).
getChannel
();
MappedByteBuffer
mappedByteBuffer
=
fileChannel
.
map
(
FileChannel
.
MapMode
.
READ_WRITE
,
0
,
1024
*
1024
*
10
);
int
bodyLen
=
mappedByteBuffer
.
getInt
((
int
)
offset
+
84
);
int
topicLenIndex
=
(
int
)
offset
+
84
+
bodyLen
+
4
;
mappedByteBuffer
.
position
(
topicLenIndex
);
mappedByteBuffer
.
putInt
(
0
);
mappedByteBuffer
.
putInt
(
0
);
mappedByteBuffer
.
putInt
(
0
);
mappedByteBuffer
.
putInt
(
0
);
mappedByteBuffer
.
force
();
fileChannel
.
force
(
true
);
fileChannel
.
close
();
}
private
class
MyMessageArrivingListener
implements
MessageArrivingListener
{
@Override
public
void
arriving
(
String
topic
,
int
queueId
,
long
logicOffset
,
long
tagsCode
,
long
msgStoreTime
,
...
...
编辑
预览
Markdown
is supported
0%
请重试
或
添加新附件
.
添加附件
取消
You are about to add
0
people
to the discussion. Proceed with caution.
先完成此消息的编辑!
取消
想要评论请
注册
或
登录