Skip to content
体验新版
项目
组织
正在加载...
登录
切换导航
打开侧边栏
oceanbase
miniob
提交
c7ecaace
M
miniob
项目概览
oceanbase
/
miniob
1 年多 前同步成功
通知
74
Star
1521
Fork
537
代码
文件
提交
分支
Tags
贡献者
分支图
Diff
分析
仓库
DevOps
项目成员
Pages
M
miniob
项目概览
项目概览
详情
发布
仓库
仓库
文件
提交
分支
标签
贡献者
分支图
比较
Pages
分析
分析
仓库分析
DevOps
成员
成员
收起侧边栏
关闭侧边栏
动态
分支图
提交
未验证
提交
c7ecaace
编写于
10月 17, 2022
作者:
羽飞
提交者:
GitHub
10月 17, 2022
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
2022 oceanbase miniob competition (#104)
2022 oceanbase competition
上级
d63a39f5
变更
30
隐藏空白更改
内联
并排
Showing
30 changed file
with
1905 addition
and
94 deletion
+1905
-94
README.md
README.md
+24
-39
deps/common/lang/defer.h
deps/common/lang/defer.h
+5
-2
src/observer/rc.cpp
src/observer/rc.cpp
+16
-0
src/observer/rc.h
src/observer/rc.h
+40
-0
src/observer/sql/executor/execute_stage.cpp
src/observer/sql/executor/execute_stage.cpp
+134
-4
src/observer/sql/executor/execute_stage.h
src/observer/sql/executor/execute_stage.h
+3
-0
src/observer/sql/operator/delete_operator.cpp
src/observer/sql/operator/delete_operator.cpp
+2
-1
src/observer/sql/operator/delete_operator.h
src/observer/sql/operator/delete_operator.h
+4
-2
src/observer/sql/parser/parse.cpp
src/observer/sql/parser/parse.cpp
+1
-0
src/observer/sql/parser/parse_defs.h
src/observer/sql/parser/parse_defs.h
+1
-0
src/observer/storage/clog/clog.cpp
src/observer/storage/clog/clog.cpp
+466
-0
src/observer/storage/clog/clog.h
src/observer/storage/clog/clog.h
+263
-0
src/observer/storage/common/condition_filter.cpp
src/observer/storage/common/condition_filter.cpp
+3
-1
src/observer/storage/common/db.cpp
src/observer/storage/common/db.cpp
+82
-2
src/observer/storage/common/db.h
src/observer/storage/common/db.h
+6
-0
src/observer/storage/common/table.cpp
src/observer/storage/common/table.cpp
+70
-15
src/observer/storage/common/table.h
src/observer/storage/common/table.h
+12
-4
src/observer/storage/default/default_handler.cpp
src/observer/storage/default/default_handler.cpp
+4
-0
src/observer/storage/default/disk_buffer_pool.cpp
src/observer/storage/default/disk_buffer_pool.cpp
+18
-2
src/observer/storage/default/disk_buffer_pool.h
src/observer/storage/default/disk_buffer_pool.h
+5
-0
src/observer/storage/index/bplus_tree.cpp
src/observer/storage/index/bplus_tree.cpp
+14
-14
src/observer/storage/persist/persist.cpp
src/observer/storage/persist/persist.cpp
+280
-0
src/observer/storage/persist/persist.h
src/observer/storage/persist/persist.h
+68
-0
src/observer/storage/record/record_manager.cpp
src/observer/storage/record/record_manager.cpp
+70
-1
src/observer/storage/record/record_manager.h
src/observer/storage/record/record_manager.h
+3
-0
src/observer/storage/trx/trx.cpp
src/observer/storage/trx/trx.cpp
+27
-7
src/observer/storage/trx/trx.h
src/observer/storage/trx/trx.h
+8
-0
test/case/test/.primary-update.test.swp
test/case/test/.primary-update.test.swp
+0
-0
unitest/clog_test.cpp
unitest/clog_test.cpp
+129
-0
unitest/persist_test.cpp
unitest/persist_test.cpp
+147
-0
未找到文件。
README.md
浏览文件 @
c7ecaace
# Introduction
miniob 是 OceanBase与华中科技大学联合开发的、面向"零"基础数据库内核知识同学的一门数据库实现入门教程实践工具。
miniob设计的目标是让不熟悉数据库设计和实现的同学能够快速的了解与深入学习数据库内核,期望通过相关训练之后,能够对各个数据库内核模块的功能与它们之间的关联有所了解,并能够在
使用数据库时,设计出高效的SQL。面向的对象主要是在校学生,并且诸多模块做了简化,比如不考虑并发操作。
注意:此代码仅供学习使用,不考虑任何安全特性。
# 介绍
miniob 是 OceanBase 与华中科技大学联合开发的、面向"零"基础同学的数据库入门实践工具。
miniob 设计的目标是让同学们快速了解数据库并深入学习数据库内核,期望通过相关训练之后,能够对数据库内核各个模块的功能及其关联有所了解,并能够在
使用数据库时,设计出高效的 SQL 。miniob 面向的对象主要是在校学生,并且诸多模块都做了简化,比如不考虑并发操作。
[
GitHub 首页
](
https://github.com/oceanbase/miniob
)
# 如何开发
## 搭建开发环境
有多种方式搭建开发环境,可以直接在本地安装一些三方依赖,或者使用Docker。如果使用的是Windows,我们建议使用Docker来开发。
### 搭建本地开发环境
直接在本地搭建开发环境,可以参考
[
how_to_build
](
docs/how_to_build.md
)
。
### 使用Docker开发
请参考
[
如何使用Docker开发MiniOB
](
docs/how-to-dev-using-docker.md
)
(注意:此代码仅供学习使用,不考虑任何安全特性。)
### Windows上开发MiniOB
[
如何在Windows上使用Docker开发miniob
](
docs/how_to_dev_miniob_by_docker_on_windows.md
)
## 词法语法解析开发环境
如果已经在处理一些SQL词法语法解析相关的问题,请参考
[
MiniOB 词法语法解析开发与测试
](
docs/miniob-sql-parser.md
)
。
Docker 环境已经预安装了相关的组件。
# 数据库管理系统实现基础讲义
由华中科技大学谢美意和左琼老师联合编撰数据库管理系统实现教材。参考
[
数据库管理系统实现基础讲义
](
docs/lectures/index.md
)
[
GitHub 首页
](
https://github.com/oceanbase/miniob
)
#
miniob 介绍
[
miniob
代码架构框架设计和说明
](
docs/miniob-introduction.md
)
#
1. 题目说明
[
miniob
题目描述
](
docs/miniob_topics.md
)
# miniob 训练
我们为MiniOB设计了配套的训练题目,大家可以在
[
MiniOB 训练营
](
https://open.oceanbase.com/train?questionId=200001
)
上进行提交测试。
# 2. 开发指南
## 搭建开发环境
1.
[
本地配置gcc环境
](
docs/how_to_build.md
)
。
2.
[
使用Docker开发
](
docs/how-to-dev-using-docker.md
)
。
3.
[
在Windows上使用Docker
](
docs/how_to_dev_miniob_by_docker_on_windows.md
)
。
[
miniob 题目描述
](
docs/miniob_topics.md
)
## 词法、语法解析
请参考
[
miniob 词法语法解析开发与测试
](
docs/miniob-sql-parser.md
)
。
为了满足训练营或比赛测试要求,代码的输出需要满足一定要求,请参考
[
MiniOB 输出约定
](
docs/miniob-output-convention.md
)
。一般情况下,不需要专门来看这篇文档,但是如果你的测试总是不正确,建议对照一下输出约定。
# 3. 提交测试
题目完成并通过自测后,大家可以在
[
miniob 训练营
](
https://open.oceanbase.com/train?questionId=200001
)
上提交代码进行测试。
# miniob 实现解析
客户端输出需要满足一定要求,如果你的测试结果不符合预期,请参考
[
miniob 输出约定
](
docs/miniob-output-convention.md
)
。
[
miniob-date 实现解析
](
https://oceanbase-partner.github.io/lectures-on-dbms-implementation/miniob-date-implementation.html
)
# 4. 数据库管理系统实现基础讲义
由华中科技大学谢美意和左琼老师联合编撰的数据库管理系统实现教材:
[
《数据库管理系统实现基础讲义》
](
docs/lectures/index.md
)
[
miniob drop-table 实现解析
](
https://oceanbase-partner.github.io/lectures-on-dbms-implementation/miniob-drop-table-implementation.html
)
# 5. miniob 介绍
[
miniob 源码解析视频
](
https://open.oceanbase.com/activities/4921877
)
[
miniob
select-tables 实现解析
](
https://oceanbase-partner.github.io/lectures-on-dbms-implementation/miniob-select-tables-implementation.html
)
[
miniob
源码解析文档
](
https://www.oceanbase.com/docs/community-developer-quickstart-10000000000627363
)
[
miniob 调试篇
](
https://oceanbase-partner.github.io/lectures-on-dbms-implementation/miniob-how-to-debug.html
)
(资料持续整理中,请大家自行查阅标题为“MiniOB...”的视频或文档)
deps/common/lang/defer.h
浏览文件 @
c7ecaace
...
...
@@ -37,5 +37,8 @@ private:
}
// namespace common
#define DERFER_NAME(suffix) defer_helper_##suffix
#define DEFER(callback) common::DeferHelper DERFER_NAME(__LINE__)(callback)
#define AA(B, C) B##C
#define BB(B, C) AA(B,C)
#define DEFER(callback) common::DeferHelper BB(defer_helper_, __LINE__)(callback)
src/observer/rc.cpp
浏览文件 @
c7ecaace
...
...
@@ -53,6 +53,7 @@ const char *strrc(RC rc)
RC_CASE_STRING
(
FORMAT
);
RC_CASE_STRING
(
RANGE
);
RC_CASE_STRING
(
NOTADB
);
RC_CASE_STRING
(
LOGBUF
);
RC_CASE_STRING
(
NOTICE
);
RC_CASE_STRING
(
BUFFERPOOL_EXIST
);
...
...
@@ -174,8 +175,23 @@ const char *strrc(RC rc)
RC_CASE_STRING
(
NOTICE_RECOVER_ROLLBACK
);
RC_CASE_STRING
(
NOTICE_AUTOINDEX
);
RC_CASE_STRING
(
FILE_EXIST
);
RC_CASE_STRING
(
FILE_NOT_EXIST
);
RC_CASE_STRING
(
FILE_NAME
);
RC_CASE_STRING
(
FILE_BOUND
);
RC_CASE_STRING
(
FILE_CREATE
);
RC_CASE_STRING
(
FILE_OPEN
);
RC_CASE_STRING
(
FILE_NOT_OPENED
);
RC_CASE_STRING
(
FILE_CLOSE
);
RC_CASE_STRING
(
FILE_REMOVE
);
RC_CASE_STRING
(
FILE_SEEK
);
RC_CASE_STRING
(
FILE_READ
);
RC_CASE_STRING
(
FILE_WRITE
);
RC_CASE_STRING
(
AUTH_USER
);
RC_CASE_STRING
(
LOGBUF_FULL
);
RC_CASE_STRING
(
LOGBUF_EMPTY
);
default:
{
return
"UNKNOWN"
;
}
...
...
src/observer/rc.h
浏览文件 @
c7ecaace
...
...
@@ -166,6 +166,26 @@ enum RCAuth {
USER
=
1
,
};
enum
RCFILE
{
F_EXIST
=
1
,
F_NOT_EXIST
,
F_NAME
,
F_BOUND
,
F_CREATE
,
F_OPEN
,
F_NOT_OPENED
,
F_CLOSE
,
F_REMOVE
,
F_SEEK
,
F_READ
,
F_WRITE
,
};
enum
RCLOGBUF
{
LB_FULL
=
1
,
LB_EMPTY
,
};
enum
RC
{
SUCCESS
=
0
,
/* Successful result */
...
...
@@ -201,6 +221,8 @@ enum RC {
FORMAT
,
/* Not used */
RANGE
,
/* 2nd parameter to bind out of range */
NOTADB
,
/* File opened that is not a database file */
FILE_ERROR
,
/* File error */
LOGBUF
,
/* clog buffer error */
NOTICE
=
100
,
/* Notifications from log() */
/* buffer pool part */
...
...
@@ -337,8 +359,26 @@ enum RC {
NOTICE_RECOVER_ROLLBACK
=
(
NOTICE
|
(
RCNotice
::
RECOVER_ROLLBACK
<<
8
)),
NOTICE_AUTOINDEX
=
(
NOTICE
|
(
RCNotice
::
AUTOINDEX
<<
8
)),
/* file part */
FILE_EXIST
=
(
FILE_ERROR
|
(
RCFILE
::
F_EXIST
<<
8
)),
FILE_NOT_EXIST
=
(
FILE_ERROR
|
(
RCFILE
::
F_NOT_EXIST
<<
8
)),
FILE_NAME
=
(
FILE_ERROR
|
(
RCFILE
::
F_NAME
<<
8
)),
FILE_BOUND
=
(
FILE_ERROR
|
(
RCFILE
::
F_BOUND
<<
8
)),
FILE_CREATE
=
(
FILE_ERROR
|
(
RCFILE
::
F_CREATE
<<
8
)),
FILE_OPEN
=
(
FILE_ERROR
|
(
RCFILE
::
F_OPEN
<<
8
)),
FILE_NOT_OPENED
=
(
FILE_ERROR
|
(
RCFILE
::
F_NOT_OPENED
<<
8
)),
FILE_CLOSE
=
(
FILE_ERROR
|
(
RCFILE
::
F_CLOSE
<<
8
)),
FILE_REMOVE
=
(
FILE_ERROR
|
(
RCFILE
::
F_REMOVE
<<
8
)),
FILE_SEEK
=
(
FILE_ERROR
|
(
RCFILE
::
F_SEEK
<<
8
)),
FILE_READ
=
(
FILE_ERROR
|
(
RCFILE
::
F_READ
<<
8
)),
FILE_WRITE
=
(
FILE_ERROR
|
(
RCFILE
::
F_WRITE
<<
8
)),
/* auth part*/
AUTH_USER
=
(
AUTH
|
(
RCAuth
::
USER
<<
8
)),
/* clog buffer part */
LOGBUF_FULL
=
(
LOGBUF
|
(
RCLOGBUF
::
LB_FULL
<<
8
)),
LOGBUF_EMPTY
=
(
LOGBUF
|
(
RCLOGBUF
::
LB_EMPTY
<<
8
)),
};
extern
const
char
*
strrc
(
RC
rc
);
...
...
src/observer/sql/executor/execute_stage.cpp
浏览文件 @
c7ecaace
...
...
@@ -44,6 +44,7 @@ See the Mulan PSL v2 for more details. */
#include "storage/default/default_handler.h"
#include "storage/common/condition_filter.h"
#include "storage/trx/trx.h"
#include "storage/clog/clog.h"
using
namespace
common
;
...
...
@@ -175,18 +176,29 @@ void ExecuteStage::handle_request(common::StageEvent *event)
default_storage_stage_
->
handle_event
(
event
);
}
break
;
case
SCF_SYNC
:
{
/*
RC rc = DefaultHandler::get_default().sync();
session_event->set_response(strrc(rc));
*/
}
break
;
case
SCF_BEGIN
:
{
do_begin
(
sql_event
);
/*
session_event->set_response("SUCCESS\n");
*/
}
break
;
case
SCF_COMMIT
:
{
do_commit
(
sql_event
);
/*
Trx *trx = session->current_trx();
RC rc = trx->commit();
session->set_trx_multi_operation_mode(false);
session_event->set_response(strrc(rc));
*/
}
break
;
case
SCF_CLOG_SYNC
:
{
do_clog_sync
(
sql_event
);
}
case
SCF_ROLLBACK
:
{
Trx
*
trx
=
session_event
->
get_client
()
->
session
->
current_trx
();
RC
rc
=
trx
->
rollback
();
...
...
@@ -519,6 +531,10 @@ RC ExecuteStage::do_insert(SQLStageEvent *sql_event)
{
Stmt
*
stmt
=
sql_event
->
stmt
();
SessionEvent
*
session_event
=
sql_event
->
session_event
();
Session
*
session
=
session_event
->
session
();
Db
*
db
=
session
->
get_current_db
();
Trx
*
trx
=
session
->
current_trx
();
CLogManager
*
clog_manager
=
db
->
get_clog_manager
();
if
(
stmt
==
nullptr
)
{
LOG_WARN
(
"cannot find statement"
);
...
...
@@ -526,11 +542,29 @@ RC ExecuteStage::do_insert(SQLStageEvent *sql_event)
}
InsertStmt
*
insert_stmt
=
(
InsertStmt
*
)
stmt
;
Table
*
table
=
insert_stmt
->
table
();
RC
rc
=
table
->
insert_record
(
nullptr
,
insert_stmt
->
value_amount
(),
insert_stmt
->
values
());
RC
rc
=
table
->
insert_record
(
trx
,
insert_stmt
->
value_amount
(),
insert_stmt
->
values
());
if
(
rc
==
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
if
(
!
session
->
is_trx_multi_operation_mode
())
{
CLogRecord
*
clog_record
=
nullptr
;
rc
=
clog_manager
->
clog_gen_record
(
CLogType
::
REDO_MTR_COMMIT
,
trx
->
get_current_id
(),
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
||
clog_record
==
nullptr
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
rc
=
clog_manager
->
clog_append_record
(
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
trx
->
next_current_id
();
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
else
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
}
else
{
session_event
->
set_response
(
"FAILURE
\n
"
);
}
...
...
@@ -541,6 +575,10 @@ RC ExecuteStage::do_delete(SQLStageEvent *sql_event)
{
Stmt
*
stmt
=
sql_event
->
stmt
();
SessionEvent
*
session_event
=
sql_event
->
session_event
();
Session
*
session
=
session_event
->
session
();
Db
*
db
=
session
->
get_current_db
();
Trx
*
trx
=
session
->
current_trx
();
CLogManager
*
clog_manager
=
db
->
get_clog_manager
();
if
(
stmt
==
nullptr
)
{
LOG_WARN
(
"cannot find statement"
);
...
...
@@ -551,14 +589,106 @@ RC ExecuteStage::do_delete(SQLStageEvent *sql_event)
TableScanOperator
scan_oper
(
delete_stmt
->
table
());
PredicateOperator
pred_oper
(
delete_stmt
->
filter_stmt
());
pred_oper
.
add_child
(
&
scan_oper
);
DeleteOperator
delete_oper
(
delete_stmt
);
DeleteOperator
delete_oper
(
delete_stmt
,
trx
);
delete_oper
.
add_child
(
&
pred_oper
);
RC
rc
=
delete_oper
.
open
();
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
}
else
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
if
(
!
session
->
is_trx_multi_operation_mode
())
{
CLogRecord
*
clog_record
=
nullptr
;
rc
=
clog_manager
->
clog_gen_record
(
CLogType
::
REDO_MTR_COMMIT
,
trx
->
get_current_id
(),
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
||
clog_record
==
nullptr
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
rc
=
clog_manager
->
clog_append_record
(
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
trx
->
next_current_id
();
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
}
return
rc
;
}
RC
ExecuteStage
::
do_begin
(
SQLStageEvent
*
sql_event
)
{
RC
rc
=
RC
::
SUCCESS
;
SessionEvent
*
session_event
=
sql_event
->
session_event
();
Session
*
session
=
session_event
->
session
();
Db
*
db
=
session
->
get_current_db
();
Trx
*
trx
=
session
->
current_trx
();
CLogManager
*
clog_manager
=
db
->
get_clog_manager
();
session
->
set_trx_multi_operation_mode
(
true
);
CLogRecord
*
clog_record
=
nullptr
;
rc
=
clog_manager
->
clog_gen_record
(
CLogType
::
REDO_MTR_BEGIN
,
trx
->
get_current_id
(),
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
||
clog_record
==
nullptr
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
rc
=
clog_manager
->
clog_append_record
(
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
}
else
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
return
rc
;
}
RC
ExecuteStage
::
do_commit
(
SQLStageEvent
*
sql_event
)
{
RC
rc
=
RC
::
SUCCESS
;
SessionEvent
*
session_event
=
sql_event
->
session_event
();
Session
*
session
=
session_event
->
session
();
Db
*
db
=
session
->
get_current_db
();
Trx
*
trx
=
session
->
current_trx
();
CLogManager
*
clog_manager
=
db
->
get_clog_manager
();
session
->
set_trx_multi_operation_mode
(
false
);
CLogRecord
*
clog_record
=
nullptr
;
rc
=
clog_manager
->
clog_gen_record
(
CLogType
::
REDO_MTR_COMMIT
,
trx
->
get_current_id
(),
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
||
clog_record
==
nullptr
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
return
rc
;
}
rc
=
clog_manager
->
clog_append_record
(
clog_record
);
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
}
else
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
trx
->
next_current_id
();
return
rc
;
}
RC
ExecuteStage
::
do_clog_sync
(
SQLStageEvent
*
sql_event
)
{
RC
rc
=
RC
::
SUCCESS
;
SessionEvent
*
session_event
=
sql_event
->
session_event
();
Db
*
db
=
session_event
->
session
()
->
get_current_db
();
CLogManager
*
clog_manager
=
db
->
get_clog_manager
();
rc
=
clog_manager
->
clog_sync
();
if
(
rc
!=
RC
::
SUCCESS
)
{
session_event
->
set_response
(
"FAILURE
\n
"
);
}
else
{
session_event
->
set_response
(
"SUCCESS
\n
"
);
}
return
rc
;
}
src/observer/sql/executor/execute_stage.h
浏览文件 @
c7ecaace
...
...
@@ -47,6 +47,9 @@ protected:
RC
do_select
(
SQLStageEvent
*
sql_event
);
RC
do_insert
(
SQLStageEvent
*
sql_event
);
RC
do_delete
(
SQLStageEvent
*
sql_event
);
RC
do_begin
(
SQLStageEvent
*
sql_event
);
RC
do_commit
(
SQLStageEvent
*
sql_event
);
RC
do_clog_sync
(
SQLStageEvent
*
sql_event
);
protected:
private:
...
...
src/observer/sql/operator/delete_operator.cpp
浏览文件 @
c7ecaace
...
...
@@ -16,6 +16,7 @@ See the Mulan PSL v2 for more details. */
#include "sql/operator/delete_operator.h"
#include "storage/record/record.h"
#include "storage/common/table.h"
#include "storage/trx/trx.h"
#include "sql/stmt/delete_stmt.h"
RC
DeleteOperator
::
open
()
...
...
@@ -42,7 +43,7 @@ RC DeleteOperator::open()
RowTuple
*
row_tuple
=
static_cast
<
RowTuple
*>
(
tuple
);
Record
&
record
=
row_tuple
->
record
();
rc
=
table
->
delete_record
(
nullptr
,
&
record
);
rc
=
table
->
delete_record
(
trx_
,
&
record
);
if
(
rc
!=
RC
::
SUCCESS
)
{
LOG_WARN
(
"failed to delete record: %s"
,
strrc
(
rc
));
return
rc
;
...
...
src/observer/sql/operator/delete_operator.h
浏览文件 @
c7ecaace
...
...
@@ -17,13 +17,14 @@ See the Mulan PSL v2 for more details. */
#include "sql/operator/operator.h"
#include "rc.h"
class
Trx
;
class
DeleteStmt
;
class
DeleteOperator
:
public
Operator
{
public:
DeleteOperator
(
DeleteStmt
*
delete_stmt
)
:
delete_stmt_
(
delete_stmt
)
DeleteOperator
(
DeleteStmt
*
delete_stmt
,
Trx
*
trx
)
:
delete_stmt_
(
delete_stmt
)
,
trx_
(
trx
)
{}
virtual
~
DeleteOperator
()
=
default
;
...
...
@@ -39,4 +40,5 @@ public:
//RC tuple_cell_spec_at(int index, TupleCellSpec &spec) const override
private:
DeleteStmt
*
delete_stmt_
=
nullptr
;
Trx
*
trx_
=
nullptr
;
};
src/observer/sql/parser/parse.cpp
浏览文件 @
c7ecaace
...
...
@@ -372,6 +372,7 @@ void query_reset(Query *query)
case
SCF_LOAD_DATA
:
{
load_data_destroy
(
&
query
->
sstr
.
load_data
);
}
break
;
case
SCF_CLOG_SYNC
:
case
SCF_BEGIN
:
case
SCF_COMMIT
:
case
SCF_ROLLBACK
:
...
...
src/observer/sql/parser/parse_defs.h
浏览文件 @
c7ecaace
...
...
@@ -168,6 +168,7 @@ enum SqlCommandFlag {
SCF_DESC_TABLE
,
SCF_BEGIN
,
SCF_COMMIT
,
SCF_CLOG_SYNC
,
SCF_ROLLBACK
,
SCF_LOAD_DATA
,
SCF_HELP
,
...
...
src/observer/storage/clog/clog.cpp
0 → 100644
浏览文件 @
c7ecaace
/* Copyright (c) 2021-2022 Xie Meiyi(xiemeiyi@hust.edu.cn),
Huazhong University of Science and Technology
and OceanBase and/or its affiliates. All rights reserved.
miniob is licensed under Mulan PSL v2.
You can use this software according to the terms and conditions of the Mulan PSL v2.
You may obtain a copy of Mulan PSL v2 at:
http://license.coscl.org.cn/MulanPSL2
THIS SOFTWARE IS PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND,
EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO NON-INFRINGEMENT,
MERCHANTABILITY OR FIT FOR A PARTICULAR PURPOSE.
See the Mulan PSL v2 for more details. */
//
// Created by huhaosheng.hhs on 2022
//
#include "common/log/log.h"
#include "clog.h"
#define CLOG_INS_REC_NODATA_SIZE (sizeof(CLogInsertRecord) - sizeof(char *))
const
char
*
CLOG_FILE_NAME
=
"clog"
;
int
_align8
(
int
size
)
{
return
size
/
8
*
8
+
((
size
%
8
==
0
)
?
0
:
8
);
}
CLogRecord
::
CLogRecord
(
CLogType
flag
,
int32_t
trx_id
,
const
char
*
table_name
/* = nullptr */
,
int
data_len
/* = 0 */
,
Record
*
rec
/* = nullptr */
)
{
flag_
=
flag
;
switch
(
flag
)
{
case
REDO_MTR_BEGIN
:
case
REDO_MTR_COMMIT
:
{
log_record_
.
mtr
.
hdr_
.
trx_id_
=
trx_id
;
log_record_
.
mtr
.
hdr_
.
type_
=
flag
;
log_record_
.
mtr
.
hdr_
.
logrec_len_
=
sizeof
(
CLogMTRRecord
);
log_record_
.
mtr
.
hdr_
.
lsn_
=
CLogManager
::
get_next_lsn
(
log_record_
.
mtr
.
hdr_
.
logrec_len_
);
}
break
;
case
REDO_INSERT
:
{
if
(
!
rec
||
!
rec
->
data
())
{
LOG_ERROR
(
"Record is null"
);
}
else
{
log_record_
.
ins
.
hdr_
.
trx_id_
=
trx_id
;
log_record_
.
ins
.
hdr_
.
type_
=
flag
;
strcpy
(
log_record_
.
ins
.
table_name_
,
table_name
);
log_record_
.
ins
.
rid_
=
rec
->
rid
();
log_record_
.
ins
.
data_len_
=
data_len
;
log_record_
.
ins
.
hdr_
.
logrec_len_
=
_align8
(
CLOG_INS_REC_NODATA_SIZE
+
data_len
);
log_record_
.
ins
.
data_
=
new
char
[
log_record_
.
ins
.
hdr_
.
logrec_len_
-
CLOG_INS_REC_NODATA_SIZE
];
memcpy
(
log_record_
.
ins
.
data_
,
rec
->
data
(),
data_len
);
log_record_
.
ins
.
hdr_
.
lsn_
=
CLogManager
::
get_next_lsn
(
log_record_
.
ins
.
hdr_
.
logrec_len_
);
}
}
break
;
case
REDO_DELETE
:
{
if
(
!
rec
)
{
LOG_ERROR
(
"Record is null"
);
}
else
{
log_record_
.
del
.
hdr_
.
trx_id_
=
trx_id
;
log_record_
.
del
.
hdr_
.
type_
=
flag
;
log_record_
.
del
.
hdr_
.
logrec_len_
=
sizeof
(
CLogDeleteRecord
);
strcpy
(
log_record_
.
ins
.
table_name_
,
table_name
);
log_record_
.
del
.
rid_
=
rec
->
rid
();
log_record_
.
del
.
hdr_
.
lsn_
=
CLogManager
::
get_next_lsn
(
log_record_
.
del
.
hdr_
.
logrec_len_
);
}
}
break
;
default:
LOG_ERROR
(
"flag is error"
);
break
;
}
}
CLogRecord
::
CLogRecord
(
char
*
data
)
{
CLogRecordHeader
*
hdr
=
(
CLogRecordHeader
*
)
data
;
flag_
=
(
CLogType
)
hdr
->
type_
;
switch
(
flag_
)
{
case
REDO_MTR_BEGIN
:
case
REDO_MTR_COMMIT
:
{
log_record_
.
mtr
.
hdr_
=
*
hdr
;
}
break
;
case
REDO_INSERT
:
{
log_record_
.
ins
.
hdr_
=
*
hdr
;
data
+=
sizeof
(
CLogRecordHeader
);
strcpy
(
log_record_
.
ins
.
table_name_
,
data
);
data
+=
TABLE_NAME_MAX_LEN
;
log_record_
.
ins
.
rid_
=
*
(
RID
*
)
data
;
data
+=
sizeof
(
RID
);
log_record_
.
ins
.
data_len_
=
*
(
int
*
)
data
;
data
+=
sizeof
(
int
);
log_record_
.
ins
.
data_
=
new
char
[
log_record_
.
ins
.
hdr_
.
logrec_len_
-
CLOG_INS_REC_NODATA_SIZE
];
memcpy
(
log_record_
.
ins
.
data_
,
data
,
log_record_
.
ins
.
data_len_
);
}
break
;
case
REDO_DELETE
:
{
log_record_
.
del
.
hdr_
=
*
hdr
;
data
+=
sizeof
(
CLogRecordHeader
);
strcpy
(
log_record_
.
del
.
table_name_
,
data
);
data
+=
TABLE_NAME_MAX_LEN
;
log_record_
.
del
.
rid_
=
*
(
RID
*
)
data
;
}
break
;
default:
LOG_ERROR
(
"flag is error"
);
break
;
}
}
CLogRecord
::~
CLogRecord
()
{
if
(
REDO_INSERT
==
flag_
)
{
delete
[]
log_record_
.
ins
.
data_
;
}
}
RC
CLogRecord
::
copy_record
(
void
*
dest
,
int
start_off
,
int
copy_len
)
{
CLogRecords
*
log_rec
=
&
log_record_
;
if
(
start_off
+
copy_len
>
get_logrec_len
())
{
return
RC
::
GENERIC_ERROR
;
}
else
if
(
flag_
!=
REDO_INSERT
)
{
memcpy
(
dest
,
(
char
*
)
log_rec
+
start_off
,
copy_len
);
}
else
{
if
(
start_off
>
CLOG_INS_REC_NODATA_SIZE
)
{
memcpy
(
dest
,
log_rec
->
ins
.
data_
+
start_off
-
CLOG_INS_REC_NODATA_SIZE
,
copy_len
);
}
else
if
(
start_off
+
copy_len
<=
CLOG_INS_REC_NODATA_SIZE
)
{
memcpy
(
dest
,
(
char
*
)
log_rec
+
start_off
,
copy_len
);
}
else
{
memcpy
(
dest
,
(
char
*
)
log_rec
+
start_off
,
CLOG_INS_REC_NODATA_SIZE
-
start_off
);
memcpy
((
char
*
)
dest
+
CLOG_INS_REC_NODATA_SIZE
-
start_off
,
log_rec
->
ins
.
data_
,
copy_len
-
(
CLOG_INS_REC_NODATA_SIZE
-
start_off
));
}
}
return
RC
::
SUCCESS
;
}
// for unitest // 1 = "="// 0 = "!="
int
CLogRecord
::
cmp_eq
(
CLogRecord
*
other
)
{
CLogRecords
*
other_logrec
=
other
->
get_record
();
if
(
flag_
==
other
->
flag_
)
{
switch
(
flag_
)
{
case
REDO_MTR_BEGIN
:
case
REDO_MTR_COMMIT
:
return
log_record_
.
mtr
==
other_logrec
->
mtr
;
case
REDO_INSERT
:
return
log_record_
.
ins
==
other_logrec
->
ins
;
case
REDO_DELETE
:
return
log_record_
.
del
==
other_logrec
->
del
;
default:
LOG_ERROR
(
"log_record is error"
);
break
;
}
}
return
0
;
}
//
CLogBuffer
::
CLogBuffer
()
{
current_block_no_
=
0
*
CLOG_BLOCK_SIZE
;
// 第一个块是文件头块
write_block_offset_
=
0
;
write_offset_
=
0
;
memset
(
buffer_
,
0
,
CLOG_BUFFER_SIZE
);
}
CLogBuffer
::~
CLogBuffer
()
{}
RC
CLogBuffer
::
append_log_record
(
CLogRecord
*
log_rec
,
int
&
start_off
)
{
if
(
!
log_rec
)
{
return
RC
::
GENERIC_ERROR
;
}
if
(
write_offset_
==
CLOG_BUFFER_SIZE
)
{
return
RC
::
LOGBUF_FULL
;
}