Skip to content

  • 体验新版
    • 正在加载...
  • 登录
  • PaddlePaddle
  • Paddle
  • 合并请求
  • !18285

P
Paddle
  • 项目概览

PaddlePaddle / Paddle
大约 2 年 前同步成功

通知 2325
Star 20933
Fork 5424
  • 代码
    • 文件
    • 提交
    • 分支
    • Tags
    • 贡献者
    • 分支图
    • Diff
  • Issue 1423
    • 列表
    • 看板
    • 标记
    • 里程碑
  • 合并请求 543
  • Wiki 0
    • Wiki
  • 分析
    • 仓库
    • DevOps
  • 项目成员
  • Pages
P
Paddle
  • 项目概览
    • 项目概览
    • 详情
    • 发布
  • 仓库
    • 仓库
    • 文件
    • 提交
    • 分支
    • 标签
    • 贡献者
    • 分支图
    • 比较
  • Issue 1,423
    • Issue 1,423
    • 列表
    • 看板
    • 标记
    • 里程碑
  • 合并请求 543
    • 合并请求 543
  • Pages
  • 分析
    • 分析
    • 仓库分析
    • DevOps
  • Wiki 0
    • Wiki
  • 成员
    • 成员
  • 收起侧边栏
  • 动态
  • 分支图
  • 创建新Issue
  • 提交
  • Issue看板

clear cache when tid == -1 and cache size exceeds max capacity !18285

  • Report abuse
!18285 已关闭 6月 24, 2019 由 saxon_zh@saxon_zh 创建
#<User:0x00007fed6e4d2908>
  • 概览 14
  • 提交 11
  • 变更 11

Created by: LeoZhao-Intel

1. Enable cache clearing mechanism platform::get_cur_thread_id() == -1 means it is in cache clearing mode. In this mode, mkldnn key generation is plain format, without including real thread id, and when blob size (mkldnn blob with first level key = -1, see line ) exceeds the defined max capacity (see line), it will trigger cache clearing, and remove one from head of this blob, the blob data structure is changed to vector type to meet requirement for removing from head.

2. Add new interface SetMKLDNNThreadId(int id) in AnalysisConfig Use this interface to indicate that users want to set mkldnn thread id manually, original AnalysisPredictor::SetMkldnnthreadid() API is not exposed to user directly. Meanwhile we use id=-1 to trigger cache clearing mode. Given cache clearing mode is a specific mode to fix thread id frequent changing issue and dynamic shape issue, it is rarely used, and should not be inherited by other AnalysisPredictor instances, we need to set and clear value for each iteration, that means we need add hook points in AnalysisPredictor::Run() and ZeroCopyRun().

3. Few fixes in mkldnn concat/pool/conv kernels In these 3 kernels, due to key generation method is not aligned with new method (PR #17965), there are few changes in key generation, and also fix potential crash issues if mkldnn cache doesn't work as expected result (always cache successfully) This part is merged by PR #18393 test=develop

指派人
分配到
审核者
Request review from
无
里程碑
无
分配里程碑
工时统计
标识: paddlepaddle/Paddle!18285
Source branch: github/fork/LeoZhao-Intel/cache_clearing
渝ICP备2023009037号

京公网安备11010502055752号

网络110报警服务 Powered by GitLab CE v13.7
开源知识
Git 入门 Pro Git 电子书 在线学 Git
Markdown 基础入门 IT 技术知识开源图谱
帮助
使用手册 反馈建议 博客
《GitCode 隐私声明》 《GitCode 服务条款》 关于GitCode
Powered by GitLab CE v13.7