在paddle cloud上运行5天的任务出现内存溢出
Created by: jshower
如题,在paddle cloud上运行的ner任务在运行5天后,出现内存溢出。设置内存限制是40G。 作业ID: job-e6c5b041cc6648c3 作业链接:http://paddlecloud.baidu-int.com/paddle/jobInfo?jobId=job-e6c5b041cc6648c3&flag=jobs 运行详情:http://paddlecloud.baidu-int.com/paddle/jobRunInfo?jobId=job-e6c5b041cc6648c3 错误信息
[2610436.709032] Task in /426206538.job-e6c5b041cc6648c3-trainer killed as a result of limit of /426206538.job-e6c5b041cc6648c3-trainer
[2610436.709035] memory: usage 41943040kB, limit 41943040kB, failcnt 44710887
[2610436.709036] memory+swap: usage 41943040kB, limit 9007199254740991kB, failcnt 0
[2610436.709037] kmem: usage 0kB, limit 9007199254740991kB, failcnt 0
[2610436.709039] Memory cgroup stats for /426206538.job-e6c5b041cc6648c3-trainer: cache:24580KB rss:41918460KB rss_huge:0KB mapped_file:24576KB sw
ap:0KB inactive_anon:26764KB active_anon:33687480KB inactive_file:0KB active_file:4KB unevictable:8228732KB