• Pipe: Improve performance for 10000+ pipes (#11021) · 1a3568ff
    马子坤 提交于
    Improvements:
    
    * Cache the File objects to reduce the size of TsFileInsertionEvents.
    
    * Limit the frequency of flushing TsFiles when cocurrently creating historical extractors.
    
    * If cluster heartbeat doesn't need PipeMetaList, do not get into PipeTaskAgent. This will prevent datanode from turning UNKNOWN when many pipes are being created.
    
    ---------
    Co-authored-by: NSteve Yurong Su <rong@apache.org>
    1a3568ff
PipeTaskAgent.java 32.1 KB