1. 24 9月, 2020 1 次提交
    • W
      use iwyu clean include (#27267) · df43905f
      wanghuancoder 提交于
      * use iwyu clean include, test=develop, test=win
      
      * compilation error, test=develop
      
      * fix compilation error2, test=develop
      
      * fix compilation error3, test=develop
      
      * fix compilation error4, test=develop
      
      * fix compilation error5, test=develop
      
      * fix compilation error6, test=develop
      
      * fix compilation error7, test=develop
      
      * fix compilation error8, test=develop
      
      * fix compilation error8, test=develop
      
      * fix compilation error10, test=develop
      
      * fix compilation error11, test=develop
      df43905f
  2. 25 2月, 2020 1 次提交
    • H
      PaddleBox Framework Part2 (#22466) · 175954d8
      hutuxian 提交于
      * Add two types of Metric Calculator: MultiTaskCalculator & CmatchRankCalculator.
      * Add a config for DynamicAdjustChannelNum function to denote whether we will discard the remaining instances when they are not be distributed evenly.
      * Remove CPU code in Pull/PushSparse and we will add it back when testing it fully.
      * Fix some known issues: such as copying persistable vars after one epoch running.
      175954d8
  3. 29 8月, 2019 1 次提交
    • T
      support debug each output of each ins (#19004) · 1fe468d3
      Thunderbrook 提交于
      * dump slot
      
      * test
      
      * proto
      
      * dump slot
      
      * test
      
      * proto
      
      * code style
      
      * code style
      
      * code style
      
      * style
      
      * add delete after unseen days
      
      * add unseen days
      
      * code style
      
      * conflict solve
      test=develop
      
      * add clear model
      
      * code style
      test=develop
      
      * code style
      test=develop
      
      * support debug tensor of each ins
      test=develop
      
      * support debug tensor of each ins
      test=develop
      
      * learning rate
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      
      * code style
      test=develop
      
      * code style
      test=develop
      
      * unitest
      
      * style
      
      * style
      
      * multi phase
      
      * add channel
      
      * code style
      
      * style
      
      * style
      
      * unitest
      
      * style
      
      * define
      
      * define
      test=develop
      
      * style
      test=develop
      
      * rm define
      test=develop
      
      * linux
      
      * linux
      test=develop
      
      * style
      test=develop
      
      * output format
      test=develop
      
      * windows ci
      test=develop
      1fe468d3
  4. 21 6月, 2019 1 次提交
    • J
      dataset (#17973) · 3f8031e2
      jiaqi 提交于
      (1) use channel instead of vector/BlockingQueue in Dataset,to keep same with existing implementation, and make code more readable and flexible (dataset single output channel or multi output channel). one previous memory out of limit problem is cause by not release memory after training.
      (2) add Record because MultiSlotType costs too much memory (80B),fix memory out of limit problem.
      (3) add Channel, Archive in paddle/fluid/framework
      (4) change dataset from shared_ptr to unique_ptr in pybind
      (5) move create/destroy readers from trainer to dataset
      (6) move shuffle from datafeed to dataset. dataset holds memory, datafeed is only for load data and feed data to network.
      (7) fix thread num bug of Dataset when filelist size < thread num
      (8) support set_queue_num in InMemoryDataset
      3f8031e2
  5. 29 9月, 2018 1 次提交
  6. 05 4月, 2018 1 次提交
  7. 27 3月, 2018 1 次提交
  8. 15 3月, 2018 2 次提交
    • T
      Implement Select OP (#9088) · 1e4c504e
      Thuan Nguyen 提交于
      * Fix old documentation for channel_recv
      
      * Initial design of CSP select
      
      * Redesign channel implementation for Select Op
      
      * Remove unecessary header
      
      * Initial checkin of select op, currently will read all the conditional_op in the cases block and also pull out all channels involved in the select.
      
      * Init python select op API
      
      * Python select bug fix when checking op creates block
      
      * Add case_to_execute as (a) input to select, (b) into the passed inputs into the select op
      
      * Add in addition code for select op
      
      * Init fibonacci test from python
      
      * implement fibonnaci sequence test
      
      * update fib unit test
      
      * Improve select test cases
      
      * Shorten non-pep-8-ed lines
      
      * Add methods on channel needed by select op
      
      * Fix compile issues, finish implementation, still need to debug code
      
      * Fix issue with fibonncci test, it works now!
      
      * Change QueueMessage callback to take in an ChannelAction enum, fix select unit test
      
      * Fix case attributes
      
      * Fix issue with select control flow
      
      * Make cases - previously on each selectcase conditional_block - attributes to select
      
      * Use class constants for type of channel
      
      * Change select op to take in "cases" attribute
      
      * return boolean from select callback function to tell Channel if this RECV or SEND should be executed
      
      * Improve attributes and inputs comments on select op
      
      * Fix issues with python unit test
      
      * Assert fibonacci final output
      
      * Fix issue when channel name / channel var is null for "default" case in select op
      
      * Assert base select test output
      
      * Make QueueMessage use shared pointer and modify the order of the callback
      
      * Fixing the order in which the callback is called
      
      * Move channel utility methods to paddle/fluid/operators/concurrency/channel_util
      
      * Create channel_util and move channel util methods
      
      * Fix crash when calling select_op
      
      * Fix deadlock
      
      * Fix issue of channel destructor deadlock
      
      * Fix precommit issues
      
      * Accidentally checked in changes to beam_search_op, reverting change.
      
      * Fix dependency issue in concurrency cmake
      
      * add device_context dependency for concurrency target
      1e4c504e
    • A
      41894da1
  9. 07 3月, 2018 1 次提交
  10. 01 3月, 2018 1 次提交
    • A
      Add Go_op, Channel_create, channel_close, channel_send and channel_receive ops (#8593) · 0d878e4c
      Abhinav Arora 提交于
      * Adding Python boilerplate code for Go op
      
      * Add very basic test case
      
      * Adding the python logic for go routine
      
      * Fix syntax
      
      * Changing test to notest
      
      * Rename Routine to Go
      
      * Combining GoGuard and Go in one class
      
      * Modify test
      
      * Adding fluid close channel
      
      * Fixing __init__.py for calling fluid.go()
      
      * Adding stubs for channel methods and updating test case
      
      * Removing import *
      
      * Adding imports from concurrency
      
      * Initial commit of GO_OP (for varun)
      
      * Creating local scopes and go through them
      
      * Updated go op inputs persistability enforcement
      
      * Add thread execution; compile failing though
      
      * Fix go op
      
      * Cleaned up Go op
      
      * Fix yapf format issue
      
      * Readd warp ctc dir for unit tests
      
      * Updated make_channel, channel_send, channel_recv and channel_close
      
      * Moved thread function to another method, update unit tests
      
      * remove output var
      
      * Add stubs for channel operators
      
      * Updating concurrency with signatures
      
      * Updated the signature with return status
      
      * Fixed dtype in variables
      
      * Updating stub of ChannelSend + add infershape
      
      * Updating stub of ChannelRecv + add infershape
      
      * Updated signature
      
      * Adding the channel_create operator
      
      * Merge channel send+receive ops
      
      * Update concurrency tests using all operators
      
      * Updating the create op with ChannelHolder
      
      * Fix issues with channel_create_op
      
      * Add the implementation for channel_close op
      
      * Add channel close operator, fix channel close op
      
      * Adding the channel_send op
      
      * Comment channels C++ and Python code
      
      * Concurrency python api comment fix
      
      * Update unit test to add Status variable
      
      * Adding channel receive operator
      
      * Update concurrency test to demonstrate a complete CSP flow
      
      * Fix clang-format issues
      
      * Fixed "Out" parameter name
      
      * Fixing merge conflict in framework.py
      
      * Add channel ops to framework.py no_kernel_op_set
      
      * Seperating channel_send and channel_recv operators
      
      * Documenting capacity type
      
      * Update concurrency test to create go block as child block of main program
      
      * Changing set status implementation
      0d878e4c
  11. 23 2月, 2018 2 次提交
    • A
      Add unit tests for ChannelHolder (#8510) · 6e7fee0e
      Abhinav Arora 提交于
      6e7fee0e
    • K
      Exposing Channel to be used as a Variable and integrating with Fluid (#8486) · 77ee8fb2
      kavyasrinet 提交于
      * Adding set_capacity method support
      
      * Adding Python for make_channel
      
      * Updating notest_concurrency
      
      * Write python for make_channel method
      
      * Write python for make_channel method
      
      * Fix make_channel and test
      
      * Placeholder ops for channel send, recv and close
      
      * Adding ToTypeIndex method to var_type.h
      
      * Add var_type.h to channel:
      
      * Added POD_Type to the method
      
      * Add CHANNEL to executor
      
      * Updated get and set DataType to accomodate Channels
      
      * Updating get and set to incorporate channels
      
      * Adding CHANNEL as supported VarType in protobuf
      
      * Removing unecessary import
      
      * Fixing VarDesc to adapt to Channel as VarType
      
      * Add channel.h to executor
      
      * Remove innclude from channel
      
      * Updated var_type to support Channel as  var type
      
      * Adding get_channel to pybind
      
      * Added ChannelHolder
      
      * Adding make_channel as an op
      
      * Adding ChannelHolder in channel
      
      * Fixing typo
      
      * Commenting out operators in concurrency
      
      * Removing totypeid right now since we don't need it.
      
      * Reverting python changes
      
      * Fixing typo in framework.py
      
      * Modify comments for ReaderHolder
      77ee8fb2
  12. 10 2月, 2018 2 次提交
  13. 09 2月, 2018 1 次提交
  14. 03 2月, 2018 1 次提交
  15. 31 1月, 2018 1 次提交
    • C
      Refine channel test (#7946) · adf14b0c
      chengduo 提交于
      * refine channel test
      
      * follow comments
      
      * Add dependency enforce to threadpool
      
      * Revert changes to channel_test.cc
      
      * Revert changes to channel_test.cc
      
      * Add #include "paddle/framework/macros.h"
      
      * Add unit tests
      
      * fix code format
      
      * refine close channel
      
      * follow comments
      
      * use delete to destroy channel
      adf14b0c
  16. 29 1月, 2018 1 次提交
  17. 28 1月, 2018 1 次提交
  18. 27 1月, 2018 1 次提交