GeneratedInput for trg_embedding. GeneratedInput computes the embedding of the generated token at the last time step for the input at the current time step.beam_search function. This function needs to set:id_input: the integer ID of the data, used to identify the corresponding output in the generated files.dict_file: the dictionary file for converting word id to word.bos_id: the start token. Every sentence starts with the start token.eos_id: the end token. Every sentence ends with the end token.beam_size: the beam size used in beam search.max_length: the maximum length of the generated sentences.seqtext_printer_evaluator to print text according to index matrix and dictionary. This function needs to set:id_input: the integer ID of the data, used to identify the corresponding output in the generated files.dict_file: the dictionary file for converting word id to word.result_file: the path of the generation result file.paddle.trainer_config_helpers.evaluators.seqtext_printer_evaluator(*args, **kwargs)
Sequence text printer will print text according to index matrix and a dictionary. There can be multiple input to this layer:
-1. If there is only one input, the input must be a matrix containing +
1. If there is no id_input, the input must be a matrix containing the sequence of indices;
-2. If there are more than one input, the first input should be ids, -and are interpreted as sample ids.
+The output format will be:
Typically SequenceTextPrinter layer takes output of maxid or RecurrentGroup with maxid (when generating) as an input.
The simple usage is:
-eval = seqtext_printer_evaluator(input,
+eval = seqtext_printer_evaluator(input=maxid_layer,
+ id_input=sample_id,
dict_file=dict_file,
result_file=result_file)
@@ -536,16 +538,29 @@ with maxid (when generating) as an input.
Parameters:
+Parameters:
- input (LayerOutput|list) – Input Layer name.
-- dict_file (basestring) – The input dictionary which contains a list of tokens.
-- result_file (basestring) – The file is to save the results.
+- result_file (basestring) – Path of the file to store the generated results.
+- id_input (LayerOutput) – Index of the input sequence, and the specified index will
+be prited in the gereated results. This an optional
+parameter.
+- dict_file (basestring) – Path of dictionary. This is an optional parameter.
+Every line is a word in the dictionary with
+(line number - 1) as the word index.
+If this parameter is set to None, or to an empty string,
+only word index are printed in the generated results.
- delimited (bool) – Whether to use space to separate output tokens.
Default is True. No space is added if set to False.
- name (None|basestring) – Evaluator name.
Returns: The seq_text_printer that prints the generated sequence to a file.
+Return type: evaluator
+
Please see the following demo for more details:
@@ -1015,25 +1014,16 @@ algorithm. To maintain tractability, every iteration only only stores a predetermined number, called the beam_size, of the most promising next words. The greater the beam size, the fewer candidate words are pruned. -The seq_text_printer that prints the generated sequence to a file.
+The generated word index.
evaluator
+LayerOutput