diff --git a/README.md b/README.md index e504860b789ebd9f37f53ce171844e726d88cfa5..9a60ef0e91f67e31b36ac8c782a46b7f13f3363d 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ ## Introduction -**BERT**, or **B**idirectional **E**mbedding **R**epresentations from +**BERT**, or **B**idirectional **E**ncoder **R**epresentations from **T**ransformers, is a new method of pre-training language representations which obtains state-of-the-art results on a wide array of Natural Language Processing (NLP) tasks. @@ -205,7 +205,8 @@ the following flags to `run_classifier.py` or `run_squad.py`: Please see the [Google Cloud TPU tutorial](https://cloud.google.com/tpu/docs/tutorials/mnist) -for how to use Cloud TPUs. +for how to use Cloud TPUs. Alternatively, you can use the Codalab notebook +"[BERT FineTuning with Cloud TPUs](https://colab.sandbox.google.com/github/tensorflow/tpu/blob/master/tools/colab/bert_finetuning_with_cloud_tpus.ipynb)". On Cloud TPUs, the pretrained model and the output directory will need to be on Google Cloud Storage. For example, if you have a bucket named `some_bucket`, you diff --git a/modeling.py b/modeling.py index ac493c50981d3a796c0432c80442e1dbe252e21e..16251def0a5f470803665194c5216da3c23e7029 100644 --- a/modeling.py +++ b/modeling.py @@ -12,7 +12,7 @@ # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. -"""Common utility functions related to TensorFlow.""" +"""The main BERT model and related functions.""" from __future__ import absolute_import from __future__ import division diff --git a/requirements.txt b/requirements.txt new file mode 100644 index 0000000000000000000000000000000000000000..c8e6da0bf228fce7941e534704fbb9fbba4d357b --- /dev/null +++ b/requirements.txt @@ -0,0 +1,5 @@ +# This may work with versions of TensorFlow back to 1.7.0, but has not been +# tested. + +tensorflow >= 1.11.0 # CPU Version of TensorFlow. +# tensorflow-gpu >= 1.11.0 # GPU version of TensorFlow.