How to train your own Object Detector with TensorFlow’s Object Detector API
Dat Tran
5.7K168

Hello,I had followed your “How to train your own Object Detector with TensorFlow’s Object Detector API”.But when I trained on google cloud,it has a error,could your help me.Thank your very much.

The replica master 0 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ The replica worker 0 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ The replica worker 1 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ The replica worker 2 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ The replica worker 3 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ The replica worker 4 exited with a non-zero status of 1. Termination reason: Error. Traceback (most recent call last): File “/usr/lib/python2.7/runpy.py”, line 162, in _run_module_as_main “__main__”, fname, loader, pkg_name) File “/usr/lib/python2.7/runpy.py”, line 72, in _run_code exec code in run_globals File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 198, in <module> tf.app.run() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py”, line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File “/root/.local/lib/python2.7/site-packages/object_detection/train.py”, line 194, in main worker_job_name, is_chief, FLAGS.train_dir) File “/root/.local/lib/python2.7/site-packages/object_detection/trainer.py”, line 218, in train var_map, train_config.fine_tune_checkpoint)) File “/root/.local/lib/python2.7/site-packages/object_detection/utils/variables_helper.py”, line 122, in get_variables_available_in_checkpoint ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path) File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/pywrap_tensorflow.py”, line 110, in NewCheckpointReader return CheckpointReader(compat.as_bytes(filepattern), status) File “/usr/lib/python2.7/contextlib.py”, line 24, in __exit__ self.gen.next() File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) InvalidArgumentError: Unsuccessful TensorSliceReader constructor: Failed to get matching files on gs:///data/model.ckpt: Invalid argument: GCS path doesn’t contain a bucket name: gs:///data/ To find out more about why your job exited please check the logs: https://console.cloud.google.com/logs/viewer?project=612338178304&resource=ml_job%2Fjob_id%2Fhuvas_object_detection_1505316273&advancedFilter=resource.type%3D%22ml_job%22%0Aresource.labels.job_id%3D%22huvas_object_detection_1505316273%22