本笔记演示的是怎么在tensorflow/python/training/basic_session_run_hooks.py增加一个自定义Hook;在其他地方增加Hook可能有所不同,但是基本流程相同,也可参考此笔记。
一.自定义Hook:
@tf_export("train.MyHook")
class MyHook(session_run_hook.SessionRunHook):
"""Hook to extend calls to MonitoredSession.run()."""
def __init__(self, arg1, arg2=10):
"""Initializes a `MyHook`.
pass
def begin(self):
"""Called once before using the session.
When called, the default graph is the one that will be launched in the
session. The hook can modify the graph by adding new operations to it.
After the `begin()` call the graph will be finalized and the other callbacks
can not modify the graph anymore. Second call of `begin()` on the same
graph, should not change the graph.
"""
pass
def after_create_session(self, session, coord): # pylint: disable=unused-argument
"""Called when new TensorFlow session is created.
This is called to signal the hooks that a new session has been created. This
has two essential differences with the situation in which `begin` is called:
* When this is called, the graph is finalized and ops can no longer be added
to the graph.
* This method will also be called as a result of recovering a wrapped
session, not only at the beginning of the overall session.
Args:
session: A TensorFlow Session that has been created.
coord: A Coordinator object which keeps track of all threads.
"""
pass
def before_run(self, run_context): # pylint: disable=unused-argument
"""Called before each call to run().
You can return from this call a `SessionRunArgs` object indicating ops or
tensors to add to the upcoming `run()` call. These ops/tensors will be run
together with the ops/tensors originally passed to the original run() call.
The run args you return can also contain feeds to be added to the run()
call.
The `run_context` argument is a `SessionRunContext` that provides
information about the upcoming `run()` call: the originally requested
op/tensors, the TensorFlow Session.
At this point graph is finalized and you can not add ops.
Args:
run_context: A `SessionRunContext` object.
Returns:
None or a `SessionRunArgs` object.
"""
return None
def after_run(self,
run_context, # pylint: disable=unused-argument
run_values): # pylint: disable=unused-argument
"""Called after each call to run().
The `run_values` argument contains results of requested ops/tensors by
`before_run()`.
The `run_context` argument is the same one send to `before_run` call.
`run_context.request_stop()` can be called to stop the iteration.
If `session.run()` raises any exceptions then `after_run()` is not called.
Args:
run_context: A `SessionRunContext` object.
run_values: A SessionRunValues object.
"""
pass
def end(self, session): # pylint: disable=unused-argument
"""Called at the end of session.
The `session` argument can be used in case the hook wants to run final ops,
such as saving a last checkpoint.
If `session.run()` raises exception other than OutOfRangeError or
StopIteration then `end()` is not called.
Note the difference between `end()` and `after_run()` behavior when
`session.run()` raises OutOfRangeError or StopIteration. In that case
`end()` is called but `after_run()` is not called.
Args:
session: A TensorFlow Session that will be soon closed.
"""
pass
二.注册Hook:
1.在tensorflow/tools/api/golden/v1/tensorflow.train.pbtxt 和 tensorflow/tools/api/golden/v2/tensorflow.train.pbtxt 中注册MyHook的名称:
member {
name: "MyHook"
mtype: "<type \'type\'>"
}
2.在 tensorflow/tools/api/golden/v1 和 tensorflow/tools/api/golden/v2 目录新增描述MyHook的接口属性文件tensorflow.train.-my-hook.pbtxt,注册MyHook的接口:
path: "tensorflow.train.MyHook"
tf_class {
is_instance: "<class \'tensorflow.python.training.basic_session_run_hooks.MyHook\'>"
is_instance: "<class \'tensorflow.python.training.session_run_hook.MyHook\'>"
is_instance: "<type \'object\'>"
member_method {
name: "__init__"
argspec: "args=[\'self\', \'arg1\', \'arg2\'], varargs=None, keywords=None, defaults=[\'0\', \'0\'], "
}
member_method {
name: "after_create_session"
argspec: "args=[\'self\', \'session\', \'coord\'], varargs=None, keywords=None, defaults=None"
}
member_method {
name: "after_run"
argspec: "args=[\'self\', \'run_context\', \'run_values\'], varargs=None, keywords=None, defaults=None"
}
member_method {
name: "before_run"
argspec: "args=[\'self\', \'run_context\'], varargs=None, keywords=None, defaults=None"
}
member_method {
name: "begin"
argspec: "args=[\'self\'], varargs=None, keywords=None, defaults=None"
}
member_method {
name: "end"
argspec: "args=[\'self\', \'session\'], varargs=None, keywords=None, defaults=None"
}
}
三.编译和部署tf框架:
1.编译:
./configure
bazel build --jobs=32 --config=opt --config=mkl --config=cuda //tensorflow/tools/pip_package:build_pip_package
2.部署:
bazel-bin/tensorflow/tools/pip_package/build_pip_package ./tensorflow_pkg
sudo pip install ./tensorflow_pkg/pkg_name.whl