Python 3.8.5
Post
Replies
Boosts
Views
Activity
Hopefully, they'll use this for testing:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/profiler/profiler_v2_test.py
ModuleNotFoundError: No module named 'tensorflow_text'
Understood. Any ETA on tensorflow_text?
https://github.com/tensorflow/text/issues/538
https://github.com/tensorflow/text/issues/654
I tried the tensorboard profiler in a Keras example. It doesn't work either.
https://github.com/tensorflow/tensorboard/blob/master/docs/tensorboard_profiling_keras.ipynb
Here's what was generated. Any idea why the tensor board profile tab empty?
% ls -lR train/plugins/profile/2021_08_29_11_07_46
total 232
-rw-r--r-- 1 davidlaxer staff 4867 Aug 29 11:07 BlueDiamond.local.input_pipeline.pb
-rw-r--r-- 1 davidlaxer staff 0 Aug 29 11:07 BlueDiamond.local.kernel_stats.pb
-rw-r--r-- 1 davidlaxer staff 1501 Aug 29 11:07 BlueDiamond.local.memory_profile.json.gz
-rw-r--r-- 1 davidlaxer staff 5938 Aug 29 11:07 BlueDiamond.local.overview_page.pb
-rw-r--r-- 1 davidlaxer staff 4013 Aug 29 11:07 BlueDiamond.local.tensorflow_stats.pb
-rw-r--r-- 1 davidlaxer staff 14817 Aug 29 11:07 BlueDiamond.local.trace.json.gz
-rw-r--r-- 1 davidlaxer staff 74605 Aug 29 11:07 BlueDiamond.local.xplane.pb
(base) davidlaxer@x86_64-apple-darwin13 20210829-102538 %
Several of the profiler tools are not functional
(e.g. - Kernel Stats: There is no GPU data to display because there were no kernels in the capture duration.
tf_data_bottleneck_analysys: No tf.data activitiy captured in your profile. If your job uses tf.data, try to capture a longer profile.
How do I send you a Jupyter notebook?
Also, why doesn't the GPU run when Tensorflow is in Eager Execution mode?
In the prior version of 'tensorflow-metal', I had to disable Eager Mode for the GPU to run:
tf.compat.v1.enable_v2_behavior()
from tensorflow.python.framework.ops import disable_eager_execution
disable_eager_execution()
You can find the notebook in the notebook directory in this repository:
https://github.com/ddangelov/Top2Vec
I installed MacOS 12.0 Beta and attempted to train the model with tensorflow_macos and tensorflow_metal 2.6.
Training the model consumed ~110GB DRAM before I killed the kernel (the iMac has 128GB).
I tried reducing the number of input rows in the training set to: 18806 rows × 5 columns,
but it still runs out of memory.
Also, I can't tell from the Activity monitor whether the GPU is running.
I tried the previous versions of 'tensorflow-macos' and 'tensorflow-metal' and they also had issues:
E.g
https://developer.apple.com/forums/thread/691339
Did you happen to measure the performance difference between CPU and GPU with the SDG optimizer? Was the CPU 4X faster?
I'm getting some results with the 'Adagrad' optimizer.
At epoch 57:
Epoch 58/100
6332/6332 [==============================] - 1621s 256ms/step - d_loss: 0.6239 - g_loss: 0.8338
Epoch 59/100
1342/6332 [=====>........................] - ETA: 21:07 - d_loss: 0.6044 - g_loss: 0.8635