keras-nlp insists I use the (buggy) Tensorflow 2.16.1 which does not work with my GPU

[nas-mouti]

keras-nlp insists I use the (buggy) Tensorflow 2.16.1 which does not work with my GPU

[sachinprasadhs]

I was able to detect GPU in the colab GPU vm.

I followed the below list of commands.
Create a fresh environment and try.

!pip install -U keras-nlp
!pip install -U tensorflow

import tensorflow as tf
print(tf.config.list_physical_devices('GPU'))

[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]

If you are still unable to detect GPU, you can close this issue and create a new issue in the TensorFlow repo since it is related to TensorFlow.

[nas-mouti]

Yes it works on Github, I reproduced it as well (see my link). But it doesn't work on my PC.

…

On Thu, Mar 21, 2024, 5:17 PM Sachin Prasad ***@***.***> wrote: I was able to detect GPU in the colab GPU vm. I followed the below list of commands. Create a fresh environment and try. !pip install -U keras-nlp !pip install -U tensorflow import tensorflow as tfprint(tf.config.list_physical_devices('GPU')) [PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')] If you are still unable to detect GPU, you can close this issue and create a new issue in the TensorFlow repo since it is related to TensorFlow. — Reply to this email directly, view it on GitHub <#1519 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMES55VEMZIVRJMVFWZIXKDYZNE5DAVCNFSM6AAAAABFCD5KAGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJTG42TGNJWG4> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[sachinprasadhs]

You link is localhost runtime, we can't access it.

[nas-mouti]

My apologies, I'm not very familiar with colab. I'll update the post. Here's the updated link: https://colab.research.google.com/drive/1BIQpgHH_Ri7HzXIykt34cRDEQ9-Yodv1?usp=sharing

…

On Thu, Mar 21, 2024, 6:25 PM Sachin Prasad ***@***.***> wrote: You link is localhost runtime, we can't access it. — Reply to this email directly, view it on GitHub <#1519 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMES55UG5P7GAPCRBC2FQO3YZNM5LAVCNFSM6AAAAABFCD5KAGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJTHE2TMNRVHA> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[sachinprasadhs]

I can see Num GPUs Available: 1 in your colab, what is the issue again?

[nas-mouti]

That's just a colab I made because the guidelines asked me to. I'm trying to run this on my own PC, not the colab.

…

On Thu, Mar 21, 2024, 7:12 PM Sachin Prasad ***@***.***> wrote: I can see Num GPUs Available: 1 in your colab, what is the issue again? — Reply to this email directly, view it on GitHub <#1519 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AMES55TC22OZRSEQIUTCPULYZNSNNAVCNFSM6AAAAABFCD5KAGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJUGAYTQNRUGE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[sachinprasadhs]

Got it, Looks like this is the TensorFlow issue for the specific OS.
You can create a new issue in TensorFlow and link this issue for context.

[arsenstonelab]

I think it would be nice if keras-nlp was usable by older tensorflow versions, as 2.16.1 version has several bugs in it, and keras-nlp seems to be compatible with tf 2.15

[sachinprasadhs]

We always try to match the latest TensorFlow version during the time of release, it's the same practice we follow for Keras-Cv as well.
Moreover, TensorFlow 2.16.1 uses Keras 3 as a backend unlike 2.15 version which uses Keras 2 as a backend.

[mattdangerw]

@arsenstonelab thanks for the issue. This is indeed a bit of a rough edge. The issue is actually with tensorflow-text most likely. keras-nlp is unopinionated about tensorflow versions in our package setup, but if you install keras-nlp it will try to install tensorflow-text (the latest version if none is installed). Which in turn will try to install the latest tensorflow version. Which can lead to a big upgrade of tensorflow.

One option is to pin the tf version you want during install for both tensorflow-text and tensorflow. E.g. this works for installing keras-nlp with tf 2.15.
pip install keras-nlp tensorflow-text~=2.15.0 tensorflow~=2.15.0

Does that work for you?

[github-actions]

This issue is stale because it has been open for 14 days with no activity. It will be closed if no further activity occurs. Thank you.