Any guide how to use tools/gemma/run_gemma_xla.py?

[deep-diver]

Any guide how to use tools/gemma/run_gemma_xla.py?

[mattdangerw]

@nkovela1 should know more! gemma is the standalone pytorch version here https://github.com/google/gemma_pytorch/. Which should be clonable, then pip installable, though it is not on PyPI. And you are right! We should document this better.

[mattdangerw]

Neel added some documentation to our scripts. Here's some links to Vertex AI notebooks:

https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/community/model_garden/model_garden_gemma_finetuning_on_vertex.ipynb
https://github.com/GoogleCloudPlatform/vertex-ai-samples/blob/main/notebooks/community/model_garden/model_garden_gemma_deployment_on_vertex.ipynb

[deep-diver]

Thanks! it looks much better.

Just wanted to demystify what hex-llm is and the underlying technology of it :)

[mattdangerw]

I think more docs there coming soon probably! Besides the two I linked above, though I'm not directly involved so I don't know the precise timeline.