Comments (11)
Maybe it worths to re-use similar storage_config
like we did in train
API..
E.g. we can name it as: trial_storage_config
.
Any other suggestions are welcome!
Any thoughts @tenzen-y @droctothorpe @johnugeorge @bwhartlove ?
/help
/good-first-issue
from katib.
You can specify the volume mounts via create_experiment
API.
from katib.
Thanks for the info! In order to do this, do I need to write a YAML spec? I have not found any examples online about mounting an existing secret into the experiment trial pods. From what I can discern given the documentation, I would need to write a TrialSpec
YAML to achieve this. I was hoping to have the ability to simply specify a volume mount directly in the experiment creation function.
from katib.
Thanks for the info! In order to do this, do I need to write a YAML spec?
Yes, we need to write the Experiment YAML spec.
I was hoping to have the ability to simply specify a volume mount directly in the experiment creation function.
I see. It might be useful to be available to specify the volume configuration via the tune
API:
@johnugeorge @andreyvelich WDYT?
from katib.
@bwhartlove You can check this example on how to use create_experiment()
API which gives you access to all Experiment and Trial Spec: https://github.com/kubeflow/katib/blob/master/examples/v1beta1/sdk/cmaes-and-resume-policies.ipynb
If you need to set volume mount for your Trials, you can add it to the trial_spec
field.
If we want to provide simple argument in the tune
function to add volume mounts, do you have any ideas how we should do it ?
That should be very simple for user to understand without prior knowledge of Kubernetes Pod specs.
For example, for Trial environments user can set it via dictionary or as Kubernetes V1EnvFromSource
parameter.
cc @droctothorpe
from katib.
@andreyvelich Thanks for the reply and the information. I can't say I am familiar enough with the underlying architecture to provide a clear solution to the issue. I just imagined having another parameter to the tune
function that allowed you to specify volumes for the trial pods. Kubeflow has an API for this with their pipelines, and it would be nice to have a similar function in Katib.
from katib.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
from katib.
@andreyvelich:
This request has been marked as suitable for new contributors.
Please ensure the request meets the requirements listed here.
If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue
command.
In response to this:
Maybe it worths to re-use similar
storage_config
like we did intrain
API..
E.g. we can name it as:trial_storage_config
.
Any other suggestions are welcome!Any thoughts @tenzen-y @droctothorpe @johnugeorge @bwhartlove ?
/help
/good-first-issue
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.
from katib.
/area sdk
from katib.
I can help with this issue :)
from katib.
/assign
from katib.
Related Issues (20)
- Update experiment instance status failed: the object has been modified HOT 2
- Update the kubernetes object's status with server-side apply
- Trial fails to be marked as completed after reporting the metrics HOT 2
- Deprecate Skopt Suggestion Service HOT 21
- Define the Python deprecation/supporting policies for the Katib SDK HOT 4
- Whether the hyperparameter search algorithm will refer to the value of additionalMetricNames HOT 11
- Tuning API in Katib for LLMs HOT 4
- Migrate KatibCertGenerator to OPA CertController
- Migrate away from deprecated github.com/hpcloud/tail
- [image] enas-cnn-cifar10-cpu:v0.16.0 does not exist
- feat(rag): Auto-RAG HOT 6
- Return validation errors after all fields are verified HOT 3
- some questions about NAS HOT 3
- Documentation Improvements for Katib 0.17 HOT 2
- Update third party worflows in the gh actions. HOT 2
- [SDK] Support Docker image as objective in the `tune` API HOT 5
- katib use crd as tail template HOT 8
- Tracking Issue: Implementation of Tuning API in Katib for LLMs HOT 1
- [GSoC] Project6: Push-based Metrics Collection for Katib HOT 1
- Issue template "Kubeflow Katib Slack Channel" doesn't prompt you to register/get invited HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from katib.