Zero-Cost Metrics

[automl]

Zero-Cost Metrics

[Neonkraft]

Hi @CNSaber,

Thank you for you interest in our project!

You can convert the architecture encoding to the string representation using convert_op_indices_to_str found in naslib\search_spaces\nasbench201\conversions.

Here's a complete snippet to convert the arch to string, and query it's validation accuracy.

from naslib.search_spaces import NasBench201SearchSpace
from naslib.search_spaces.nasbench201.conversions import convert_op_indices_to_str
from naslib.search_spaces.core.query_metrics import Metric
from naslib.utils import get_dataset_api

graph = NasBench201SearchSpace()
graph.set_spec((4, 0, 3, 1, 4, 3))

dataset_api = get_dataset_api(search_space="nasbench201", dataset="cifar10")
val_acc = graph.query(metric=Metric.VAL_ACCURACY, dataset="cifar10", dataset_api=dataset_api)
print(convert_op_indices_to_str(graph.get_hash()), val_acc)

Hope this helps!

Best,
Arjun

[Zhenhan-Huang]

Thank you very much for the clarification!