Comments (4)
Hello mmuratarat,
Hi,
I've worked on Adanet framework upon RNN type network (Simple RNN, LSTM and GRU).
In order to train mixture weights, Adanet may use logits or last layer from subnetwork candidates.
Then I force Adanet to use logits rather then last layer in creating Adanet Estimator with instructions :
from adanet.ensemble import MixtureWeightType
from adanet.ensemble.weighted import ComplexityRegularizedEnsembler
ensembler = ComplexityRegularizedEnsembler(mixture_weight_type=mixture_weight_type, adanet_lambda=1.e-3)
list_ensembler = [ensembler]
adanet_estimator = adanet.Estimator(
ensemblers = [ensembler],
max_iteration_steps=500,
subnetwork_generator = ...,
head = ...,
config= ...,
evaluator=adanet.Evaluator(
input_fn=...,
steps=None))
....
results, _ = tf.estimator.train_and_evaluate(adanet_estimator, train_spec, eval_spec)
Hope this will help
from adanet.
@mmuratarat: We've successfully train all kinds of RNNs with different cells like lstm
, cudnn_lstm
, and gru
. Like @dataforcast mentions, you will need to create a custom adanet.subnetwork.Generator
and adanet.subnetwork.Builder
subclasses that use tf.nn.dynamic_rnn()
. You can look at SimpleDNN for inspiration.
from adanet.
Hello! I'm a green hand in adanet. Would you please tell me if I have to build the LSTM model myself rather than using the LSTM API provided in kereas or tensorflow when using adanet? If so, would you please give an example about using LSTM with adanet(the sample you use for test RNN). Thank you very much.
from adanet.
@tx2010011751 You should be able to use the tf.contrib.estimator.RNNEstimator with adanet.AutoEnsembleEstimator
if you want to try ensembling RNN models.
As a first step, try getting tf.contrib.estimator.RNNEstimator
to train on its own, and next try it in adanet.
from adanet.
Related Issues (20)
- `input_fn` called multiple times in `Estimator.train` HOT 5
- relation to AutoML tables in GCP HOT 2
- Question regarding architecture HOT 3
- adanet.ensemble.Ensembler not used in Tutorials? HOT 5
- Adding different loss to tf.estimator.Head HOT 2
- Correct place to add custom metric_fn? HOT 3
- Early stopping 'best-practice' using Adanet
- Interpretation of serialized "architecture_summary" HOT 2
- simple_dnn should not work !
- [Bug] AutoEnsembleEstimator() cannot be instatiated if tf< 2.x HOT 1
- I am having errors and do not know what to do... HOT 1
- Evaluation issue using TPUEstimator HOT 2
- RuntimeError with adanet_tpu tutorial using TF2.2 and Adanet 0.9.0
- AttributeError: module 'adanet' has no attribute 'AutoEnsembleEstimator'
- Is there any code to compute FLOPs and parameter size of adanet?
- Error on running tutorial notebook in Google colab
- Using AdaNet ModelFlow with pre-trained models HOT 1
- Got `AttributeError: 'NoneType' object has no attribute 'logits'` error while applying tutorial
- Is this repository deprecated? HOT 1
- Design suggestions of _IterationBuilder._best_loss from adanet.core.iteration
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from adanet.