is it possible to train a Dynamic/Recurrent neural network with Ensemble Method?

Asked by mohad on 5 Jul 2012
Latest activity Commented on by Greg Heath on 17 Jul 2012

i want implementation y(k)=a1 y(k-1)+ b1*u, and u is initiate value.

how learn a1 and b1. is it possible ?

4 Comments

Greg Heath on 7 Jul 2012

What do you mean by "ensemble" method?

G.

mohad on 7 Jul 2012

when k=0 we have y(0)= b1* u my professor said me how learn a1 and b1 with ensmeble ?

i think we can train system with Dynomic Network, and i dont know how use Ensemble

Greg Heath on 7 Jul 2012

You didn't explain the term "ensemble". Does it mean the weighted average output of a number of nets that are trained from different random initial weights?

mohad

Products

No products are associated with this question.

3 Answers

Answer by Greg Heath on 12 Jul 2012
Accepted answer

The documentation in

help fitensemble

doc fitensemble

lists the methods of regression and classification for which this function is applicable. Neural Networks are not mentioned in the list.

However, this does not mean that you cannot form an ensemble by combining the outputs from a number of NNs.

In my experience, simple linear combinations of multiple designs have been very successful. The success results from the "strong learner" capability of NNs.

The differences between designs tend (but are not limited) to be

1. Design (Train + Validation) data subsets

2. Number of hidden nodes

3. Type of hidden node activations (e.g., sigmoidal and Gaussian)

4. Random initial weights

In addition, the function stagewisefit can be used to identify nets whose removable will not significantly decrease performance.

Hope this helps.

Greg

0 Comments

Greg Heath
Answer by mohad on 11 Jul 2012

i want to just know is it possible work with neural network and Ensemble ? does Ensmeble such az MEthod of Neural ? and how work with neural and Ensemble?

example of matlab we have::

load carsmall

X = [Horsepower Weight];

ens = fitensemble(X,MPG,'LSBoost',100,'Tree');

mileage = ens.predict([150 2750])

mileage = 22.6735

1 Comment

Greg Heath on 11 Jul 2012

You still haven't explained what you mean by "Ensemble"

mohad
Answer by mohad on 14 Jul 2012

many tnx . i think ensemble is not Leaner just decide. at first i train system with Recurent or dynomic network such as narxnet then out put pass to Ensmeble and Ensmeble Vote best answer. is it true ?

i Read apeper "A new boosting algorithm for improved time-series forecasting with recurrent neural networks" that Work such this. tnxx

1 Comment

Greg Heath on 17 Jul 2012

Not true.

How does the ensemble know which answer is best?

mohad

Contact us