AForge.NET

  :: AForge.NET Framework :: Articles :: Forums ::

training network with one by one input

The forum is to discuss topics from different artificial intelligence areas, like neural networks, genetic algorithms, machine learning, etc.

training network with one by one input

Postby sleepy_hollow » Fri May 20, 2011 4:10 am

as what title say, is it possible for a neural network do training that provide one by one input

so this what i think, i wanna train a network with one letter input pattern, than summarize the epoch from that. after the network converged, the netwrok will provided with new input pattern, than do training again until all input are trained. the epoch are total from each epoch from each input that tranied, and output pattern will change if there are new input pattern

so is it possible that the network will recognize a character precisely as same as network which provided all input for each epoch
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia

Re: training network with one by one input

Postby andrew.kirillov » Fri May 20, 2011 11:12 am

sleepy_hollow wrote:i wanna train a network with one letter input pattern, than summarize the epoch from that. after the network converged, the netwrok will provided with new input pattern, than do training again until all input are trained.

So on the second phase you will provide only second character to the network and the first (which was used previously) will not be provided to the network any more. Am I right? If so, the answer is NO - feed forward network with Error Back Propagation learning algorithm will not help you. You should have all the data, which is supposed to be used for training.

However, you can use 1 character on the first phase, keep it in your database and then when you get another one, you can use 2 characters to update your network (so you don’t need to teach network from random weights). However, you will need to create network of proper size/structure from the very beginning.
With best regards,
Andrew


Interested in supporting AForge.NET Framework?
User avatar
andrew.kirillov
Site Admin, AForge.NET Developer
 
Posts: 3451
Joined: Fri Jan 23, 2009 9:12 am
Location: UK

Re: training network with one by one input

Postby sleepy_hollow » Wed May 25, 2011 4:14 pm

However, you can use 1 character on the first phase, keep it in your database and then when you get another one, you can use 2 characters to update your network (so you don’t need to teach network from random weights). However, you will need to create network of proper size/structure from the very beginning.


is the save method does save to database?
if it doesn't, so how to save it in to a database?
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia

Re: training network with one by one input

Postby andrew.kirillov » Wed May 25, 2011 8:34 pm

sleepy_hollow wrote:is the save method does save to database?

Save() method saves the network - nothing else. I hope it is clear from documentation.

sleepy_hollow wrote:if it doesn't, so how to save it in to a database?

It is up to you to decide what is your DB engine and how you save data. Text file, XML file, some custom file format, SQL database, whatever else you may want. This has nothing to do with neural networks and is totally application's part.
With best regards,
Andrew


Interested in supporting AForge.NET Framework?
User avatar
andrew.kirillov
Site Admin, AForge.NET Developer
 
Posts: 3451
Joined: Fri Jan 23, 2009 9:12 am
Location: UK

Re: training network with one by one input

Postby sleepy_hollow » Mon May 30, 2011 7:32 am

i still confused how to insert multiple binary images and then convert it into vector input as inputs to train it in a network teacher at same time
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia

Re: training network with one by one input

Postby sleepy_hollow » Tue Jun 07, 2011 2:47 pm

since i found a way to insert all inputs, now i had a question
if i had 36 character and each character had 10 varaints, and output patterns are 36 and i use backpropagation teacher in aforge library

so, should i divide my error value?
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia

Re: training network with one by one input

Postby andrew.kirillov » Tue Jun 07, 2011 3:31 pm

Most probably the answer to your question can be found here: RunEpoch(). The it is up to you to decide if you want to divide it or not.
With best regards,
Andrew


Interested in supporting AForge.NET Framework?
User avatar
andrew.kirillov
Site Admin, AForge.NET Developer
 
Posts: 3451
Joined: Fri Jan 23, 2009 9:12 am
Location: UK

Re: training network with one by one input

Postby sleepy_hollow » Thu Jun 16, 2011 4:01 am

there are another problem again

when i train my network with error doesn't divided, the error values stack at some range point

when training starts and epoch 0, the error values are 9000++, when the error values hit at 958 point and epoch are 10.000++, it will decrease 957 when epoch reach further and more further epoch it'll back to 958 point again and will decrease again when epoch reach more further

so what's wrong? i've tried to researh with alfa values
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia

Re: training network with one by one input

Postby andrew.kirillov » Thu Jun 16, 2011 8:18 am

But what do you expect? Do you want to get 0 error? You will never get it. Do you want to get error which is always decreasing? Also hardly possible. Sometime it may slightly jump up.
With best regards,
Andrew


Interested in supporting AForge.NET Framework?
User avatar
andrew.kirillov
Site Admin, AForge.NET Developer
 
Posts: 3451
Joined: Fri Jan 23, 2009 9:12 am
Location: UK

Re: training network with one by one input

Postby sleepy_hollow » Fri Jun 17, 2011 3:09 am

i expect that error would decreased until reach my error limitation and be converged, but it never reach it while i use so many pair of data on it
when it just one pair data, it would reach my error limit not so long
sleepy_hollow
 
Posts: 23
Joined: Fri Jan 21, 2011 12:40 pm
Location: indonesia



Next

Return to Artificial Intelligence