0 votes
1 view
in AI and Deep Learning by (28.9k points)

Suppose I have a very big train set so that Matlab hangs while training or there is insufficient memory to hold train set.

Is it possible to split the training set into parts and train the network by parts?

Is it possible to train the network with one sample at a time (one by one)?

1 Answer

0 votes
by (63.8k points)

 Incremental training in MatLab can be implemented

to both static and dynamic networks, although it is more generally used with dynamic networks, such as adaptive filters. You can just manually divide the dataset into batches and train them one after one:

for bn = 1:num_batches

    inputs = <get batch bn inputs>;

    targets = <get batch bn targets>;

    net = train(net, inputs, targets);

end

Though
batch size should be greater than 1, anyway that should reduce memory consumption for training.

For more https://in.mathworks.com/help/deeplearning/ug/neural-network-training-concepts.html;jsessionid=d510f3808184666f0514bfe27e13information refer to the following link:

If you wish to learn about Neural Network then visit this Neural Network Tutorial.

Welcome to Intellipaat Community. Get your technical queries answered by top developers !


Categories

...