Category Archives: Deep Learning

Deep Learning . Training with huge amount of data .PART2
If you read the first part we left at the point that we are goint to build a multi-thread, multiprocesses mechanism. CPU1: reads a big chunk from disk ( 3200 samples ), shuffle it, and insert a memory Buffer ( Queue) CPU2: the second one is the generator that extract a small amount from this…

Deep Learning . Training with huge amount of data .PART1
Performance considerationsI would like to put some consideration about Performance in Keras , in order to obtain the max GPU consideration.What we are going to do , is train a Keras Model.Here the number of images :Now we define a generator used to train in batch of 32 ( can be an other number ),…