I have done part of my project. And now have algorithm what produce data sets from pile of data. By the way, it work on different way from NN. And for work don't ask really "big data" for analyse. Also i have no resources for work with "big data", because have only 1 old server, what i bought used from ebay. :)
For example. With MNIST dataset, 600 sets (10% from whole set) enough for recognize about 94% other sets.
If you have some data, we can try use it and see how it will work.
Sorry for delay.
The algorithm itself works quite simply.
Imagine that we have data represented as a set of vectors. Each new vector is compared with the whole existing ‘forest’ of vectors and becomes a part of the forest itself. In this case, each individual vector can be restored back without loss. As a result of the work, we get a list of all parts (a set of elements in the vector) that we already have in the forest with link to other vectors that have the same part.
For example, if we take a data set with handwritten figures. Then as the result of the algorithm, we get the sets that will be common to all digits, the sets that will be common only to, for example, the digit 5, and these set will play a key role in its recognition.
Unlike neural networks, we can pull out and look at the composition of each set and assign a marker to it. The number of markers is not limited. Markers can be either specific signs or vectors as a whole.
Thanks for your reply!
I still don't understand completely what is the "set" and what is the "pile", in your example with MNIST? Also, does your algorithm have any advantages before the well-known (not NN) basic ML algorithms that Andrew Ng used in his Coursera course?
Thanks!
Set is collection of distinct objects. in MNIST is sets of pixels.
Pile is just a dataset.
How i know, my algorithm is new. Сlassical mathematics considers this direction impossible and does not consider because of the theoretical "Combinatorial explosion".
I have couple publication about my model.
here is first part
https://becominghuman.ai/theoretical-neuroscience-7975868b4566
and here is second
https://becominghuman.ai/theoretical-neuroscience-dd4d95631992
Thanks, I will read your articles, this is very interesting :) I will probably ask more questions later.
Any questions welcome. :)