Skip to main content

1.1 Memorization, Learning and Classification

By

Memorization, Learning and Classification

https://rumble.com/vbp5su-memorization-learning-and-classification.html

Memorization - Store the contents of a set of observations

Learning - When a constraint is imposed with a requirement to communicate outside the system, then learning occurs, a new representation of the observations is necessary, more efficient, abstractions occur.

Classification - A judgment statement, good/bad, a category is labeled with a quality

While learning provides a better quantity, more efficient representation, classification provides a quality.


Notes:

1. Short term memory is constrained and communicated to long term memory typically at night, most learning occurs at night

2. Maimonidies in the Guide opens with the distinction between truth-falsity vs. good-bad

3. Prof. K. Smith, Human and non-human communication


Comments

Post a Comment

Popular posts from this blog

1.65 Phase transitions, a measure of learning

By
Phase transitions, a measure of learning https://rumble.com/vcj8fk-1.65-phase-transitions-a-measure-of-learning.html Lets compare KMeans to faddc KMeans faddc That was quite dramatic, how did we get there: KMeans faddc Neat right, KMeans spreads its representations equally across the entire dataset, minimising the global loss of information The thing to notice with faddc is that the representation is very stable up to a point, at a certain point there is a dramatic shift in the representation.   Here I graph the derivative energy, the change, the difference between the distortion given each 'k'....
Post a Comment
Read more

0.0 Introduction to advanced concepts in AI and Machine Learning

By
Introduction to advanced concepts in AI and Machine Learning I created a set of short videos and blog posts to introduce some advanced ideas in AI and Machine Learning.  It is easier for me to think about them as I met them, chronologically in my life, but I may revisit the ideas later from a different perspective. I also noticed that one of things I am doing is utilising slightly off-centre tools to describe an idea.  So for example, I employ Kohonen Feature Maps to describe embeddings.  I think I gain a couple of things this way, first it is a different perspective than most people are used to.  In addition, well you will see :-) I recommend first opening the blog entry (as per the links below), then concurrently watching the linked video. Hope you enjoy these as much as I did putting them together, David Here are links: https://data-information-meaning.blogspot.com/2020/12/memorization-learning-and-classification.html https://data-information-meaning.blogspot.com/...
Post a Comment
Read more

1.55 Multi-scale defines learning

By
Multi-scale defines learning https://rumble.com/vcexnm-multi-scale-defines-learning-part-1.html https://rumble.com/vcexxw-multi-scale-defines-learning-part-2.html Why have I been so focused on multi-scale data?  Because learning can only occur when there are multiple scales.  Why is that true, is sounds nonsensical, what is the relationship between the scale of a set of data and learning that data.   I need to better define multi-scale systems. A multi-scale system has at least two levels.  Each level has elements.  Yet the elements on each level are different.  How different?  In what way are they different?  Primarily the descriptive language of the elements is different.  The elements on each level describe different attributes. Since each level creates its own descriptive language, two different levels are not able to communicate directly with each other.   Although that is a negative definition I like it.   The p...
Post a Comment
Read more