Skip to main content

IV) Abstractions and judgements

IV) Abstractions and judgements

When the third thing is introduced an abstraction is made.

That moment when a continuous function takes on a discrete shape.  The moment when we utilize a metric, so that instead of saying something is better or worse we say it is in a different category.  That is the moment when we create the idea of the category.  The category provides a framework to describe the abstraction we just made by saying these two things are more similar to each other than to a third thing.

It is also the moment when we lose something, we go from an infinite potential to a specific realization.  We make a judgement call.

https://ashlag-cause-and-kook-affect.blogspot.com/2018/12/being-judgmental-is-necessary-for.html

Abstractions are both the key element in learning and the realization of a judgement, a phase transition.   I want to define learning, as opposed to memorization and prediction, as a method for creating a model.  A model is a compact representation of the data, all those observations which hopefully are too numerous to remember.  Our relatively small memory and our need to communicate efficiently forces us to create abstractions.

Way back when a bit after we sold Mobilee to NMS Communications, I found myself without a job and not sure what to do.  I was sitting with Zvi Wolicki at his house when Daniel Swirksy came in, we talked briefly and the next thing I knew I was working for Daniel as a patent liaison.

Crafting patents was about finding the perfect new word.  You need to find a new word, because you need to prove that the idea is a new creation.  And in a patent the best way to prove an idea is with a word.

Creativity and naming go hand in hand, more on that later when we get to semiotics.  But for now lets enjoy the creative speech act and be aware when people throw more data at us without creating abstraction to communicate more efficiently.

So, here are some examples of poor communication skill without efficient use of language.  Look for an overly long description.  A good communication builds on itself.  A good scientific proposal introduces a new term, defines it and then employs that term to communicate.

Look for people adding more and more low level data without providing abstractions.  For example: please pass the object, in the container, that is on the left, made out of silver as opposed to please pass the salt shaker.  Note how not only is the first phrase long (large minimum description length MDL), but it includes multiple dimensions -- position (left), material (silver).  While the second phrase employs a nice fancy word, that provides a higher level semantic.


Comments

Popular posts from this blog

V) How do we know we made a reasonable judgement?

V) How do we know we made a reasonable judgement? I was by my brother in NY, on my way to the airport, and I spotted a book by Umberto Eco on information and open systems.  I borrowed the book (and still have it -- sorry Jacob),  just on the whim that I would enjoy more Eco in my life.  I discovered much more, the book is Eco's earlier writing, semiotics mixed with art and science, and has had a profound affect on me.  Eco makes the argument that Shannon's description of information, a measure of the communicability of a message, provides for a measure of art. If it helps think about 'On Interpretation' by Susan Sontag, experience art without interpreting it.  There is no message not even one that we the viewer creates.   There is no meaning to be had, just an experience.  The flip side of this argument is that when there is interpretation there is meaning.  This view, proposed by Semiotics, states that when two closed systems meet and are ...

0.0 Introduction to advanced concepts in AI and Machine Learning

Introduction to advanced concepts in AI and Machine Learning I created a set of short videos and blog posts to introduce some advanced ideas in AI and Machine Learning.  It is easier for me to think about them as I met them, chronologically in my life, but I may revisit the ideas later from a different perspective. I also noticed that one of things I am doing is utilising slightly off-centre tools to describe an idea.  So for example, I employ Kohonen Feature Maps to describe embeddings.  I think I gain a couple of things this way, first it is a different perspective than most people are used to.  In addition, well you will see :-) I recommend first opening the blog entry (as per the links below), then concurrently watching the linked video. Hope you enjoy these as much as I did putting them together, David Here are links: https://data-information-meaning.blogspot.com/2020/12/memorization-learning-and-classification.html https://data-information-meaning.blogspot.com/...

III) Metrics

III) Metrics One of these things is not like the other -- but two of these things are distant from a third. I grew up with Brisk Torah, more specifically my father was a Talmid of Rabbi Joseph Soloveichik and dialectic thinking was part and parcel of our discussions.  Two things, two dinim, the rhythm in the flow between two things.  Dialectics not dichotomies.  The idea espoused by the Rambam in his description of Love and Awe, mutually exclusive, we travel between them. Why create duality?  Dialectics or dichotomies provide a powerful tool, but what is it that tool? What is the challenge? I think the Rabbinic language might be נתת דברך לשיעורים, 'your words are given to degrees', the idea being that without clear definitions we are left with vague language, something is more than something else, ok, but how much more? This I think is the reasoning for the first of the twenty one questions I was taught by my father's mother, 'is it bigger than a breadbox?',...