Skip to main content

VI) Scale -- hierarchy and distance metrics

VI) Scale -- hierarchy and distance metrics

Judgements are phase transitions, they bring us to higher levels of representation.

Scale -- hierarchy and distance metrics


I wrote the following:
https://ashlag-cause-and-kook-affect.blogspot.com/2018/10/the-natural-scale-of-thing.html

Here is a snippet:
There can be no metric to measure the distance between two things across levels

Why not?  Well simply:
1. A metric to measure distance between two elements requires that the elements be in the same dimension
2. By comparing two elements at different levels we are reducing the higher dimensional object to the lower dimension, this will collapse the information in the system.

Here is an example:
1. Assuming I want to measure the health benefits of eating a balanced diet.
2. At a high level I can gather data in a three dimensional space, carbs, protein and fat, macro nutrients.
3. I can also gather data at a lower level that is in a higher dimensional space, we can breakdown protein to amino acids.
4. Now, if I want to compare the distance between two peoples diet, and measure their protein consumption.
5. What is the distance between a macro measure of protein and a micro measure of amino acids?
If I were to try, I could randomly/evenly distribute the macro content across all amino acids.
But that would be false.

Comments

Popular posts from this blog

III) Metrics

III) Metrics One of these things is not like the other -- but two of these things are distant from a third. I grew up with Brisk Torah, more specifically my father was a Talmid of Rabbi Joseph Soloveichik and dialectic thinking was part and parcel of our discussions.  Two things, two dinim, the rhythm in the flow between two things.  Dialectics not dichotomies.  The idea espoused by the Rambam in his description of Love and Awe, mutually exclusive, we travel between them. Why create duality?  Dialectics or dichotomies provide a powerful tool, but what is it that tool? What is the challenge? I think the Rabbinic language might be נתת דברך לשיעורים, 'your words are given to degrees', the idea being that without clear definitions we are left with vague language, something is more than something else, ok, but how much more? This I think is the reasoning for the first of the twenty one questions I was taught by my father's mother, 'is it bigger than a breadbox?',...

0.0 Introduction to advanced concepts in AI and Machine Learning

Introduction to advanced concepts in AI and Machine Learning I created a set of short videos and blog posts to introduce some advanced ideas in AI and Machine Learning.  It is easier for me to think about them as I met them, chronologically in my life, but I may revisit the ideas later from a different perspective. I also noticed that one of things I am doing is utilising slightly off-centre tools to describe an idea.  So for example, I employ Kohonen Feature Maps to describe embeddings.  I think I gain a couple of things this way, first it is a different perspective than most people are used to.  In addition, well you will see :-) I recommend first opening the blog entry (as per the links below), then concurrently watching the linked video. Hope you enjoy these as much as I did putting them together, David Here are links: https://data-information-meaning.blogspot.com/2020/12/memorization-learning-and-classification.html https://data-information-meaning.blogspot.com/...

1.55 Multi-scale defines learning

Multi-scale defines learning https://rumble.com/vcexnm-multi-scale-defines-learning-part-1.html https://rumble.com/vcexxw-multi-scale-defines-learning-part-2.html Why have I been so focused on multi-scale data?  Because learning can only occur when there are multiple scales.  Why is that true, is sounds nonsensical, what is the relationship between the scale of a set of data and learning that data.   I need to better define multi-scale systems. A multi-scale system has at least two levels.  Each level has elements.  Yet the elements on each level are different.  How different?  In what way are they different?  Primarily the descriptive language of the elements is different.  The elements on each level describe different attributes. Since each level creates its own descriptive language, two different levels are not able to communicate directly with each other.   Although that is a negative definition I like it.   The p...