We will be adding entropy studies into random numerical/pattern sequences research.
This research sparked my interest as it pertains directly to undersampled data.
Reference 3 points out possible applications of this algorithm:
1. Complexity of dynamics
2. Dimensions of strange attractors
as well as
"rare events statistics"
Reference 3, is actually extremely interesting even outside of theme of study we are doing (random games, random sequences), in fact, NSB Entropy is used by bio-physicist to study "emergence" of intelligent behaviour...
1. The nsb-entropy project is devoted to implementation and practical use of the NSB algorithm for estimation of entropy and related information-theoretic quantities
from undersampled discrete data
2. (Formal paper) Entropy and inference, revisited by Ilya Nemenman, Fariel Shafee, William Bialek
3. (Power Point Presentation) A Bayesian Estimator of Entropies in a Severely Undersampled Regime: Theory and Applications to the Neural Code) by Ilya Nemenman