Welcome Guest
( Log In | Register )
The time is now 8:14 pm
You last visited January 18, 2017, 7:05 pm
All times shown are
Eastern Time (GMT-5:00)

NSB Entropy Estimation and related information theoretic quantities from undersampled discrete data


Last Edited: July 16, 2009, 12:13 am

We will be adding entropy studies into random numerical/pattern sequences research.

This research sparked my interest as it pertains directly to undersampled data.

Reference 3 points out possible applications of this algorithm:

Dynamical systems

1. Complexity of dynamics
2. Dimensions of strange attractors

as well as

"rare events statistics"

Reference 3, is actually extremely interesting even outside of theme of study we are doing (random games, random sequences), in fact, NSB Entropy is used by bio-physicist to study "emergence" of intelligent behaviour...


1. The nsb-entropy project is devoted to implementation and practical use of the NSB algorithm for estimation of entropy and related information-theoretic quantities
from undersampled discrete data


2. (Formal paper) Entropy and inference, revisited by Ilya Nemenman, Fariel Shafee, William Bialek


3. (Power Point Presentation) A Bayesian Estimator of Entropies in a Severely Undersampled Regime: Theory and Applications to the Neural Code) by Ilya Nemenman


Entry #24


This Blog entry currently has no comments.

You must be a Lottery Post member to post comments to a Blog.

Register for a FREE membership, or if you're already a member please Log In.