Welcome Guest
Log In | Register )
You last visited December 10, 2016, 2:31 am
All times shown are
Eastern Time (GMT-5:00)

Forward-Backward Algorithms

Topic closed. 3 replies. Last post 8 years ago by KnuckleHead.

Page 1 of 1
KnuckleHead's avatar - box

United States
Member #73037
April 3, 2009
147 Posts
Posted: May 22, 2009, 10:28 am - IP Logged

Good morning all.

I did a search on the site for "forward-backward algorithm" and came up empty.

Has anyone attempted to implement a "forward-backward" algorithm to search for picks? If so, would you be kind enough to point me in the proper direction.

If not, could it be done? What are your thoughts on getting accruate picks? How diffuclt would it be to implement?

Any interest/suggestions on this topic would be greatly appreaciated since I'm only just becoming interested in the idea.

          The only DUMB question is the one question you DID NOT ask...

    Raven62's avatar - binary
    New Jersey
    United States
    Member #17843
    June 28, 2005
    49813 Posts
    Posted: May 22, 2009, 11:31 am - IP Logged

    In computer science, the forward-backward algorithm is an algorithm for computing the probability of a particular observation sequence. It operates in the context of hidden Markov models.

    The algorithm comprises three steps:
    1. computing forward probabilities
    2. computing backward probabilities
    3. computing smoothed values

    The forward and backward steps are often called "forward message pass" and "backward message pass". The wording originates from the way the algorithm processes the given observation sequence. First the algorithm moves forward starting with the first observation in the sequence and going to the last, and then returning back to the first. At each single observation in the sequence probabilities to be used for calculations at the next observation are computed. During the backward pass the algorithm simultaneously performs the smoothing step. This step allows the algorithm to take into account any past observations of output for computing more accurate results.


    The Viterbi algorithm is a dynamic programming algorithm for finding the most likely sequence of hidden states "called the Viterbi path" that results in a sequence of observed events, especially in the context of Markov information sources, and more generally, hidden Markov models. The forward algorithm is a closely related algorithm for computing the probability of a sequence of observed events. These algorithms belong to the realm of information theory.

    The algorithm makes a number of assumptions.
    1. Both the observed events and hidden events must be in a sequence. This sequence often corresponds to time.
    2. These two sequences need to be aligned, and an instance of an observed event needs to correspond to exactly one instance of a hidden event.
    3. Computing the most likely hidden sequence up to a certain point t must depend only on the observed event at point t, and the most likely sequence at point t - 1. These assumptions are all satisfied in a first-order hidden Markov model.

    The terms "Viterbi path" and "Viterbi algorithm" are also applied to related dynamic programming algorithms that discover the single most likely explanation for an observation. For example, in statistical parsing a dynamic programming algorithm can be used to discover the single most likely context-free derivation (parse) of a string, which is sometimes called the "Viterbi parse".

    Dynamical systems are mathematical objects used to model physical phenomena whose state (or instantaneous description) changes over time. These models are used in financial and economic forecasting, environmental modeling, medical diagnosis, industrial equipment diagnosis, and a host of other applications.

    For the most part, applications fall into three broad categories:
    1. Predictive (also referred to as generative), in which the objective is to predict future states of the system from observations of the past and present states of the system,
    2. Diagnostic, in which the objective is to infer what possible past states of the system might have led to the present state of the system (or observations leading up to the present state), and, finally,
    3. Applications in which the objective is neither to predict the future nor explain the past but rather to provide a theory for the physical phenomena. These three categories correspond roughly to the need to predict, explain, and understand physical phenomena.

    A mind once stretched by a new idea never returns to its original dimensions!

      Todd's avatar - Cylon 2.gif
      Chief Bottle Washer
      New Jersey
      United States
      Member #1
      May 31, 2000
      23275 Posts
      Posted: May 22, 2009, 12:13 pm - IP Logged

      <Moved to Mathematics forum>

      Please post in the appropriate forum ... thank you.

        KnuckleHead's avatar - box

        United States
        Member #73037
        April 3, 2009
        147 Posts
        Posted: May 24, 2009, 2:33 pm - IP Logged

        Happy Memorial Day to Everyone

        Hello Raven62,

        I had already discovered the site that you directed me to, read through it, and wondered what the possibalities of something like that might be. I also found several other documents on line that refer to the same thing. But, since I don't have the knowledge or computer skills needed, how diffuclt/involved would it be to implement/setup?

        What are your thoughts?

        Does anyone else have any thoughts on this idea?

                  The only DUMB question is the one question you DID NOT ask...