JIPAM logo: Home Link
 
Home Editors Submissions Reviews Volumes RGMIA About Us
 

   
  Volume 7, Issue 2, Article 59
 
Entropy Lower Bounds Related to a Problem of Universal Coding and Prediction

    Authors: Flemming Topsoe,  
    Keywords: Entropy, Index of coincidence, Rényi entropy, Measure of roughness, Universal coding, Universal prediction.  
    Date Received: 18/08/04  
    Date Accepted: 20/03/06  
    Subject Codes:

94A15, 94A17.

 
    Editors: Frank Hansen,  
 
    Abstract:

Second order lower bounds for the entropy function expressed in terms of the index of coincidence are derived. Equivalently, these bounds involve entropy and Rényi entropy of order 2. The constants found either explicitly or implicitly are best possible in a natural sense. The inequalities developed originated with certain problems in universal prediction and coding which are briefly discussed.

         
       
  Download Screen PDF
  Download Print PDF
  Send this article to a friend
  Print this page
 

      search [advanced search] copyright 2003 terms and conditions login