A simple alphabet-independent FM-index

Szymon Grabowski, Gonzalo Navarro, Rafal Przywarski, Alejandro Salinger, Veli Mäkinen

Tutkimustuotos: ArtikkelijulkaisuArtikkeliTieteellinenvertaisarvioitu

Abstrakti

We design a succinct full-text index based on the idea of Huffman-compressing the text and then applying the Burrows-Wheeler transform over it. The resulting structure can be searched as an FM-index, with the benefit of removing the sharp dependence on the alphabet size, sigma, present in that structure. On a text of length n with zero-order entropy H-0, our index needs O(n(H-0 + 1)) bits of space, without any significant dependence on or. The average search time for a pattern of length m is O(m(H-0 + 1)), under reasonable assumptions. Each position of a text occurrence can be located in worst case time O((H-0 + 1) log n), while any text substring of length L can be retrieved in O((H-0 + 1)L) average time in addition to the previous worst case time. Our index provides a relevant space/time tradeoff between existing succinct data structures, with the additional interest of being easy to implement. We also explore other coding variants alternative to Huffman and exploit their synchronization properties. Our experimental results on various types of texts show that our indexes are highly competitive in the space/time tradeoff map.
Alkuperäiskielienglanti
LehtiInternational Journal of Foundations of Computer Science
Vuosikerta17
Numero6
Sivut1365-1384
Sivumäärä20
ISSN0129-0541
DOI - pysyväislinkit
TilaJulkaistu - 2006
OKM-julkaisutyyppiA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä, vertaisarvioitu

Tieteenalat

  • 113 Tietojenkäsittely- ja informaatiotieteet

Siteeraa tätä