On the inconsistency of ℓ1-penalised sparse precision matrix estimation

Otte Heinävaara, Janne Leppä-Aho, Jukka Corander, Antti Honkela

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Background: Various l(1)-penalised estimation methods such as graphical lasso and CLIME are widely used for sparse precision matrix estimation and learning of undirected network structure from data. Many of these methods have been shown to be consistent under various quantitative assumptions about the underlying true covariance matrix. Intuitively, these conditions are related to situations where the penalty term will dominate the optimisation.

Results: We explore the consistency of l(1)-based methods for a class of bipartite graphs motivated by the structure of models commonly used for gene regulatory networks. We show that all l(1)-based methods fail dramatically for models with nearly linear dependencies between the variables. We also study the consistency on models derived from real gene expression data and note that the assumptions needed for consistency never hold even for modest sized gene networks and l(1)-based methods also become unreliable in practice for larger networks.

Conclusions: Our results demonstrate that l(1)-penalised undirected network structure learning methods are unable to reliably learn many sparse bipartite graph structures, which arise often in gene expression data. Users of such methods should be aware of the consistency criteria of the methods and check if they are likely to be met in their application of interest.
Original languageEnglish
JournalBMC Bioinformatics
Volume17
Issue numberSuppl 16
Pages (from-to)99-107
Number of pages9
ISSN1471-2105
DOIs
Publication statusPublished - 13 Dec 2016
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 112 Statistics and probability
  • 113 Computer and information sciences

Cite this