Proactive Information Retrieval via Screen Surveillance

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

Kuvaus

We demonstrate proactive information retrieval via screen surveillance. A user's digital activities are continuously monitored by capturing all content on a user's screen using optical character recognition. This includes all applications and services being exploited and relies on each individual user's computer usage, such as their Web browsing, emails, instant messaging, and word processing. Topic modeling is then applied to detect the user's topical activity context to retrieve information. We demonstrate a system that proactively retrieves information from a user's activity history being observed on the screen when the user is performing unseen activities on a personal computer. We report an evaluation with ten participants that shows high user satisfaction and retrieval effectiveness. Our demonstration and experimental results show that surveillance of a user's screen can be used to build an extremely rich model of a user's digital activities across application boundaries and enable effective proactive information retrieval.
Alkuperäiskielienglanti
OtsikkoSIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
Sivumäärä4
JulkaisupaikkaNew York
KustantajaACM
Julkaisupäivä7 elokuuta 2017
Sivut1313-1316
ISBN (painettu)978-1-4503-5022-8
DOI - pysyväislinkit
TilaJulkaistu - 7 elokuuta 2017
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational ACM SIGIR Conference on Research and Development in Information Retrieval - Tokyo, Japani
Kesto: 7 elokuuta 201711 elokuuta 2017
Konferenssinumero: 40

Tieteenalat

  • 113 Tietojenkäsittely- ja informaatiotieteet

Lainaa tätä

Vuong, T., Jacucci, G., & Ruotsalo, T. (2017). Proactive Information Retrieval via Screen Surveillance. teoksessa SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (Sivut 1313-1316). New York: ACM. https://doi.org/10.1145/3077136.3084151
Vuong, Tung ; Jacucci, Giulio ; Ruotsalo, Tuukka. / Proactive Information Retrieval via Screen Surveillance. SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York : ACM, 2017. Sivut 1313-1316
@inproceedings{1a3d2a67dcc348e8beb58c9c16f079e0,
title = "Proactive Information Retrieval via Screen Surveillance",
abstract = "We demonstrate proactive information retrieval via screen surveillance. A user's digital activities are continuously monitored by capturing all content on a user's screen using optical character recognition. This includes all applications and services being exploited and relies on each individual user's computer usage, such as their Web browsing, emails, instant messaging, and word processing. Topic modeling is then applied to detect the user's topical activity context to retrieve information. We demonstrate a system that proactively retrieves information from a user's activity history being observed on the screen when the user is performing unseen activities on a personal computer. We report an evaluation with ten participants that shows high user satisfaction and retrieval effectiveness. Our demonstration and experimental results show that surveillance of a user's screen can be used to build an extremely rich model of a user's digital activities across application boundaries and enable effective proactive information retrieval.",
keywords = "113 Computer and information sciences",
author = "Tung Vuong and Giulio Jacucci and Tuukka Ruotsalo",
year = "2017",
month = "8",
day = "7",
doi = "10.1145/3077136.3084151",
language = "English",
isbn = "978-1-4503-5022-8",
pages = "1313--1316",
booktitle = "SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval",
publisher = "ACM",
address = "United States",

}

Vuong, T, Jacucci, G & Ruotsalo, T 2017, Proactive Information Retrieval via Screen Surveillance. julkaisussa SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, Sivut 1313-1316, International ACM SIGIR Conference on Research and Development in Information Retrieval, Tokyo, Japani, 07/08/2017. https://doi.org/10.1145/3077136.3084151

Proactive Information Retrieval via Screen Surveillance. / Vuong, Tung; Jacucci, Giulio; Ruotsalo, Tuukka.

SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York : ACM, 2017. s. 1313-1316.

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

TY - GEN

T1 - Proactive Information Retrieval via Screen Surveillance

AU - Vuong, Tung

AU - Jacucci, Giulio

AU - Ruotsalo, Tuukka

PY - 2017/8/7

Y1 - 2017/8/7

N2 - We demonstrate proactive information retrieval via screen surveillance. A user's digital activities are continuously monitored by capturing all content on a user's screen using optical character recognition. This includes all applications and services being exploited and relies on each individual user's computer usage, such as their Web browsing, emails, instant messaging, and word processing. Topic modeling is then applied to detect the user's topical activity context to retrieve information. We demonstrate a system that proactively retrieves information from a user's activity history being observed on the screen when the user is performing unseen activities on a personal computer. We report an evaluation with ten participants that shows high user satisfaction and retrieval effectiveness. Our demonstration and experimental results show that surveillance of a user's screen can be used to build an extremely rich model of a user's digital activities across application boundaries and enable effective proactive information retrieval.

AB - We demonstrate proactive information retrieval via screen surveillance. A user's digital activities are continuously monitored by capturing all content on a user's screen using optical character recognition. This includes all applications and services being exploited and relies on each individual user's computer usage, such as their Web browsing, emails, instant messaging, and word processing. Topic modeling is then applied to detect the user's topical activity context to retrieve information. We demonstrate a system that proactively retrieves information from a user's activity history being observed on the screen when the user is performing unseen activities on a personal computer. We report an evaluation with ten participants that shows high user satisfaction and retrieval effectiveness. Our demonstration and experimental results show that surveillance of a user's screen can be used to build an extremely rich model of a user's digital activities across application boundaries and enable effective proactive information retrieval.

KW - 113 Computer and information sciences

U2 - 10.1145/3077136.3084151

DO - 10.1145/3077136.3084151

M3 - Conference contribution

SN - 978-1-4503-5022-8

SP - 1313

EP - 1316

BT - SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

PB - ACM

CY - New York

ER -

Vuong T, Jacucci G, Ruotsalo T. Proactive Information Retrieval via Screen Surveillance. julkaisussa SIGIR '17 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM. 2017. s. 1313-1316 https://doi.org/10.1145/3077136.3084151