[{"id":342358,"last_updated":"2023-12-22 11:05:26","id_people":471258,"institutes":["ILC"],"type":"book_chapter","type_order":2,"type_people":"bookPart","title":"Finger movements and eye movements during adults' silent and oral reading","year":2022,"authors_people":"Crepaldi D., Ferro M., Marzi C., Nadalini A., Pirrelli V., Taxitari L.","authors_cnr":["Nadalini, Andrea","Pirrelli, Vito","Marzi, Claudia","Ferro, Marcello"],"authors_cnr_id":["326","8389","11870"],"authors_cnr_institute":[""],"authors":["Crepaldi, D.","Ferro, M.","Marzi, C.","Nadalini, A.","Pirrelli, V.","Taxitari, L."],"abstract":"Using a common tablet and a web application, we can record the finger movements of a reader that is concurrently reading and finger-pointing a text displayed on the tablet touchscreen. In a preliminary analysis of \"finger-tracking\" data of early-graders we showed that finger movements can replicate established reading effects observed in more controlled settings. Here, we analyse and discuss reading evidence collected by (i) tracking the finger movements of adults reading a short essay displayed on a tablet touchscreen, and (ii) tracking the eye movements of adults reading a comparable text displayed on the screen of a computer. Texts in the two conditions were controlled for linguistic complexity and page layout. In addition, we tested adults' comprehension in both silent and oral reading, by asking them multiple-choice questions after reading each text. We show and discuss the reading evidence that the two (optical and tactile) protocols provide, and to what extent they show comparable effects. We conclude with some remarks on the importance of ecology and portability of protocols for large-scale collection of naturalistic reading data.","keywords":["Reading","finger-tracking","digital technology"],"pages":"443-471","url":"https:\/\/link.springer.com\/book\/9783030998905","volume":"23","doi":"","editors_people":"Levie, R. and Bar-On, A. and Ashkenazi, O. and Dattner, E. and Brandes, G.","editors":["Levie, R.","Bar On, A.","Ashkenazi, O.","Dattner, E.","Brandes, G."],"published":"Developing language and literacy-Studies in Honor of Dorit Diskin Ravid","publisher":"Springer (Dordrecht, NLD)","issn":"","isbn":"978-3-030-99890-5","conference_name":"","conference_place":"","conference_date":""},{"id":132409,"last_updated":"2021-01-25 13:08:14","id_people":441870,"institutes":["IFC","ILC"],"type":"conference_article","type_order":5,"type_people":"conferenceObject","title":"Using mobile technology for reading assessment","year":2021,"authors_people":"Taxitari, L.; Cappa, C.; Ferro, M.; Marzi, C.; Nadalini, A.; Pirrelli, V.","authors_cnr":["Nadalini, Andrea","Taxitari, Loukia","Pirrelli, Vito","Marzi, Claudia","Ferro, Marcello","Cappa, Claudia"],"authors_cnr_id":["326","8389","11870","29386"],"authors_cnr_institute":[""],"authors":["Taxitari, L.","Cappa, C.","Ferro, M.","Marzi, C.","Nadalini, A.","Pirrelli, V."],"abstract":"The enormous potential of Information and Communication Technologies (ICT) for addressing critical educational issues is generally acknowledged, but its use in the assessment of the complex skills of reading and understanding a text has been very limited to date. The paper contrasts traditional reading assessment protocols with ReadLet, an ICT platform with a tablet front-end, designed to support online monitoring of silent and oral reading abilities in early graders. ReadLet makes use of cloud computing and mobile technology for large-scale data collection and allows the time alignment of the child's reading behaviour with texts tagged using Natural Language Processing (NLP) tools. Initial findings replicate established benchmarks from the psycholinguistic literature on reading in both typically and atypically developing children, making the application a new ground-breaking approach in the evaluation of reading skills. Index Terms--reading assessment, reading research, mobile technology, NLP, cloud computing, special education needs.","keywords":["reading assessment","reading research","mobile technology","NLP","cloud computing","special education needs"],"pages":"1-6","url":"http:\/\/www.ieee.ma\/cist20\/component\/content\/?id=26&Itemid=185","volume":"","doi":"","editors_people":"","editors":[""],"published":"","publisher":"","issn":"","isbn":"9781728166469","conference_name":"6th IEEE Congress on Information Science & Technology (IEEE CIST'20)","conference_place":"online","conference_date":"05\/06\/2021"},{"id":132429,"last_updated":"2021-12-14 12:32:11","id_people":445743,"institutes":["ILC"],"type":"conference_misc","type_order":6,"type_people":"conferenceObject","title":"Valutare la lettura \"in tempo reale\": un esempio di integrazione tra linguistica computazionale e linguistica applicata","year":2021,"authors_people":"Marzi C., Taxitari L., Ferro M., Nadalini A., Pirrelli V.","authors_cnr":["Nadalini, Andrea","Taxitari, Loukia","Pirrelli, Vito","Marzi, Claudia","Ferro, Marcello"],"authors_cnr_id":["326","8389","11870"],"authors_cnr_institute":[""],"authors":["Marzi, C.","Taxitari, L.","Ferro, M.","Nadalini, A.","Pirrelli, V."],"abstract":"In anni recenti, linguistica computazionale e linguistica applicata hanno ampliato i loro rispettivi ambiti d'indagine, utilizzando l'ontologia formale della linguistica teorica e i modelli cognitivi della psicolinguistica per studiare le difficolt\u00e0 che i parlanti incontrano nello svolgimento di \"compiti\" linguistici specifici. Nell'ambito della lettura, le tecnologie per il Trattamento Automatico del Linguaggio (TAL) si sono dimostrate capaci di classificare il livello di leggibilit\u00e0 di un testo, basandosi sulla distribuzione di alcuni parametri linguistici in testi pre-classificati per et\u00e0 dei lettori destinatari, o per grado di scolarit\u00e0, o per livello di sviluppo cognitivo. Ad esempio, parole o frasi pi\u00f9 lunghe, o parole pi\u00f9 rare tendono a distribuirsi in testi di pi\u00f9 difficile comprensione, o destinati a lettori pi\u00f9 maturi. E' possibile cos\u00ec assegnare a un testo, o a ogni singola frase, un punteggio di leggibilit\u00e0 in funzione (inversa) della complessit\u00e0 lessicale, morfologica, sintattica o pragmatica dell'unit\u00e0 testuale analizzata. In Linguistica Applicata (LA) la valutazione della difficolt\u00e0 di lettura ha seguito un approccio funzionale. Nel modello semplice di lettura, ad esempio, la capacit\u00e0 di leggere un testo \u00e8 analizzata come il prodotto dell'interazione tra decodifica e comprensione. Attraverso l'osservazione di un campione di bambini impegnati nella lettura, \u00e8 possibile valutare la loro fluenza in decodifica, gli errori di decodifica e comprensione, e l'efficacia di percorsi educativi personalizzati. La piattaforma ReadLet \u00e8 stata sviluppata con l'obiettivo di integrare l'approccio classificatorio del TAL con quello funzionale della LA. Il bambino legge un breve testo visualizzato sullo schermo di un tablet, ad alta voce o in modalit\u00e0 silente. In entrambi i casi, al bambino viene chiesto di \"tenere il segno\" con il dito sullo schermo nel corso della lettura. La traccia tattile \u00e8 registrata e allineata con il testo visualizzato sullo schermo mediante un algoritmo di convoluzione. Al contempo, il testo \u00e8 annotato automaticamente per tratti linguistici. Alla fine della sessione di lettura silente, il bambino risponde ad alcune semplici domande sul contenuto del testo. I dati raccolti consentono di valutare le difficolt\u00e0 (rallentamenti o errori) che il bambino incontra nella lettura, e di mettere in relazione \"in tempo reale\" queste difficolt\u00e0 con aspetti linguistici specifici del testo. Un'analisi preliminare dei dati raccolti da ReadLet su oltre 400 allievi di alcune scuole elementari toscane e della Svizzera italiana, ha evidenziato il differente \"passo\" di lettura tra lettori con sviluppo tipico e atipico, e il peso che variabili come lunghezza, frequenza e lessicalit\u00e0 hanno su profili di lettura individuali e aggregati. La possibilit\u00e0 di \"controllare\" automaticamente la distribuzione di queste variabili nel testo e di correlarle con le difficolt\u00e0 del singolo bambino consente, infine, di somministrare testi con livelli di difficolt\u00e0 gradualmente crescenti, rendendo possibili percorsi personalizzati di potenziamento.","keywords":["reading assessment","reading strategies","NLP","ICT mobile technologies"],"pages":"5-5","url":"https:\/\/publications.cnr.it\/doc\/445743","volume":"2021","doi":"","editors_people":"","editors":[""],"published":"FARE LINGUISTICA APPLICATA CON LE DIGITAL HUMANITIES","publisher":"","issn":"","isbn":"","conference_name":"XXI Congresso Internazionale di AItLA","conference_place":"Bergamo (I)","conference_date":"11-12\/02\/2021"},{"id":132402,"last_updated":"2020-12-15 09:58:13","id_people":438979,"institutes":["ILC"],"type":"conference_article","type_order":5,"type_people":"conferenceObject","title":"Does finger-tracking point to child reading strategies?","year":2020,"authors_people":"Marzi, Claudia; Rodella, Anna; Nadalini, Andrea; Taxitari, Loukia; Pirrelli, Vito","authors_cnr":["Nadalini, Andrea","Taxitari, Loukia","Pirrelli, Vito","Marzi, Claudia"],"authors_cnr_id":["326","8389"],"authors_cnr_institute":[""],"authors":["Marzi, C.","Rodella, A.","Nadalini, A.","Taxitari, L.","Pirrelli, V."],"abstract":"The movement of a child's index finger that points to a printed text while (s)he is reading may provide a proxy for the child's eye movements and attention focus. We validated this correlation by showing a quantitative analysis of patterns of \"finger-tracking\" of Italian early graders engaged in reading a text displayed on a tablet. A web application interfaced with the tablet monitors the reading behaviour by modelling the way the child points to the text while reading. The analysis found significant developmental trends in reading strategies, marking an interesting contrast between typically developing and atypically developing readers.","keywords":["reading assessment","reading strategies","mobile technology","special educiation needs"],"pages":"1-7","url":"http:\/\/ceur-ws.org\/Vol-2769\/paper_60.pdf","volume":"vol-2769","doi":"","editors_people":"Monti, J; Dell'Orletta, F; Tamburini, F","editors":["Monti, J.","Dell'Orletta, F.","Tamburini, F."],"published":"Proceedings of the Seventh Italian Conference on Computational Linguistics","publisher":"CEUR-WS. org (Aachen, DEU)","issn":"1613-0073","isbn":"","conference_name":"Italian Conference on Computational Linguistics 2020","conference_place":"Bologna","conference_date":"1-3\/03\/2021"},{"id":132420,"last_updated":"2021-12-14 12:32:15","id_people":442758,"institutes":["IFC","ILC"],"type":"conference_misc","type_order":6,"type_people":"conferenceObject","title":"Tracking the pace of reading with finger movements","year":2020,"authors_people":"Pirrelli, Vito; Cappa, Claudia; Crepaldi, Davide; Del Pinto, Viola; Ferro, Marcello; Giulivi, Sara; Marzi, Claudia; Nadalini, Andrea; Taxitari, Loukia","authors_cnr":["Nadalini, Andrea","Taxitari, Loukia","Pirrelli, Vito","Marzi, Claudia","Ferro, Marcello","Cappa, Claudia"],"authors_cnr_id":["326","8389","11870","29386"],"authors_cnr_institute":[""],"authors":["Pirrelli, V.","Cappa, C.","Crepaldi, D.","Del Pinto, V.","Ferro, M.","Giulivi, S.","Marzi, C.","Nadalini, A.","Taxitari, L."],"abstract":"Recent experimental evidence in visual perception analysis shows that eye and finger movements strongly correlate during scene exploration, at both individual and group levels. A familiar context which exploits this synergistic behaviour is when children learn to read, with the practice of finger-pointing to text as a support for their attention focus, directional movement and voice-print match. Using a tablet to display short texts, we collected evidence on the finger-pointing behaviour of 3rd-6th Italian graders engaged in both silent and oral reading. \"Finger-tracking\" data, sampled by the tablet and aligned with the text, made it possible to time a child's reading paceat word and sentence level. Results are shown to replicate established benchmarks in the reading literature, such as the difference in reading pace between age-matched typical and atypical readers as a function of word frequency and length, and neighbourhood entropy and Old20. Atypical readers show increasing difficulty with longer words, with a steeper time increment for word length > 6, integrating previous evidence. In addition, neighbourhood density plays a sparse facilitative role in atypical reading, with no significant interaction with neighbourhood entropy, pointing to a non trivial developmental interplay between sublexical reading and the richness of the Italian orthographic-phonological lexicon. Despite their different dynamics, optical and tactile strategies for text exploration prove to be highly congruent: this suggests that finger-tracking can be used as an ecological proxy for eye-tracking in reading assessment.","keywords":["Reading","Finger tracking","Mental Lexicon","Word frequency","Word Length","Neighbourhood entropy"],"pages":"1","url":"https:\/\/osf.io\/hr62g\/","volume":"","doi":"","editors_people":"","editors":[""],"published":"","publisher":"","issn":"","isbn":"","conference_name":"Words in the World International Conference","conference_place":"Montreal (Canada)","conference_date":"16-18\/10\/2020"}]