densite_idees function implements a non-standard approach to idea density #2
Description
Idea density counts the number of ideas (propositions or ICUs) per N words to determine how dense it is with ideas, optionally over a sliding window. The current function is not counting, but calculating average similarity between embeddings. I understand it's implemented from Ivensky (2019). I would suggest it be renamed to reflect that it's a non-standard approach, as users may be confused if expecting linguistic idea density. Idea density can be computed using the method in CPIDR (Brown et al., 2008).
See also:
- Snowdon, D. A., Kemper, S. J., Mortimer, J. A., Greiner, L. H., Wekstein, D. R., & Markesbery, W. R. (1996). Linguistic ability in early life and cognitive function and Alzheimer’s disease in late life: Findings from the Nun Study. JAMA, 275(7), 528–532.
- Fromm D, Greenhouse J, Hou K, Russell GA, Cai X, Forbes M, Holland A, MacWhinney B. Automated Proposition Density Analysis for Discourse in Aphasia. J Speech Lang Hear Res. 2016 Oct 1;59(5):1123-1132.
- Kairit Sirts, Olivier Piguet & Mark Johnson. (2017). Idea density for predicting Alzheimer’s disease from transcribed speech. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 322–332.
- Harrag, C., Sabil, A., Conceição, M. C., & Radvansky, G. A. (2024). Propositional density: cognitive impairment and aging. Frontiers in Psychology.
- Hill, E., Alty, J., Bartlett, L., Goldberg, L., Park, M., Yeom, S., & Vickers, J. (2021). Automated analysis of propositional idea density in older adults. Cortex, 145, 264–272.
- Ferguson, A., Spencer, E., Craig, H., & Colyvas, K. (2014). Propositional idea density in women's written language over the lifespan: Computerized analysis. Cortex, 55, 107–121.
- Engelman, M., Agree, E. M., Meoni, L. A., & Klag, M. J. (2010). Propositional density and cognitive function in later life: Findings from the Precursors Study. The Journals of Gerontology: Series B, 65B(6), 706–711.