Estimating text regressions using txtreg

Abstract

In this article, I introduce new commands to estimate text regressions for continuous, binary, and categorical variables based on text strings. The command txtreg_train automatically handles text cleaning, tokenization, model training, and cross-validation for lasso, ridge, elastic-net, and regularized logistic regressions. The txtreg_predict command obtains the predictions from the trained text regression model. Furthermore, the txtreg_analyze command facilitates the analysis of the coefficients of the text regression model. Together, these commands provide a convenient toolbox for researchers to train text regressions. They also allow sharing of pretrained text regression models with other researchers.

Keywords

dm0112 txtreg_train txtreg_predict txtreg_analyze text regressions machine learning text analysis

Get full access to this article

View all access options for this article.

References

Barker

Pöge

. 2012. strdist: Stata module to calculate the Levenshtein distance, or edit distance, between strings. Statistical Software Components S457547, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s457547.html.

Bird

Klein

Loper

. 2009. Natural Language Processing With Python: Analyzing Text With the Natural language Toolkit. Sebastopol, CA: O’Reilly.

Gentzkow

Kelly

Taddy

. 2019. Text as data. Journal of Economic Literature 57: 535–574. https://doi.org/10.1257/jel.20181020.

Hastie

Tibshirani

Friedman

. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York: Springer. https://doi.org/10.1007/978-0-387-84858-7.

Iaria

Schwarz

Waldinger

. 2022. Gender gaps in academia: Global evidence over the twentieth century. http://doi.org/10.2139/ssrn.4150221.

Pedregosa

Varoquaux

Gramfort

Michel

Thirion

Grisel

Blondel

, et al. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12: 2825–2830. https://doi.org/10.48550/arXiv.1201.0490.

Schonlau

Guenther

Sucholutsky

. 2017. Text mining with n-gram variables. Stata Journal 17: 866–881. https://doi.org/10.1177/1536867X1801700406.

Schwarz

2018. ldagibbs: A command for topic modeling in Stata using latent Dirichlet allocation. Stata Journal 18: 101–117. https://doi.org/10.1177/1536867X1801800107.

Schwarz

2019. lsemantica: A command for text similarity based on latent semantic analysis. Stata Journal 19: 129–142. https://doi.org/10.1177/1536867X19830910.

10.

Stepner

2013. binscatter: Stata module to generate binned scatterplots. Statistical Software Components S457709, Department of Economics, Boston College. https://ideas.repec.org/c/boc/bocode/s457709.html.

11.

The Pandas Development Team. 2020. Python Pandas. https://doi.org/10.5281/zenodo.3509134.

12.

Williams

S. P.

. 2014. txttool: Utilities for text analysis in Stata. Stata Journal 14: 817–829. https://doi.org/10.1177/1536867X1401400407.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

5.81 MB

0.00 MB

Estimating text regressions using txtreg_train

Abstract

Keywords

Get full access to this article

References

Supplementary Material