A sequence of three randomized controlled trials (RCTs) is conducted to support a small online business’ decision of whether and how to implement AI in the creation of email marketing content. Recent developments in frequentist statistical decision theory are used to accommodate small samples available for testing in the small-business setting. The RCTs comprise three test policy cells with email content created by (i) salaried writers (“human”), (ii) a large-language model (“LLM”), and (iii) a “hybrid” combination of a human editing the content created by the LLM, respectively. When a “no email” control policy is included, all three test cells approximately double the gross profits from orders relative to the control cell. The RCTs vary whether the hybrid cell is edited by a salaried writer or the marketing team. The LLM cells vary whether the AI is pre-trained using historic emails or uses a prompt-based generative pre-trained transformer (“GPT”). Decision theory always selects one of the AI cells over the standard human policy on the basis of total annual profit net of related labor and software overhead.
Dubé, Jean-Pierre, Xu, Ariel. Large Language Models and Creative Content Design: a case study of email marketing at Wine Access. // Quantitative Marketing and Economics. – 2026. – DOI: 10.1007/s11129-025-09303-9. – URL: http://link.springer.com/openurl/fulltext?id=doi:10.1007/s11129-025-09303-9
Dubé, Jean-Pierre, Xu, & Ariel (2026). Large Language Models and Creative Content Design: a case study of email marketing at Wine Access. Quantitative Marketing and Economics. https://doi.org/10.1007/s11129-025-09303-9
Dubé, et al. “Large Language Models and Creative Content Design: a case study of email marketing at Wine Access.” Quantitative Marketing and Economics, 2026. doi:10.1007/s11129-025-09303-9.
@article{Dub2026,
title = {Large Language Models and Creative Content Design: a case study of email marketing at Wine Access},
author = {Dubé and Jean-Pierre and Xu and Ariel},
journal = {Quantitative Marketing and Economics},
year = {2026},
doi = {10.1007/s11129-025-09303-9},
url = {http://link.springer.com/openurl/fulltext?id=doi:10.1007/s11129-025-09303-9}
}
The rising popularity of digital wealth management platforms (DWPs) has transformed how retail investors manage their portfolios. This study examines key factors related to the successful adoption of DWPs and their outcomes, using an...
Much academic research is focused on the application of predictive data, forecasts, and models to inform practical marketing decision-making. Such work offers powerful insights to marketers directing their firms and interacting with the...
Migrant tourism entrepreneurs (MTEs) are emerging as important actors in rural destination branding. However, the mechanisms through which they shape brand formation through everyday practices remain insufficiently understood. Drawing...
Authenticity drives customer decision-making and firm success, yet research remains fragmented due to the diversity of conceptualizations, mediators and outcomes, and empirical contexts investigated. Utilizing the entity–referent...
Signaling theory predicts that communication, such as by CEOs, might complement observable environmental engagement by a firm, by reducing information asymmetry. Yet it remains unclear whether firms with stronger environmental...