Using ChatGPT to Assess Soft Firm-level Risks
October 24, 2023 - Fundamental Valuation, Investing Expertise
Can artificial intelligence (AI) models help investors quantify vague firm risks through textual analysis? In their October 2023 paper entitled “From Transcripts to Insights: Uncovering Corporate Risks Using Generative AI”, Alex Kim, Maximilian Muhn and Valeri Nikolaev explore the value of generative AI tool ChatGPT 3.5 in quantifying firm risks based on politics, climate change and AI as conveyed in earnings conference call transcripts. For each of the three risks, they generate: (1) risk summaries based solely on the transcripts, and (2) risk assessments in full context based on the transcripts plus all ChatGPT training data. They consider risk analysis both within (before September 2021) and outside (January 2022 through March 2023) ChatGPT’s training period. They test the import of ChatGPT-based risk assessments via 5-factor (accounting for market, size, book-to-market, profitability and investment effects) alphas of hedge portfolios that are that are long the fifth (quintile) of stocks with the highest assessed risks and short the quintile with the lowest. Using earnings transcripts and monthly returns for a broad sample of U.S. stocks during January 2018 through March 2023, they find that: Keep Reading