Finance and Economics Discussion Series: Accessible versions of figures for 2025-108

LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora*

Accessible version of figures

Figure 1: Text classification for GDP trends.

month sentiment count
2018-01-01 falling 13
2018-01-01 rising 63
2018-01-01 staying flat 67
2018-02-01 falling 14
2018-02-01 rising 64
2018-02-01 staying flat 53
2018-03-01 falling 27
2018-03-01 rising 61
2018-03-01 staying flat 41
2018-04-01 falling 17
2018-04-01 rising 62
2018-04-01 staying flat 74
2018-05-01 falling 14
2018-05-01 rising 58
2018-05-01 staying flat 84
2018-06-01 falling 38
2018-06-01 rising 69
2018-06-01 staying flat 69
2018-07-01 falling 37
2018-07-01 rising 94
2018-07-01 staying flat 114
2018-08-01 falling 45
2018-08-01 rising 80
2018-08-01 staying flat 88
2018-09-01 falling 47
2018-09-01 rising 71
2018-09-01 staying flat 81
2018-10-01 falling 43
2018-10-01 rising 82
2018-10-01 staying flat 101
2018-11-01 falling 33
2018-11-01 rising 67
2018-11-01 staying flat 71
2018-12-01 falling 19
2018-12-01 rising 51
2018-12-01 staying flat 55
2019-01-01 falling 36
2019-01-01 rising 55
2019-01-01 staying flat 51
2019-02-01 falling 29
2019-02-01 rising 65
2019-02-01 staying flat 68
2019-03-01 falling 33
2019-03-01 rising 63
2019-03-01 staying flat 75
2019-04-01 falling 34
2019-04-01 rising 103
2019-04-01 staying flat 111
2019-05-01 falling 41
2019-05-01 rising 56
2019-05-01 staying flat 112
2019-06-01 falling 20
2019-06-01 rising 68
2019-06-01 staying flat 91
2019-07-01 falling 19
2019-07-01 rising 93
2019-07-01 staying flat 89
2019-08-01 falling 39
2019-08-01 rising 42
2019-08-01 staying flat 71
2019-09-01 falling 41
2019-09-01 rising 55
2019-09-01 staying flat 69
2019-10-01 falling 27
2019-10-01 rising 71
2019-10-01 staying flat 87
2019-11-01 falling 24
2019-11-01 rising 55
2019-11-01 staying flat 89
2019-12-01 falling 21
2019-12-01 rising 33
2019-12-01 staying flat 56
2020-01-01 falling 30
2020-01-01 rising 48
2020-01-01 staying flat 49
2020-02-01 falling 55
2020-02-01 rising 42
2020-02-01 staying flat 70
2020-03-01 falling 82
2020-03-01 rising 31
2020-03-01 staying flat 59
2020-04-01 falling 122
2020-04-01 rising 48
2020-04-01 staying flat 84
2020-05-01 falling 70
2020-05-01 rising 44
2020-05-01 staying flat 96
2020-06-01 falling 47
2020-06-01 rising 39
2020-06-01 staying flat 100
2020-07-01 falling 39
2020-07-01 rising 40
2020-07-01 staying flat 120
2020-08-01 falling 25
2020-08-01 rising 32
2020-08-01 staying flat 75
2020-09-01 falling 16
2020-09-01 rising 47
2020-09-01 staying flat 74
2020-10-01 falling 20
2020-10-01 rising 46
2020-10-01 staying flat 69
2020-11-01 falling 17
2020-11-01 rising 47
2020-11-01 staying flat 86
2020-12-01 falling 19
2020-12-01 rising 33
2020-12-01 staying flat 83
2021-01-01 falling 6
2021-01-01 rising 56
2021-01-01 staying flat 58
2021-02-01 falling 11
2021-02-01 rising 45
2021-02-01 staying flat 58
2021-03-01 falling 20
2021-03-01 rising 68
2021-03-01 staying flat 95
2021-04-01 falling 17
2021-04-01 rising 48
2021-04-01 staying flat 62
2021-05-01 falling 12
2021-05-01 rising 48
2021-05-01 staying flat 60
2021-06-01 falling 12
2021-06-01 rising 42
2021-06-01 staying flat 57
2021-07-01 falling 18
2021-07-01 rising 49
2021-07-01 staying flat 47
2021-08-01 falling 10
2021-08-01 rising 39
2021-08-01 staying flat 38
2021-09-01 falling 19
2021-09-01 rising 35
2021-09-01 staying flat 36
2021-10-01 falling 20
2021-10-01 rising 32
2021-10-01 staying flat 32
2021-11-01 falling 15
2021-11-01 rising 27
2021-11-01 staying flat 35
2021-12-01 falling 18
2021-12-01 rising 34
2021-12-01 staying flat 48
2022-01-01 falling 9
2022-01-01 rising 22
2022-01-01 staying flat 21
2022-02-01 falling 21
2022-02-01 rising 19
2022-02-01 staying flat 26
2022-03-01 falling 20
2022-03-01 rising 22
2022-03-01 staying flat 48
2022-04-01 falling 24
2022-04-01 rising 33
2022-04-01 staying flat 39
2022-05-01 falling 25
2022-05-01 rising 23
2022-05-01 staying flat 55
2022-06-01 falling 16
2022-06-01 rising 25
2022-06-01 staying flat 38
2022-07-01 falling 51
2022-07-01 rising 28
2022-07-01 staying flat 28
2022-08-01 falling 19
2022-08-01 rising 31
2022-08-01 staying flat 62
2022-09-01 falling 23
2022-09-01 rising 30
2022-09-01 staying flat 42
2022-10-01 falling 19
2022-10-01 rising 39
2022-10-01 staying flat 36
2022-11-01 falling 25
2022-11-01 rising 39
2022-11-01 staying flat 28
2022-12-01 falling 16
2022-12-01 rising 28
2022-12-01 staying flat 39
2023-01-01 falling 23
2023-01-01 rising 51
2023-01-01 staying flat 42
2023-02-01 falling 15
2023-02-01 rising 46
2023-02-01 staying flat 53
2023-03-01 falling 22
2023-03-01 rising 41
2023-03-01 staying flat 52
2023-04-01 falling 22
2023-04-01 rising 55
2023-04-01 staying flat 56
2023-05-01 falling 33
2023-05-01 rising 37
2023-05-01 staying flat 53
2023-06-01 falling 14
2023-06-01 rising 42
2023-06-01 staying flat 58
2023-07-01 falling 17
2023-07-01 rising 46
2023-07-01 staying flat 52
2023-08-01 falling 19
2023-08-01 rising 55
2023-08-01 staying flat 53
2023-09-01 falling 36
2023-09-01 rising 31
2023-09-01 staying flat 57
2023-10-01 falling 31
2023-10-01 rising 62
2023-10-01 staying flat 79
2023-11-01 falling 22
2023-11-01 rising 82
2023-11-01 staying flat 63
2023-12-01 falling 14
2023-12-01 rising 34
2023-12-01 staying flat 53

Return to text


Figure 2: SVM Public Comments Accuracy

Accuracy Threshold M-RARU Random
80.00000% 125 200
85.00000% 200 350
90.00000% 875 2075

Return to text


Figure 3: SVM Public Comments Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
75.00000% 600 1050
80.00000% 1125 3400
85.00000% 4225 6275+

Return to text


Figure 4: LDA Public Comments Accuracy

Accuracy Threshold M-RARU Random
80.00000% 650 900
85.00000% 925 1550
90.00000% 2250 6275+

Return to text


Figure 5: LDA Public Comments Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
75.00000% 875 1400
80.00000% 1225 2700
85.00000% 3500 6275+

Return to text


Figure 6: RF Public Comments Accuracy

Accuracy Threshold M-RARU Random
70.00000% 50 50
75.00000% 75 75
80.00000% 125 200

Return to text


Figure 7: RF Public Comments Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
65.00000% 175 400
70.00000% 375 950
75.00000% 1200 6275+

Return to text


Figure 8: GBDT Public Comments Accuracy

Accuracy Threshold M-RARU Random
80.00000% 150 200
85.00000% 250 550
90.00000% 1825 6275+

Return to text


Figure 9: GBDT Public Comments Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 300 750
75.00000% 575 1675
80.00000% 2500 6275+

Return to text


Figure 10: DistilBERT Public Comments Accuracy

Accuracy Threshold M-RARU Random
70.00000% 350 400
75.00000% 350 425
80.00000% 425 475

Return to text


Figure 11: DistilBERT Public Comments Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 675 950
75.00000% 725 1100
80.00000% 750 1200

Return to text


Figure 12: SVM GNAD Accuracy

Accuracy Threshold M-RARU Random
70.00000% 625 850
75.00000% 1675 3150
80.00000% 3475 6150+

Return to text


Figure 13: SVM GNAD Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 725 925
75.00000% 1825 3225
80.00000% 3675 6150+

Return to text


Figure 14: LDA GNAD Accuracy

Accuracy Threshold M-RARU Random
70.00000% 1425 2275
75.00000% 2525 6150+
80.00000% 4325 6150+

Return to text


Figure 15: LDA GNAD Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 1575 2650
75.00000% 2875 6150+
80.00000% 4850 6150+

Return to text


Figure 16: RF GNAD Accuracy

Accuracy Threshold M-RARU Random
70.00000% 1300 2200
75.00000% 3150 6150+
80.00000% 5100 6150+

Return to text


Figure 17: RF GNAD Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 1625 2425
75.00000% 3600 6150+
80.00000% 5825 6150+

Return to text


Figure 18: GBDT GNAD Accuracy

Accuracy Threshold M-RARU Random
70.00000% 1175 2200
75.00000% 3225 6150+
80.00000% 5675 6150+

Return to text


Figure 19: GBDT GNAD Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
65.00000% 525 675
70.00000% 1525 2725
75.00000% 3825 6150+

Return to text


Figure 20: DistilBERT GNAD Accuracy

Accuracy Threshold M-RARU Random
70.00000% 400 500
75.00000% 900 2600
80.00000% 1850 6150+

Return to text


Figure 21: DistilBERT GNAD Balanced Accuracy

Balanced Accuracy Threshold M-RARU Random
70.00000% 425 525
75.00000% 1000 2950
80.00000% 2025 6150+

Return to text