Frank Esser

2papers

2 Papers

35.7SIMay 4
Measuring Structural Political Fragmentation

Yuan Zhang, Laia Castro, Frank Esser et al.

Political fragmentation denotes the differentiation of a political system into multiple groups and the extent of separation among them. It often manifests structurally in online interaction behaviors. To measure and compare political fragmentation across contexts, previous scholarship has often relied on network measures of polarisation such as modularity and the Krackhardt E-I index. Here, we show that these metrics combine two aspects of fragmentation: the strength of separation and the number of fragments. These two aspects have not been clearly distinguished in previous work, making comparisons across varied systems difficult to interpret. In addition, none of them is designed to capture the multiscale fragmentation structures that characterize real-world multi-dimensional political spaces. We compare several network measures and show that the two aspects of network fragmentation are best captured by the pairwise adaptive E-I index and the effective number of communities (ENC), while other measures confound the strength of separation and the number of fragments. Furthermore, we introduce a novel metric for multiscale fragmentation, the effective branching factor (EBF), capturing how political fragments at one level split into smaller fragments at the next level. Applying EBF to two empirical datasets spanning Brazil, Spain, and the United States yields consistent country rankings across datasets. Overall, these results clarify three complementary dimensions of structural political fragmentation: strength of separation, number of fragments, and between-level branching. They support a more holistic characterization of structural political fragmentation.

71.2CLApr 4
Researchers waste 80% of LLM annotation costs by classifying one text at a time

Christian Pipal, Eva-Maria Vogel, Morgan Wack et al.

Large language models (LLMs) are increasingly being used for text classification across the social sciences, yet researchers overwhelmingly classify one text per variable per prompt. Coding 100,000 texts on four variables requires 400,000 API calls. Batching 25 items and stacking all variables into a single prompt reduces this to 4,000 calls, cutting token costs by over 80%. Whether this degrades coding quality is unknown. We tested eight production LLMs from four providers on 3,962 expert-coded tweets across four tasks, varying batch size from 1 to 1,000 items and stacking up to 25 coding dimensions per prompt. Six of eight models maintained accuracy within 2 pp of the single-item baseline through batch sizes of 100. Variable stacking with up to 10 dimensions produced results comparable to single-variable coding, with degradation driven by task complexity rather than prompt length. Within this safe operating range, the measurement error from batching and stacking is smaller than typical inter-coder disagreement in the ground-truth data.