Tag: cond-mat.dis-nn

#cond-mat.dis-nn

Academic · 1 min

Semantic Chunking and the Entropy of Natural Language

arXiv:2602.13194v1 Announce Type: new Abstract: The entropy rate of printed English is famously estimated to be about one bit per character, a benchmark that modern …

Weishun Zhong, Doron Sivan, Tankut Can, Mikhail Katkov, Misha Tsodyks
13 views
Academic · 1 min

Biased Generalization in Diffusion Models

arXiv:2603.03469v1 Announce Type: new Abstract: Generalization in generative modeling is defined as the ability to learn an underlying distribution from a finite dataset and produce …

Jerome Garnier-Brun, Luca Biggio, Davide Beltrame, Marc M\'ezard, Luca Saglietti
12 views
Academic · 1 min

A unified theory of feature learning in RNNs and DNNs

arXiv:2602.15593v1 Announce Type: new Abstract: Recurrent and deep neural networks (RNNs/DNNs) are cornerstone architectures in machine learning. Remarkably, RNNs differ from DNNs only by weight …

Jan P. Bauer, Kirsten Fischer, Moritz Helias, Agostina Palmigiano
19 views