[79044] in cryptography@c2.net mail archive

home help back first fref pref prev next nref lref last post

Re: Entropy of other languages

daemon@ATHENA.MIT.EDU (Travis H.)
Wed Feb 7 13:34:40 2007

Date: Mon, 5 Feb 2007 21:08:07 -0600
From: "Travis H." <travis+ml-cryptography@subspacefield.org>
To: cryptography@metzdowd.com
Mail-Followup-To: cryptography@metzdowd.com
In-Reply-To: <45C67061.7050405@sound-by-design.com>


--1sNVjLsmu1MXqwQ/
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Sun, Feb 04, 2007 at 03:46:41PM -0800, Allen wrote:
> An idle question. English has a relatively low entropy as a=20
> language. Don't recall the exact figure, but if you look at words=20
> that start with "q" it is very low indeed.

I seem to recall Shannon did some experiments which showed that with a
human as your probability oracle, it's roughly 1-2 bits per letter.
Many of his papers are online last time I looked, but some of his
experimental results are harder to locate online.

> What about other languages? Does anyone know the relative entropy=20
> of other alphabetic languages? What about the entropy of=20
> ideographic languages? Pictographic? Hieroglyphic?

IIRC, it turned out that Egyptian heiroglyphs were actually syllabic,
like Mesopotamian, so no fun there.  Mayan, on the other hand, remains
an enigma.  I read not long ago that they also had a way of recording
stories on bundles of knotted string, like the end of a mop.
--=20
The driving force behind innovation is sublimation.
-><- <URL:http://www.subspacefield.org/~travis/>
For a good time on my UBE blacklist, email john@subspacefield.org.

--1sNVjLsmu1MXqwQ/
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.1 (OpenBSD)

iQIVAwUBRcfxF2QVZZEDJt9HAQJaxQ/7BOQFhjAYkGbTOfO138J+odfRX9GKeGMP
f7SpAqVuUpfN7NnnShrBciDnAT9y6YcNFhxbb4zNNuqWO+aR0JiIICDHm9d6Ypt0
sgdBEm5lTTCNJr232lfA5xN0tA++6JJAamv72/ZNeTchj8ZIg/12tvgP87WqR6JV
vo8stSLpThtpS+ml5IozVnjOkPBu0oMrsz4AorJtCmI7NmN4tkwRdO9kOWmKBnGH
S6QtGuwhrnRInlDPH3FvYqUyOJEfqZz1nN5Y5Yo023A5eDiAXZdF3gV21AXk3i05
1u/u+mi3P33e/MnWHNhIUa2VCtypxHUSCiv89FB0pP4Kw0V57YDaKkz3H/+4vzRH
JIohdiMqrRNjzpT8S9rTaEFXkSu0+DqIG7HVOvBSJGSZ/hMBT+IpzTs7lJw+bqZD
p/HClIyivxWszbCfwl0IsJGMdJG2AqtPBQRpHgh6V7RK8ujqYR2TAgVGH0hmyuyT
AQVuNn3SCdLC1gfnrAQtALxVMDdvkbjRmA/wfrihihSA02KPdAUqJ0O+mOB7uS8p
U4Xeq0aAv7Ay0oxmT/n+JKLwKuYeOQpDT/KFjvMOk7QZlbOWKArjizJErXh2a2/k
wXf5WYAmRbVxN6iZ5nocI0ltLvf0iYWsfPlwGftwdkySeeuhTc2KxWaXEEOx+hoc
T4isQg09MLg=
=f0XS
-----END PGP SIGNATURE-----

--1sNVjLsmu1MXqwQ/--

---------------------------------------------------------------------
The Cryptography Mailing List
Unsubscribe by sending "unsubscribe cryptography" to majordomo@metzdowd.com

home help back first fref pref prev next nref lref last post