{"id":2176,"date":"2019-04-07T21:50:23","date_gmt":"2019-04-08T05:50:23","guid":{"rendered":"http:\/\/antoine.wojdyla.fr\/blog\/?p=2176"},"modified":"2019-06-10T23:23:46","modified_gmt":"2019-06-11T07:23:46","slug":"kolmogorov-access","status":"publish","type":"post","link":"http:\/\/antoine.wojdyla.fr\/blog\/2019\/04\/07\/kolmogorov-access\/","title":{"rendered":"Kolmogorov Access"},"content":{"rendered":"<p>Back in undergrad, I remember being fascinated by the notion of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Kolmogorov_complexity\" onclick=\"_gaq.push(['_trackEvent', 'outbound-article', 'https:\/\/en.wikipedia.org\/wiki\/Kolmogorov_complexity', 'Kolmogorov complexity']);\" >Kolmogorov complexity<\/a> in computer science.<\/p>Put simply, the Kolmogorov complexity is the minimal length (number of lines) of the code needed to generate a signal, would it be a mathematical sequence (such as one listed in the <a href=\"https:\/\/oeis.org\/\" onclick=\"_gaq.push(['_trackEvent', 'outbound-article', 'https:\/\/oeis.org\/', 'OEIS']);\" >OEIS<\/a>) or an image, irrespective to the size needed to store it. It bears deep relations with the notion of entropy (a great book on the topic is <a href=\"https:\/\/www.inference.org.uk\/mackay\/itila\/\" onclick=\"_gaq.push(['_trackEvent', 'outbound-article', 'https:\/\/www.inference.org.uk\/mackay\/itila\/', 'Information Theory, Inference, and Learning Algorithms']);\" >Information Theory, Inference, and Learning Algorithms<\/a> by the late David MacKay.)<\/p>For example, a series of eight billion ones in a row would require 1GB of memory, but can be written in a few lines of code:<\/p>\n<p style=\"padding-left: 30px;\">for i in 1:1e9; print 1; end<\/p>(To some extent, this is why computer science is often problematic, since one of the goal of a good code is sometimes to reduce its Kolmogorov complexity, but the final code does not show all the lines that have been erased to get there&#8230;)<\/p>In the field of arts, culture and science, this description seems naive: can you really generate a book based on a script, or has it infinite entropy?<\/p>\n<blockquote><p>Science is organized knowledge. Wisdom is organized life.<br \/>\n&#8211; Immanuel Kant<\/p><\/blockquote><p><a href=\"http:\/\/antoine.wojdyla.fr\/blog\/wp-content\/uploads\/05e2e400dd1165870b3787a527e4e753-2.gif\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-2237 aligncenter\" src=\"http:\/\/antoine.wojdyla.fr\/blog\/wp-content\/uploads\/05e2e400dd1165870b3787a527e4e753-2.gif\" alt=\"\" width=\"526\" height=\"414\" \/><\/a><\/p>In the age of the Internet, can we do better?<\/p><em>update 6\/10\/2019:<\/em> I&#8217;ve seen recently on Twitter the embodiment of these ideas, see <a href=\"https:\/\/twitter.com\/NARepina_\/status\/1138154609543852032\" onclick=\"_gaq.push(['_trackEvent', 'outbound-article', 'https:\/\/twitter.com\/NARepina_\/status\/1138154609543852032', 'Nicole R.']);\" >Nicole R.<\/a>&#8216;s thread. Way to go!<\/p><!--more--><\/p>\n<h3>URLs and Link shorteners<\/h3>\n<h3>Digital Object Identifiers<\/h3>\n<h3>Twitter<\/h3><p>I believe Twitter is actually an excellent way to link information: it has identifiable information, a short link and the data.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Back in undergrad, I remember being fascinated by the notion of Kolmogorov complexity in computer science.Put simply, the Kolmogorov complexity is the minimal length (number of lines) of the code needed to generate a signal, would it be a mathematical sequence (such as one listed in the OEIS) or an image, irrespective to the size [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,13,14,16,5],"tags":[],"class_list":["post-2176","post","type-post","status-publish","format-standard","hentry","category-english","category-epistemology","category-projects","category-resources","category-science-life"],"_links":{"self":[{"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/posts\/2176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/comments?post=2176"}],"version-history":[{"count":5,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/posts\/2176\/revisions"}],"predecessor-version":[{"id":2240,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/posts\/2176\/revisions\/2240"}],"wp:attachment":[{"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/media?parent=2176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/categories?post=2176"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/antoine.wojdyla.fr\/blog\/wp-json\/wp\/v2\/tags?post=2176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}