{"id":14379,"date":"2022-01-06T13:38:26","date_gmt":"2022-01-06T13:38:26","guid":{"rendered":"https:\/\/sceptical.scot\/staging\/?p=14379"},"modified":"2026-04-18T19:34:31","modified_gmt":"2026-04-18T19:34:31","slug":"the-paywall-keeping-the-public-out-of-history","status":"publish","type":"post","link":"https:\/\/sceptical.scot\/staging\/2022\/01\/the-paywall-keeping-the-public-out-of-history\/","title":{"rendered":"The paywall keeping the public out of history"},"content":{"rendered":"\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/sceptical.scot\/staging\/wp-content\/uploads\/2022\/01\/IMG_1122.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-14439\" src=\"https:\/\/sceptical.scot\/staging\/wp-content\/uploads\/2022\/01\/IMG_1122.jpg\" alt=\"Oor Wullie statue sitting outside the McManus museum in Dundee, a poster saying Links with the Past can be seen behind him: picture Fay Young\" width=\"800\" height=\"690\" srcset=\"https:\/\/sceptical.scot\/staging\/wp-content\/uploads\/2022\/01\/IMG_1122.jpg 800w, https:\/\/sceptical.scot\/staging\/wp-content\/uploads\/2022\/01\/IMG_1122-300x259.jpg 300w, https:\/\/sceptical.scot\/staging\/wp-content\/uploads\/2022\/01\/IMG_1122-768x662.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<blockquote>\n<p>Access to the UK census is dependent, admittedly at one remove, on the owner of those other national institutions, <em>The Beano, The Dandy<\/em>, and the&nbsp;<em>Sunday Post<\/em>&nbsp;newspaper and its national treasures, \u201cThe Broons\u201d and \u201cOor Wullie\u201d.. <a href=\"file:\/\/\/Users\/fayyoung\/Downloads\/RODGERMakingtheCensusCountJScottishHistoricalStudies40_2_Pressfile.pdf\">Richard Rodger<\/a><\/p>\n<\/blockquote>\n<p><em>Looking back&#8230;and forward, Scotland&#8217;s census is crucial to understanding the lives of the people who make the nation. It is a vital resource for policy makers and service providers in our present time, and equally essential to historians exploring who we were and how we got here.&nbsp; As we await the delayed Scottish 2021 census, due to take place in March this year at greatly increased cost, the national (UK) 1921 census is published online by DC Thomson, in a contract with the National Archives. But why do we have to pay to see it?&nbsp; Historian <strong>Richard Rodger<\/strong>&nbsp; questions the commercial&nbsp; and &#8216;personal&#8217; interests keeping digitised historic censuses behind a paywall.&nbsp;&nbsp;<\/em><\/p>\n<h1>Why are historic censuses not free and open to all?<\/h1>\n<div class=\"postContent\">\n<div class=\"entry-content content\">\n<p><strong>Have you come across such terms as \u2018Open Data\u2019, \u2018Open Access\u2019 or even \u2018Open Government\u2019? \u2018Accountability\u2019 and \u2018transparency\u2019 are bandied about by local government and Scottish government bodies. But saying it does not mean doing it. Repeating it is not enough. Good intentions need execution.<\/strong><\/p>\n<p>So you might think that when in 2019 the Scottish Government published&nbsp;<em>A Culture Strategy for Scotland&nbsp;<\/em>it might have had something to say something about \u2018Archives\u2019 \u2013 the written cultural gold mine of our nation. But no! Not a single reference to \u2018archives\u2019, \u2018historical records\u2019, or the National Records of Scotland in&nbsp;<em>A Culture Strategy for Scotland<\/em>.<\/p>\n<p>So is that it? Don\u2019t we value our records any longer? No culture strategy for written assets? Or worse, are our top civil servants in the&nbsp;<em>National Records of Scotland<\/em>&nbsp;so weak they meekly waived through a document with no reference to the historical assets they are there to protect. And should not our history professors and other senior cultural figures have something to say about this? That\u2019s right.&nbsp;<a href=\"httpss:\/\/en.wikipedia.org\/wiki\/New_Register_House\">Register House<\/a>, a purpose built repository for the documentary record of Scotland of such importance that it was the first thing to be built in the New Town is not worth a single mention in a major policy document. Shameful.<\/p>\n<p>But that\u2019s not all. You might think that with a commitment to Open Data, Open Access, blah blah \u2026from the Scottish Government and Local Councils we would be able to consult Census records from 150 years ago. You might think that having paid your taxes, local and national, that you would be able to consult the digital version of the Census online. Locked down as a nation we might have been able to consult historical records. Instead we were locked out! Or do I mean lucked out?!<\/p>\n<h2>Find my past&#8230;for a fee<\/h2>\n<p>Well local historians will tell you \u2013 you can consult records on line. True \u2013 up to a point. You can pay through&nbsp;<a href=\"httpss:\/\/www.ancestry.com\/\">Ancestry.com<\/a>&nbsp;and&nbsp;<a href=\"httpss:\/\/www.findmypast.co.uk\/\">Findmypast<\/a>&nbsp;and you can consult&nbsp;<em>individual&nbsp;<\/em>records on a pay per view basis. This is OK if you (a) have the money (b) have some initial leads (c) accept the errors and imperfections in the transcribed records (d) want to consult English census records, because they include 1911 (unlike Scotland) and also provide digital versions of the originals (unlike Scotland). You also need to be vigilant. The quality of the farmed out transcription is really dreadful. For example, in Edinburgh, \u2018Bucclench\u2019 is used. For Buccleuch Street look for Bucclench; for Darnaway Street look for \u2018Warnaway.\u2019 OK \u2013 not too difficult to spot if you are from Edinburgh. Here was an excellent chance to farm out checking personal names and Scottish place names to local historians and genealogists. Dereliction at the contractual level, and at the implementation stage.<\/p>\n<blockquote>\n<p>But historical research is more than pursuing individuals. It is about understanding society. What was the average family size; most common occupations; what percentage of women were household heads; and many other interesting questions? These cannot, I repeat, CANNOT be addressed with current arrangements and so access to the Census actively impairs an understanding of Scotland and Scottish society.<\/p>\n<\/blockquote>\n<p>You can download UK Census data from&nbsp;<a href=\"httpss:\/\/www.ukdataservice.ac.uk\/\">this digital census databank<\/a>. But there is an approval system to see the entire dataset. Two \u2018safeguarding\u2019 tests have to be passed. One is whether access to names and addresses is prejudicial to \u2018personal\u2019 interests. This is rarely invoked for the historical census. The other is&nbsp;<em>safeguarding<\/em>&nbsp;the \u2018commercial\u2019 interests at stake!! In the case of the historical census, \u2018commercial interests\u2019 are cited in order to protect the digital investment made under a contractual agreement between The National Archives (TNA, Kew, London) and DC Thomson Media, to which the National Records of Scotland (NRS) at General Register House, Edinburgh is party.<\/p>\n<p>Yes, you did not mis-read that: access to the UK census is dependent, admittedly at one remove, on the owner of those other national institutions,&nbsp;<em>The Beano, The Dandy<\/em>, and the&nbsp;<em>Sunday Post<\/em>&nbsp;newspaper and its national treasures, \u201cThe Broons\u201d and \u201cOor Wullie\u201d.<\/p>\n<blockquote>\n<p>Through these commercial arrangements DC Thomson Media control access to \u2018Findmypast\u2019, the search engine which private researchers and professional genealogists use and pay for to pursue their historical interests. <a href=\"file:\/\/\/Users\/fayyoung\/Downloads\/RODGERMakingtheCensusCountJScottishHistoricalStudies40_2_Pressfile.pdf\">Making the Census Count<\/a><\/p>\n<\/blockquote>\n<p>Nowadays, as in the past, we are routinely asked for our \u2018name and address\u2019 for almost all transactions and relationships. Linking common data fields is a key tool to enriching historical analysis and to forfeit \u2018name\u2019 and \u2018address\u2019 is to diminish the productivity of many non-Census sources which can be nominally linked. That happens everyday to us so where is the concern for historical records say between 1851 and 1911? And rather than safeguarding commercial interests should not the contract to digitise the Census be safeguarding our&nbsp;<em>historical<\/em>&nbsp;interests?<\/p>\n<h2>What&#8217;s in a name?<\/h2>\n<p>In a recent paper I have written about these issues, \u201c<a href=\"httpss:\/\/www.researchgate.net\/publication\/345503693_Making_the_Census_Count_Revealing_Edinburgh_1760-1900\"><strong>Making the Census Count: Edinburgh 1760-1900\u2033<\/strong><\/a>&nbsp;for the&nbsp;<a href=\"httpss:\/\/www.euppublishing.com\/loi\/jshs\"><strong><em>Journal of Scottish Historical Studies<\/em><\/strong><\/a>, three examples are used to show how access to names and addresses enriches historical understanding. One example utilises the Census of Edinburgh to identify the \u2018Top 10\u2019 popular male and female names in 1861 (see below). This is impossible without access to the full digital census. You will never have seen anything like this analysis. Another example considers Alfred McNightingale\u2019s addresses over forty years to understand his employment patterns. A third illustration considers a selection of Old Town Closes in 1861 and 1891 in order to reveal how household size and composition was affected, if at all, by the demolitions initiated under the \u2018Improvement\u2019 Act of 1867. None of these strands, and many others, can be undertaken without access to nominal records. I am fortunate to have been given access to the names and addresses. But why should others be excluded?<\/p>\n<div id=\"attachment_2488\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-2488 size-large\" src=\"httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-1024x599.jpg\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" srcset=\"httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-1024x599.jpg 1024w, httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-600x351.jpg 600w, httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-768x450.jpg 768w, httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-100x59.jpg 100w, httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog-300x176.jpg 300w, httpss:\/\/www.cockburnassociation.org.uk\/wp-content\/uploads\/2021\/07\/Names-Graph-Richard-Rodger-Blog.jpg 1066w\" alt=\"\" width=\"1024\" height=\"599\" aria-describedby=\"caption-attachment-2488\">\n<p id=\"caption-attachment-2488\" class=\"wp-caption-text\"><em>The top ten most popular forenames in Edinburgh in 1861<\/em><\/p>\n<\/div>\n<p>The interests of local historians, genealogists, students and academic historians are adversely affected by current arrangements. The inability to harvest quantities of data from the Census impairs social, economic, cultural, demographic and social science history generally. It limits local interests and civic engagement by denying a legitimate interest in local themes and general trends. School projects and undergraduate dissertations are limited and, at a time when digital resources are a godsend, the general public cannot engage with Census data to advance their own historical interests. Of greater significance perhaps are questions such as: How can the histories of a nation be written without access to the core data \u2013 the inhabitants and their locations?<\/p>\n<\/div>\n<\/div>\n\n\n\n<p><em>This article is republished with permission of the author and <a href=\"httpss:\/\/www.cockburnassociation.org.uk\/history-blogs\/historic-censuses\/\">Cockburn Association<\/a> <\/em><\/p>\n<p><em>Featured image: Oor Wullie outside the McManus Museum in Dundee, photo Fay Young\u00a0<\/em><\/p>\n<p><strong>Further reading<\/strong>: Richard Rodger&#8217;s full length article &#8220;<a href=\"httpss:\/\/www.researchgate.net\/publication\/345503693_Making_the_Census_Count_Revealing_Edinburgh_1760-1900\">Making the Census Count: Revealing Edinburgh 1760\u20131900&#8243;<\/a> <em>Journal of Scottish Historical Studies<\/em><\/p>\n<blockquote>\n<div class=\"t m0 x0 h4 ya ff1 fs2 fc0 sc0 ls7 wsa\">The central theme here is that under present arrangements Scottish historians and the Scottish public are denied access a crucial publicly-funded historical source, and that a \u2018pay-as-you go\u2019 approach is inappropriate for access to archival materials. No other European country applies such a policy.<\/div>\n<\/blockquote>\n<p>Audit Scotland:\u00a0 <a href=\"httpss:\/\/www.audit-scotland.gov.uk\/news\/scotlands-delayed-census-making-good-progress-but-challenges-remain\">Scotland&#8217;s delayed census making good progress but challenges remain.\u00a0<\/a><\/p>\n<p>Financial Times: <a href=\"httpss:\/\/on.ft.com\/3n6SyV7\">Census publication shows DC Thomson pinning future on family pasts\u00a0<\/a><\/p>\n<p>\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;At a time when digital resources are a godsend, the general public cannot engage with Census data to advance their own historical interests. Of greater significance perhaps are questions such as: How can the histories of a nation be written without access to the core data \u2013 the inhabitants and their locations?&#8221;<\/p>\n","protected":false},"author":385,"featured_media":14439,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[123],"class_list":["post-14379","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-culture","tag-scottish-history"],"_links":{"self":[{"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/posts\/14379","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/users\/385"}],"replies":[{"embeddable":true,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/comments?post=14379"}],"version-history":[{"count":1,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/posts\/14379\/revisions"}],"predecessor-version":[{"id":18537,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/posts\/14379\/revisions\/18537"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/media\/14439"}],"wp:attachment":[{"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/media?parent=14379"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/categories?post=14379"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sceptical.scot\/staging\/wp-json\/wp\/v2\/tags?post=14379"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}