This article is from the source 'guardian' and was first published or seen on . It last changed over 40 days ago and won't be checked again for changes.

You can find the current article at its original source at http://www.theguardian.com/world/2018/jan/03/stasi-files-east-germany-archivists-losing-hope-solving-worlds-biggest-puzzle

The article has changed 8 times. There is an RSS feed of changes available.

Version 1 Version 2
Stasi files: scanner struggles to stitch together surveillance state scraps Stasi files: scanner struggles to stitch together surveillance state scraps
(35 minutes later)
Archivists in Germany are losing hope of being able to solve the world’s biggest jigsaw puzzle, as technology is struggling to piece together hundreds of thousands of Stasi files ripped to shreds in the dying days of the East German regime.Archivists in Germany are losing hope of being able to solve the world’s biggest jigsaw puzzle, as technology is struggling to piece together hundreds of thousands of Stasi files ripped to shreds in the dying days of the East German regime.
The government-funded Stasi records agency confirmed this week that it had to halt an €8m (£7m) project to digitally reassemble the contents of 23 bags stuffed with torn-up documents detailing the activity of the secret police, because the scanning hardware it was using was not advanced enough.The government-funded Stasi records agency confirmed this week that it had to halt an €8m (£7m) project to digitally reassemble the contents of 23 bags stuffed with torn-up documents detailing the activity of the secret police, because the scanning hardware it was using was not advanced enough.
Over the 60-year existence of communist East Germany, the state security ministry built one of the most tightly knit surveillance states in recent history, with historians calculating one Stasi informant per 6.5 citizens. Over the 40-year existence of communist East Germany, the state security ministry built one of the most tightly knit surveillance states in recent history. The Stasi, short for the Ministry for State Security created a vast web of full-time agents and part-time snoops, with some historians calculating one informant per 6.5 citizens.
After German reunification in 1990 an archive was set up to allow the system’s victims to access their records, but stacks of paperwork were shredded or ripped up by hand to cover up the regime’s activity. Some researchers estimate that 10-40% of the archive’s contents may be lost to history. After German reunification in 1990 an archive was set up to allow the system’s victims to access their records, but not before stacks of paperwork were shredded or ripped up by hand to cover up the regime’s activity.
Since 1995 workers employed by the agency have managed to piece together more than 1.5m pages of destroyed files by hand, shedding light on East Germany’s use of doping in sports, links between the Stasi and West Germany’s Red Army Faction terrorist group, and the persecution of writers critical of the regime. While there are no official figures on the volume of destroyed records, researchers estimate that 10-40% of the archive’s contents may be lost to history.
Since the early 1990s workers employed by the agency have managed to piece together more than 1.5m pages of destroyed files by hand, shedding light on East Germany’s use of doping in sports, links between the Stasi and West Germany’s Red Army Faction terrorist group, and the persecution of writers critical of the regime.
Among other stories, the reassembled files have brought to light the story of a young Austrian theology student who shopped several fellow students to the Stasi after they had confided in him their plan to escape across to the west. As a reward, the informant was handed a professorship at the university of Jena.
Until 2015, the Stasi records agency outsourced some of manual puzzling work to the federal refugee agency in Bavaria.
But workers have struggled with files that were torn up more than four times. “Once you have nine snippets per A4 sheet of paper, the human brain really can’t keep up”, said Dagmar Hovestädt, the spokesperson for the Stasi Records Agency.But workers have struggled with files that were torn up more than four times. “Once you have nine snippets per A4 sheet of paper, the human brain really can’t keep up”, said Dagmar Hovestädt, the spokesperson for the Stasi Records Agency.
A so-called ePuzzler, working with an algorithm developed by the Fraunhofer Institute and costing about €8m of federal funds, has managed to digitally reassemble about 91,000 pages since 2013. However, it has recently run into trouble.A so-called ePuzzler, working with an algorithm developed by the Fraunhofer Institute and costing about €8m of federal funds, has managed to digitally reassemble about 91,000 pages since 2013. However, it has recently run into trouble.
For the last two years, the Stasi Records Agency has been waiting for engineers to develop more advanced hardware that can scan in smaller snippets, some of which are only the size of a fingernail. For the last two years, the Stasi records agency has been waiting for engineers to develop more advanced hardware that can scan in smaller snippets, some of which are only the size of a fingernail.
The ePuzzler works by detecting the outline of the torn-up page rather than its content. It has struggled with files that were folded before being torn, thus leaving several snippets with near-identical outlines. The ePuzzler works by matching up types of paper stock, typewriter fonts, or the outline of the torn-up page. It has struggled with hand-written files that were folded before being torn, leaving several snippets with near-identical outlines.
The ePuzzler has also required human assistance to feed paper snippets and check over the completed jigsaw puzzle, further slowing down the process.
“We currently don’t have a scanner that we can work with”, said Hovestädt, adding that her agency was hopeful that technological progress would allow the archive to resume reassembling destroyed records this year.“We currently don’t have a scanner that we can work with”, said Hovestädt, adding that her agency was hopeful that technological progress would allow the archive to resume reassembling destroyed records this year.
The Stasi records agency said its attempt to virtually piece the history of a surveillance state was without a precedent in the world. “We are dealing with a research project that requires us to develop a technology entirely from scratch.
In the meantime, a small team of manual puzzlers continue their work of matching up more crudely ripped files by hand.In the meantime, a small team of manual puzzlers continue their work of matching up more crudely ripped files by hand.