Go does have support for decoding bzip2-encoded files so the restore tool can read the file we just exported by setting the is-bzip flag. That’s why we need to pipe the output of the dump tool to the bzip2 utility. | bzip2 -c > /usr/local/data/millsfield.bz2Īs of this writing the Go programming language doesn’t have native support for bzip2 encoding.
Both tools are written in the Go programming language which allows them to be compiled and distributed as standalone binary applications with no external dependencies.īy default the dump tool outputs everything to STDOUT which means you can pipe the data in to other tools like bzip2 to compress it before writing everything to a file on disk. The second tool, called restore, reads a file containing line-separated JSON records and inserts them in to an Elasticsearch index. The first tool, called dump, exports all the records in an Elasticsearch index as a stream of line-separated JSON records that can be written to a file. Elasticsearch has its own process for creating and restoring snapshots of an index but it is sufficiently complex and time-consuming that I decided to write my own tools to perform the migration instead. Recently we needed to migrate 11 million records from one Elasticsearch instance to another. Negative: San Francisco International Airport (SFO), runway or taxiway construction. These tools aren’t specific to SFO Museum and might be useful to other organizations in the sector. In that spirit this blog post is about four small command-line utilities we’ve written to help us do our work and are sharing with the wider cultural heritage sector.
#SMALLAND MUSEUM. HOW TO#
We need to learn how to scope the purpose of and our expectations of any single tool so that we can be generous of, and learn from, the inevitable missteps and false starts that will occur along the way. It needs them in the short-term to develop the skill and the practice required to make those tools successful. It needs them in the long-term to finally reach the goal of a common infrastructure that can be employed sector-wide. The cultural heritage sector needs as many small, focused tools as it can produce. As a prelude to that wrap up I want to touch on something I said in the Geotagging Photos at SFO Museum, Part 1 – Setting the Stage blog post:
#SMALLAND MUSEUM. SERIES#
I still need to finish the series of posts we started about our work geotagging photos in the SFO Museum collection and this will happen soon. It’s been a little while since I’ve written anything here. Some have paths marked with different colours and a wooden deck near the lake where you can unpack your basket with Swedish fika and just enjoy the view of Åsnen, with all its lakes and water.Negative: San Francisco International Airport (SFO), landscape maintenance.
Some places in the national park have toilets, fire places and resting places. Additionally, there is a shore by the lake and wetland forest, all in the same small area. Here you can find leaflets about the national park and also both broad-leaved deciduous trees and conifer trees such as pine and fir trees. The other entrance to the national park is situated by the left shore of Åsnen and near the mountain Trollberget. The bird life is rich and you can find unusual insects, moss and lichen here. Bjurkärr has one of Sweden’s most valuable broad-leaved deciduous forests, since it is very rich in species.
The main entrance is situated by the bridge Sunnabron near the narrow that leads to the largest island in Åsnen, Sirkön. The national park is about 1,868 hectares large, and 75% of the area is water. Åsnen was made a national park in March 2018, which means that the nature in the surroundings is unique and of international interest.
0 kommentar(er)
