Skip to main content

A case for guided data entry (part 1)

I just helped someone add a few releases to Discogs and it was, again, a quite frustrating experience, even though I have added releases to Discogs before.

Adding releases to Discogs is actually a lot of work. These are the steps I typically take for a 7" single:

  1. see if the release is already there on Discogs.
  2. see if the release I have differs from any of the listed releases
  3. copy an existing release to draft, or start from scratch
  4. fill in all the details that I am sure about
  5. make scans, crop the scans, scale them
  6. add scans
Adding a release properly, with all the details, can easily take 15 to 20 minutes, and then I still only have a fairly barebones release. What I typically don't get right due to lack of knowledge are things like:
  • composers
  • printing companies
  • manufacturing companies
  • pressing plants
  • country specific peculiarities
  • etc.
These usually require specialist knowledge about releases from a certain country, label or artist, which I simply don't have. Other contributors on Discogs actually do have this knowledge but this source of knowledge is hardly used. For some countries or labels or artists some information is gathered either in a forum (example: Spain), but when people start adding releases they are either not reading those suggestions (it is a lot of data, or incomplete, or scattered across various places) or not even aware of it.

Instead people are literally dumped in front of a rather complex entry form, with very little checks and the possibility to either screw up, or to miss relevant data. Then after the release has been added other people point out mistakes (instead of fixing them), and tell them to read the relevant forum threads or documentation, and so on which simply is too much effort for most. And I agree with them: the learning curve is way too high.

It would be great to somehow use this knowledge and guide people who do not have it to make sure that they are contributing good quality data, but without requiring them to become experts.

The release data entry form is great for experts who know what they are doing, but not for less experienced people. Guiding them through the process can help data quality a lot. For software programs using a wizard (or setup assistant) is actually very normal and I don't see why it would not be something for Discogs.


I don't know what the flow should be, but I could imagine something like:
  1. enter country
  2. enter artist
  3. enter label
  4. enter year
  5. enter tracks
  6. add images
and based on that information as well as information extracted from earlier releases on Discogs or domain experts to create a series of questions to gather the rest of the information. Examples:
  • "Are there any run times listed? If so, please add them"
  • "If you can find any numbers in the run out groove, please add them to 'Matrix/Runout'"
  • "If you can find a barcode, add them in the section 'Barcode'" (which could be left out for releases from before barcodes existed)
  • "Is there a manufacturing date in the form XX/1 or XX/2 on the release? If so, add to the 'Barcodes' section using the field 'Other'" (for Czechoslovak releases)
  • etc.
This allows people to make fewer mistakes, but it also sets expectations of what would be minimally required to have a good release, also serving as a teaching tool, so people can later go to the expert form if wanted. For me it would be useful as these questions would serve as a reminder of what data to add.

I would not recommend automatically filling in values. This is fine if the data is actually correct, but not if the data is incorrect, as people will assume that it is correct data and leave it.

Comments

Popular posts from this blog

SID codes (part 1)

One thing that I only learned about after using Discogs is the so called Source Identification Code, or SID. These codes were introduced in 1994 to combat piracy and to find out on which machines a CD was made. It was introduced by Philips and adopted by IFPI, and specifications are publicly available which clearly describe the two available SID codes (mastering SID code and mould SID code). Since quite a few months Discogs has two fields available in the " Barcode and Other Identifiers " (BaOI) section: Mould SID code Mastering SID code A few questions immediately popped up in my mind: how many releases don't have a SID field defined when there should be (for example, the free text field indicates it is a SID field)? how many releases have a SID field with values that should not be in the SID field? how many release have a SID field, but a wrong year (as SID codes were only introduced in 1994) how many vinyl releases have a SID code defined (which is impossi

SPARS codes (part 1)

Let's talk about SPARS codes used on CDs (or CD-like formats). You have most likely seen it used, but maybe don't know its name. The SPARS code is a three letter code indicating if recording, mixing and mastering were analogue or digital. For example they could look like the ones below. There is not a fixed format, so there are other variants as well. Personally I am not paying too much attention to these codes (I simply do not care), but in the classical music world if something was labeled as DDD (so everything digital) companies could ask premium prices. That makes it interesting information to mine and unlock, which is something that Discogs does not allow people to do when searching (yet!) even though it could be a helpful filter. I wanted to see if it can be used as an identifier to tell releases apart (are there similar releases where the only difference is the SPARS code?). SPARS code in Discogs Since a few months SPARS is a separate field in the Discogs

Country statistics (part 2)

One thing I wondered about: for how many releases is the country field changed? I looked at the two most recent data dumps (covering February and March 2019) and see where they differed. In total 5274 releases "moved". The top 20 moves are: unknown -> US: 454 Germany -> Europe: 319 UK & Europe -> Europe: 217 unknown -> UK: 178 UK -> Europe: 149 Netherlands -> Europe: 147 unknown -> Europe: 139 unknown -> Germany: 120 UK -> US: 118 Europe -> Germany: 84 US -> UK: 79 USA & Canada -> US: 76 US -> Canada: 65 unknown -> France: 64 UK -> UK & Europe: 62 UK & Europe -> UK: 51 France -> Europe: 51 Saudi Arabia -> United Arab Emirates: 49 US -> Europe: 46 unknown -> Japan: 45 When you think about it these all make sense (there was a big consolidation in Europe in the 1980s and releases for multiple countries were made in a single pressing plant) but there are also a few weird changes: