Skip to main content

Barcodes (part 1)

One thing that I still haven't properly researched is barcodes. This is not because the barcode field in Discogs is used correctly. Quite the contrary: I am seeing lots of releases where the barcode field is used for all kinds of information that is not a barcode.

No, the real reason is that I am afraid of how much bad stuff I will find. The current amount of possible known errors in Discogs is already quite large, even when just looking at part of the "Barcodes and Other Identifiers" section! I haven't even started on verifying other data such as labels, companies, and so on, but I am very sure that as soon as I start processing that the flood gates will be open.

But, I have to take the plunge one day, so today is as good as any other. Before I can show some useful results it is good to dive into some specifics about barcodes and how these are used in Discogs.

Barcodes

My guess is that most people are familiar with barcodes, but if not there is an excellent article on Wikipedia about barcodes. In short: there are many different kinds of barcodes, so that is something to keep in mind when looking at the data in Discogs. Most of the barcodes will either be EAN-13, or JAN (Japanese releases), although I am confident there are others as well. One example I saw is likely a EAN-13 with the check digit missing.

Barcodes in Discogs

Barcodes are used in Discogs and for example the Discogs app on iPhone will allow you to scan a barcode and then you will be taken to a list of releases that have that particular barcode. This information is searched in the Discogs database and it is a nifty feature, but it depends on the barcode information being correct. And this is where the fun starts. There are three questions I wanted to answer:

Barcode field abused for other data

In Discogs there is a section "Barcodes and Other Identifiers", or "BaOI" for short. This section is used to store all kinds of information, such as label codes (which does not mean "anything printed on a label"), rights society information, run outs, and more. When you enter a new item in this section you have to select the right type for the field you are entering, but some people don't know what to fill in and just leave it set to the default which is "Barcode". Or they simply don't bother to change it and leave it set to "Barcode". This slightly complicates things, as for example a SPARS code is obviously not a barcode.

So the first question I had is: how many barcode values are there that obviously cannot be barcodes?

Incorrect barcodes

The second question that I had is: how many barcodes do not actually correspond to the release? One of the sources of errors in Discogs is the so called "copy to draft" function where you can use an existing release in Discogs as a template for entering data, to make it easier. Some people are extremely sloppy and don't remove the incorrect data from the release they copied it from from. I am seeing plenty of errors with this, but I am not sure how prevelant it really is.

Wrongly dated releases

Barcodes only started to become more prominent in the mid-1980s and before that almost no releases (according to my knowledge) had barcodes. Old releases obviously cannot have a barcode, so having a barcode on an old release either means that the barcode is incorrect (see above) or that someone entered the wrong release date and it is actually a repress or reissue. The third question is: how many releases have a valid barcode, but a release year that would make it impossible to have a barcode?

So with these questions in mind I started to dig into the data.

Barcode distribution in Discogs

I took the data dump covering all data until (not including) May 1 2019 and looked at which releases have a barcode field defined, regardless of whether or not they actually are correct:

Distribution of releases with barcodes in the Discogs dataset

For each million release numbers there are about 200,000 releases with barcode fields, with the first million releases numbers having about 275,000. In total there are 2,881,281 releases with the barcode field. This excludes the releases where a barcode is present but where it has ended up in other fields or sections (like the 'Notes'), but purely the field "Barcode" in the "Barcodes and Other Identifiers" section. Together these releases have 3,403,322 barcode fields.

"No barcode"

There are quite a few releases that have no barcode. Because Discogs makes it really hard to flag non-existent data and there is no single way to do this I looked into variations of "none" (excluding case variations):
  • none : 24753
  • [none] : 196
  • (none) : 125
  • none  : 97
  • none. : 14
  •  none : 10
  • none (promo) : 6
  • "none" : 6
  • none present : 5
  • #cat: none : 3
  • none shown : 2
  • none available : 2
  • none on cover : 2
  • none - pre barcode era : 2
  • none barcode : 2
  • none   : 2
  • none (club edition) : 2
  • none                 : 1
  • (none as promo) : 1
  • none as promo : 1
  • cat# none : 1
  • none (digital) : 1
  • none (erased trace) : 1
  • none given : 1
  •   none : 1
  • none because release date : 1
  • none2008 : 1
  • none 9 : 1
  • none on label : 1
  • none - test pressing : 1
  • nonexistent  : 1
  • none / promotional only - not for sale : 1
  • none [white rectangle] : 1
  • none on cd or box : 1
  • 'none' : 1
  • none on cd case : 1
  • none1 : 1
  • none listed : 1
  • none on disc : 1
  • none4009880364925 : 1
  • -none- : 1
Luckily most use "none", but there are of course extra spaces, quotes, extra data, and so on. Extending it to "no" (and not showing all results):
  • no barcode : 2490
  • no : 261
  • no barcode  : 46
  • non : 42
  • no bar code : 41
  • no barcode. : 30
  • unknown : 30
  • not on label : 27
  • {digits not printed} : 14
  • no code : 14
  • not barcode : 14
  • (no barcode) : 9
  • no bar code promo only not for sale : 6
  • no barcode ! : 6
  • [no barcode] : 6
  • no barcode on the sleeve : 5
  • not : 5
  • no  : 5
  • nobarcode : 5
  • no barecode : 5
  • not on barcode : 5
  • not for sale : 4
  • not available : 4
  • no barcode available : 4
  • no barcode! : 3
  • [unknown] : 3
  • [no text] : 3
  • non barcode : 3
  • non specified : 3
  • no barcode on cover : 3
Sigh. Seriously Discogs, just follow my suggestion, it would make the data a lot more clean and make it easier for me to skip these entries. It would make the world a better place.

In the next part I will dive further into the data.
Labels:

Comments

Post a Comment

Popular posts from this blog

SID codes (part 1)

One thing that I only learned about after using Discogs is the so called Source Identification Code, or SID. These codes were introduced in 1994 to combat piracy and to find out on which machines a CD was made. It was introduced by Philips and adopted by IFPI, and specifications are publicly available which clearly describe the two available SID codes (mastering SID code and mould SID code). Since quite a few months Discogs has two fields available in the " Barcode and Other Identifiers " (BaOI) section: Mould SID code Mastering SID code A few questions immediately popped up in my mind: how many releases don't have a SID field defined when there should be (for example, the free text field indicates it is a SID field)? how many releases have a SID field with values that should not be in the SID field? how many release have a SID field, but a wrong year (as SID codes were only introduced in 1994) how many vinyl releases have a SID code defined (which is impossi...
1 comment
Read more

SPARS codes (part 1)

Let's talk about SPARS codes used on CDs (or CD-like formats). You have most likely seen it used, but maybe don't know its name. The SPARS code is a three letter code indicating if recording, mixing and mastering were analogue or digital. For example they could look like the ones below. There is not a fixed format, so there are other variants as well. Personally I am not paying too much attention to these codes (I simply do not care), but in the classical music world if something was labeled as DDD (so everything digital) companies could ask premium prices. That makes it interesting information to mine and unlock, which is something that Discogs does not allow people to do when searching (yet!) even though it could be a helpful filter. I wanted to see if it can be used as an identifier to tell releases apart (are there similar releases where the only difference is the SPARS code?). SPARS code in Discogs Since a few months SPARS is a separate field in the Discogs ...
Post a Comment
Read more

Using matrix numbers of CDs to verify release years (1)

One of the first steps when making CDs is to produce a "glass master". From that (using a few more steps) a "stamper" is created which is then used to press the actual CDs. When looking at a CD you can often see text in a ring in the middle of the CD. This is the so called matrix which comes from the glass master. Apart from the matrix other text (like the IFPI mastering SID code) could possibly also come from the glass master. A bit of background information can be found on page 7 of the IFPI SID code implementation guide although I would also highly recommend watching some of the clips about glass masters on YouTube, which are highly informative. One company making a lot of these glass masters is Cinram . For most of their glass masters they stored the production date in matrix. This is good news, because it means that it could possibly be used to verify releases and see if the declared year of the release is right: it could never have been released before...
Post a Comment
Read more