Bug 1045 - (int-99525/int-152451) Media player breaks the original sorting of songs in a CD
(int-99525/int-152451)
: Media player breaks the original sorting of songs in a CD
Status: REOPENED
Product: Data
Meta Tracker
: 5.0:(20.2010.36-2)
: All Maemo
: Unspecified normal with 15 votes (vote)
: ---
Assigned To: unassigned
: metatracker-bugs
:
:
:
:
  Show dependency tree
 
Reported: 2007-02-10 17:14 UTC by David Hagood
Modified: 2010-11-10 18:42 UTC (History)
14 users (show)

See Also:


Attachments
filesystem listing (123.31 KB, image/png)
2008-06-26 00:34 UTC, Joshua Layne
Details
mediaplayer listing (138.78 KB, image/png)
2008-06-26 00:35 UTC, Joshua Layne
Details
GRIP configuration file (1.51 KB, application/octet-stream)
2009-01-18 00:55 UTC, David Hagood
Details


Note

You need to log in before you can comment on or make changes to this bug.


Description David Hagood (reporter) 2007-02-10 17:14:01 UTC
Given a set of MP3s in a directory, which are named thus:
  Artist_Name_%02d.mp3
and are titled thus:
  Artist Name %d
(in other words, while the file numbers are zero padded to two digits, the
titles are NOT zero padded)
The media player sorts on title name, not on file name or ID3 track number.

As such, the media is sorted thus:

  Artist Name 1
  Artist Name 10
  Artist Name 2
  ...

Rather than being sorted in numeric order.

The media player should sort on either the file name, or the ID3 track number,
or at least allow for the option of sorting on the track #.
Comment 1 Neil MacLeod maemo.org 2007-02-10 22:23:03 UTC
Have you included a playlist file in the same directory (ie. .pls or .m3u)? If
so you can view your music directory via the Playlist view and it should be in
the correct order. Without a playlist, the files will be listed in filename
order which is understandable since it may take a while to parse all the ID3
tags. Alternatively, can you rename your files if you want them in a specific order?
Comment 2 David Hagood (reporter) 2007-02-10 23:30:13 UTC
There was no playlist in the directory, BUT the files were NOT sorted in file
name order - As I said, the filename order would have been correct. They were
sorted in order by the ID3 Title tag.
Comment 3 Igor Tkach 2007-02-21 04:51:11 UTC
Songs in an album are also sorted by title tag, not by file name. So for songs
that don't have track number 
as first part of the title (and why should it be there?) the album becomes just
an alphabetically sorted list 
of song names, which completely ruins album listening experience. In this case
it is better not to sort at all 
then to sort alphabetically!
Comment 4 Noah Mittman 2007-09-18 21:33:49 UTC
It also sorts them improperly by file name. All of my files are preceded with a
number for this very reason, but this is how Media Player lists them:

01 Trackname.mp3
10 Trackname.mp3
11 Trackname.mp3
12 Trackname.mp3
02 Trackname.mp3
03 Trackname.mp3
04 Trackname.mp3
05 Trackname.mp3
06 Trackname.mp3
07 Trackname.mp3
08 Trackname.mp3
09 Trackname.mp3

Despite the use of leading zeros which is supposed to prevent this kind of
character sorting problem, Media Players seems to parse out the whole number,
and *then* proceed to sort them incorrectly.

I've verified this with every album I own now. I couldn't figure out why it was
all sorted wrong until I just added an album and saw Intro only two tracks away
from Outro. :|
Comment 5 Noah Mittman 2007-11-16 18:26:49 UTC
Guys, this is pretty basic filename and ID3 handling, and yet *very integral*
to the user experience of the tablet being used as a media player. Can someone
please address this bug?

FYI, to my previous comment, ID3s *are* being read -- after all, how would the
tablet know what the Artist and Album information is? -- but it simply NOT
sorting the tracks properly using the Track Number field.

There are all VBR MP3s, using ID3 v2.3, with metadata fully inputted in iTunes
7 -- not an uncommon scenario at all.
Comment 6 Noah Mittman 2008-01-02 01:33:06 UTC
I have a high suspicion that this problem is a parsing issue that involves the
"Position In Set" extension of Track Number.

From <http://www.id3.org/id3v2-00>:

TRK
   The 'Track number/Position in set' frame is a numeric string
   containing the order number of the audio-file on its original
   recording. This may be extended with a "/" character and a numeric
   string containing the total numer of tracks/elements on the original
   recording. E.g. "4/9".
Comment 7 Noah Mittman 2008-01-02 01:41:16 UTC
To note:

I recently downloaded an album from Emusic directly to the tablet, which sorted
fine. These files had substantial ID3 info in it, but did NOT have the Position
In Set filled in, only the Track Number.

As well, if you look at the example above, you can see how you might get the
bizarre sorting:
1 of 10 = "1/10"
10 of 10 = "10/10"
2 of 10 = "2/10"
The routine the media player uses might be switching to string-sorting due to
the presence of the non-numeric character.

Please, please someone read this bug report!
Comment 8 Matt Johnston 2008-04-14 09:25:25 UTC
Probably related to this bug (rather than opening a new one), when sorting a
list of ID3-less tracks it would really seem to make sense to sort any tracks
with a leading number digit numerically, rather than 1, 10, 11, 2, 3 etc.
Comment 9 Joshua Layne 2008-06-17 21:11:22 UTC
I'm just now getting to the point where I have a decent sized card for 
my N810 and have grsync working to sync against part of my iTunes library.

That part works fine.

Media player can play 256K AAC files (even inside mpeg4 wrappers!), 
which makes me (and my ears) happy.

But it reorders the songs within an album, ignoring the numeric prefix
as an example:
Beastie Boys, To The 5 Buroughs

Nokia-N810-51-3:/media/mmc1/music/Beastie Boys/To The 5 Boroughs$ ls
01 Ch-Check It Out 1.m4a        09 That's It That's All 1.m4a
02 Right Right Now Now 1.m4a    10 All Lifestyles 1.m4a
03 3 The Hard Way 1.m4a         11 Shazam! 1.m4a
04 Time To Build 1.m4a          12 An Open Letter To NYC 1.m4a
05 Rhyme The Rhyme Well 1.m4a   13 Crawlspace 1.m4a
06 Triple Trouble 1.m4a         14 The Brouhaha 1.m4a
07 Hey **** You 1.m4a           15 We Got The 1.m4a
08 Oh Word_ 1.m4a

yet, when played in the Media Player, track 1 is:

3 The Hard Way

so it is stripping (good for display) and ignoring (bad) the track 
numbers of the songs.

it needs to sort based on filename within an album as this is a (de-facto)
standard - these files were ripped and converted by iTunes 7.x, a fairly common
use case.
Comment 10 Andre Klapper maemo.org 2008-06-23 15:25:01 UTC
I cannot reproduce this at all on my N810 (Chinook 4.0), I have some tracks
named
"01 - Title 01.mp3"
...
"10 - Title 10.mp3"
"11 - Title 10.mp3"
and the sorting in media player is correct.

I have also tried this with
"01 Title 01.mp3"
...
"10 Title 10.mp3"
"11 Title 10.mp3"
but could not reproduce either. At least I'd need a testcase to reproduce
this...

(note to myself: there is a similar internal issue but that has been closed as
fixed in 2007: 51180)
Comment 11 Joshua Layne 2008-06-26 00:29:22 UTC
I gave as much detail on the test case as I could.  I will provide screenshots
of how the files are listed on the filesystem versus how they are shown in
mediaplayer.  I will also try to validate with mp3 files as well - for all I
know, this is dependent on file type...
Comment 12 Joshua Layne 2008-06-26 00:34:41 UTC
Created an attachment (id=790) [details]
filesystem listing
Comment 13 Joshua Layne 2008-06-26 00:35:09 UTC
Created an attachment (id=791) [details]
mediaplayer listing
Comment 14 Joshua Layne 2008-06-26 02:16:56 UTC
this also persists in diablo - I upgraded yesterday and have the same problem
(the screenshots were actually taken in diablo)
Comment 15 Tony Green 2008-06-27 22:49:44 UTC
(In reply to comment #10)
> I cannot reproduce this at all on my N810 (Chinook 4.0), I have some tracks
> named
> "01 - Title 01.mp3"
> ...
> "10 - Title 10.mp3"
> "11 - Title 10.mp3"
> and the sorting in media player is correct.
> 
> I have also tried this with
> "01 Title 01.mp3"
> ...
> "10 Title 10.mp3"
> "11 Title 10.mp3"
> but could not reproduce either. At least I'd need a testcase to reproduce
> this...

With Ogg Vorbis support provided by the Mogg package, the same problem is
visible on directories of Ogg files.

The significant issue is whether or not the files have title tags in them. With
title tags, the media player sorts the files alphabetically by title. If I
remove the title tags (but leave all other tags intact) then it sorts them
according to the file name (I have leading zeroes as in your example.)

So the problem seems to be that the player doesn't understand tracknumber tags
(something mentioned in the Mogg documentation) so where it probably ought to
be sorting by tracknumber/title, it's just sorting by title.
Comment 16 Noah Mittman 2008-10-08 18:22:13 UTC
(In reply to comment #11)
> I gave as much detail on the test case as I could.  I will provide screenshots
> of how the files are listed on the filesystem versus how they are shown in
> mediaplayer.  I will also try to validate with mp3 files as well - for all I
> know, this is dependent on file type...
> 

Can you please check against my comment #7?

I am confident this has something to do with the Position In Set field of the
MP3s.

From my personal tests:

* Alphabetical sort when neither Position nor Position-In-Set is present
* Position sort when Position is present but Position-In-Set is not
* PROBLEM sorting when both Position and Position-In-Set is present
Comment 17 gilles.gagniard 2008-12-29 22:16:03 UTC
I confirm this behaviour and the probable cause in comment #7 :

- removing all "position in set" values in id3v2 tags (and thus using format xx
instead of xx/xx for the TRCK frame) makes media player sort the tracks by
track number; with xx/xx format, it sorts tracks by track title which is NOT
the expected behaviour

- the problem is not only for id3v2 tags : the same bug occurs for m4a files,
and the workaround is the same : removing the "position in set" value (or
whatever equivalent in m4a tags)
Comment 18 Quim Gil nokia 2009-01-16 09:04:34 UTC
I want to see whether this problem can be reproduced in Fremantle and I want to
use the same music files as you - without having to buy them.  :)

Can anybody provide a freely downloadable album (CreativeCommons etc) that can
be used to replicate this bug in Diablo?

In a worst case scenario I guess I can do with a isohunt.com link *for testing
purposes*  :roll:
Comment 19 David Hagood (reporter) 2009-01-16 14:35:16 UTC
Well, I cannot legally share my files, but since all I have done is take a CD
and rip it with Grip under Linux, what I could do is give you my Grip settings,
and you can rip an album of your own - would that work?
Comment 20 Quim Gil nokia 2009-01-16 22:42:26 UTC
(In reply to comment #19)
> Well, I cannot legally share my files, but since all I have done is take a CD
> and rip it with Grip under Linux, what I could do is give you my Grip settings,
> and you can rip an album of your own - would that work?

Fair enough. Grip installed, waiting for instructions.
Comment 21 David Hagood (reporter) 2009-01-18 00:55:33 UTC
Created an attachment (id=1107) [details]
GRIP configuration file

You should be able to use this GRIP setup file to rip the CD of your choice and
add the metadata in the same way I do when I build my files.
Comment 22 Quim Gil nokia 2009-01-22 22:53:21 UTC
This bug can be reproduced in Fremantle, even with a simpler setting:

1. Rip a CD (here as an example: Doolittle, by Pixies) on Ubuntu and Sound
Juicer Audio CD Extractor. You will get a bunch of mp3 files inside
/Pixies/Doolittle.

2. Copy the folder to the memory fo the device.

3. The file manager sees the songs in the right sorting:

01 - Debaser
02 - Tame
03 - Wave of Mutilation
04 - I Bleed
05 - Here Comes Your Man
06 - Dead
07 - Monkey Gone to Heaven
08 - Mr. Grieves
09 - Crackity Jones
10 - La La Love You
11 - No. 13 Baby
12 - There Goes My Gun
13 - Hey
14 - Silver
15 - Gouge Away

4. Open Media Player and go to this album.


EXPECTED RESULT

The songs appear in the same sorting, showing the track number or not.


ACTUAL RESULT

Songs scrambled with no evident sort criteria (it's not alphabetical, nor
duration, perhaps the exact time they were created when ripping the CD, or
copied to the device memory?):

Debaser
La La Love You
No. 13 Baby
There Goes My Gun
Hey
Silver
Gouge Away
Tame
Wave of Mutilation
I Bleed
Here Comes Your Man
Dead
Monkey Gone to Heaven
Mr. Grieves
Crackity Jones
Comment 23 Iago Toral 2009-01-28 16:56:41 UTC
This should be addressed in mafw now.
Comment 24 Andre Klapper maemo.org 2009-02-13 03:14:56 UTC
seems to be a tracker issue
Comment 25 Andre Klapper maemo.org 2009-04-23 19:13:43 UTC
Forwarding request from the internal ticket. Please post your results here.


 Could you specify the rdf query and the libtracker call to specify this data?

 tracker-query -s Music -p ./rdf-query -r Audio:TrackNo Audio:Album
Audio:TrackNo

Being rdf-query:
<rdfq:Condition>
  <rdfq:contains>
    <rdfq:Property name="File:NameDelimited" />
    <rdf:String>/home/carlos/Music/Soul Sirkus</rdf:String>
  </rdfq:contains>
</rdfq:Condition>

And I get the expected output:
Results: 11
  /home/carlos/Music/Soul Sirkus/World Play/01 - Highest Ground.mp3, Music,
World Play, 1
  /home/carlos/Music/Soul Sirkus/World Play/02 - New Position.mp3, Music, World
Play, 2
  /home/carlos/Music/Soul Sirkus/World Play/03 - Another World.mp3, Music,
World Play, 3
  /home/carlos/Music/Soul Sirkus/World Play/04 - Soul Goes On.mp3, Music, World
Play, 4
  /home/carlos/Music/Soul Sirkus/World Play/05 - Peephole.mp3, Music, World
Play, 5
  /home/carlos/Music/Soul Sirkus/World Play/06 - Periled Divide.mp3, Music,
World Play, 6
  /home/carlos/Music/Soul Sirkus/World Play/07 - Praise.mp3, Music, World Play,
7
  /home/carlos/Music/Soul Sirkus/World Play/08 - My Sanctuary.mp3, Music, World
Play, 8
  /home/carlos/Music/Soul Sirkus/World Play/09 - Friends 2 Lovers.mp3, Music,
World Play, 9
  /home/carlos/Music/Soul Sirkus/World Play/10 - Coming Home.mp3, Music, World
Play, 10
  /home/carlos/Music/Soul Sirkus/World Play/11 - Close The Door.mp3, Music,
World Play, 11
Comment 26 Andre Klapper maemo.org 2009-04-28 12:19:17 UTC
Forwarding comments from the internal ticket:
  "Alright, so everything seems to work here, According to the bug description,
tracks numbers were being sorted in ascii order, rather than numerically. I've
been doing some svn archeology, and this should have been fixed a long time
ago. Before this, DataType definitions for some fields (including
Audio:TrackNo) didn't match what Tracker could parse, so they were taken as
strings."
           and
  "Tested in a freshly flashed device, with some still-hot ripped tracks, and 
the sorting in the album is working fine."


Fremantle SDK alpha ships tracker version 0.6.6. This issue has been fixed in
more recent versions.
Now let's hope that SDK beta will include a more recent version.
Comment 27 Andre Klapper maemo.org 2009-04-28 15:15:09 UTC
Fremantle SDK beta ships tracker 0.6.92.
Resetting target milestone.
Comment 28 Ian Ryge 2009-12-15 03:26:53 UTC
This bug is present on my retail N900 (1.2009.42-11.002). Albums with ID3 v2.3
and v2.4 tags are sorted correctly based on the ID3 track numbers, while albums
with ID3 v2.2 tags (which are still produced by many current apps including
iTunes) get sorted alphabetically by ID3 song title. Obviously this really
needs to be fixed, but I think I'll convert my ID3 tags to v2.4 in the
meantime.
Comment 29 Andre Klapper maemo.org 2009-12-15 15:43:22 UTC
Thanks. Also updated the internal ticket about this.
Comment 30 Urho Konttori 2010-01-05 23:05:50 UTC
We need to fix this.
Comment 31 MKazia 2010-01-21 07:36:59 UTC
I have multiple CDs in albums. When songs are listed, expected order is
1. Artist
2. Album
3. CD
4. Track
Only if the above info is missing it should list sorted by title and if title
is missing then file name.
MAFW is ignoring the CD and Track while sorting. It's sorting only by title.
Comment 32 John 2010-11-10 18:23:25 UTC
DELL XPS M1330 laptop/WIN 7 64bit
Nokia PC-Suite v7.1.51.0
Easy CD-DA Extractor v12.0.1
Mp3tag v2.46a
N900: Firmware Version 20.2010.36-2

I am using Easy CD-DA Extractor for ripping my CD's. I always have all the
fields filled out(artist/title/album/genre/year) and 99% of the time I include
the image of the CD cover as well, so that I can search by various methods and
and make the search proccess on the phone as efficient as possible. A lot of
times what happens is that the album cover is replaced with a different one and
sometimes some of the songs are missing from the album(!!!) although going
through File Manager and looking it up, everything is there, but when I select
one of the "missing" songs for playbck, the ID3 tag info is missing and it
shows unknown for all the parameters I listed earlier. Playes fine though.
Eventually this makes it difficult to find the song through Media Player. If
there is a song lost, then the best chance of finding it is to select one of
the catagories and go under 'unknown'.... kinda sucks....then back to the File
Manager....kinda sucks again. The method I use for adding new albums to the
phone is by connecting the device through USB cable, because Bluetooth is
unstable and randomly disconnects when file copying is in proccess. Then I copy
the selected folder with the album and paste it under Data/Music. When I
noticed that one of the songs is missing from the media player I tried to
delete the album through the phone, because PC doesn't let you do that very
well and then paste it again. Now I have the song that Media Player couldn't
recognize before, but a different one is missing. In File Manager everything is
in order and nothing is missing. I don't see any pattern how Media Player
screws this up. It also has added one specific album cover to many songs that
didn't have a cover, but they are not related in any way, but I do have one
song that is from this album with this cover. What I've also tried is to
reapply the ID3 tags in the software called Mp3tag v2.46a, so that I could
maybe blame my ripping software, but no, that did not help at all. There is
definitely something wrong with the Media Player ID3 tag reading mechanism
which really ruins the experience with the n900. With the new firmware out one
would suspect that such issue would be resolved. Then again, maybe I'm doing
something wrong....although adding music to the phone shouldn't require a PhD
in programminng. At this point I wouldn't even care if they show up in the
wrong order as long as everything else would work. The only thing I haven't
tried so far is to delete all the music(~1800 songs) and copy it back. It
strikes me as such a simple problem that could be easily solved. I bought phone
as soon as it came out and obviously payed a bunch and these kind of problems
are not the ones I would like to encounter after almost a year n900 being on
the market.