Monument ([info]marnanel) wrote in [info]marnanel_joule,
@ 2008-02-09 23:48:00
Previous Entry  Add to memories!  Tell a Friend!  Next Entry
partlock
A couple of people have emailed me in the last week to tell me that they're still getting the "Your account hasn't been loaded into the new system yet." error (example), even though Joule 3 was launched months ago. This is (in the code) called "partlock", so that's what I'll call it here.

I had forgotten quite what caused this, so I went to take a look. Joule 2 used files on a filesystem to store each user's data; Joule 3 uses a database. What I found is that if a user doesn't exist in the Joule 3 database, the program checks to see whether there was an old Joule 2 file. If there is, it assumes the data wasn't loaded up into the Joule 3 database correctly, and you get that error.

Originally you would only see this if the import script hadn't reached your name yet, alphabetically. But the reason this happens now is that the import script just dropped accounts it couldn't import, leaving all the data safely in a file on the disk: it had a couple of hundred thousand accounts to import, and even though the vast majority imported just fine, if the script had stopped every time there was an error so that someone could fix it, it would have taken all year. (Bear in mind that Joule had to be stopped while the import script ran, to ensure integrity.) So instead, if the import failed because there was some kind of error, it just went on to the next one, thus ensuring that there'd be no Joule 3 database record but the Joule 2 file was still on the filestore. In other words, you'd get the partlock error.

The way to fix this, which I'll try to get working tomorrow if I can, is to find all the records which exist in Joule 2 but not Joule 3, and examine them to find why the original import script failed to import them. I suspect there was some sort of corruption issue, but I don't know. If the worst comes to the worst, I will just abolish the error and the accounts will begin again with no history, although that would be a rather unhelpful solution.



(Post a new comment)


[info]smashfantastic
2008-02-10 05:48 am UTC (link)
Thanks for clearing that up! I'll keep checking back here. Probably should've joined the community already, so I'll just get on that now...

(Reply to this) (Thread)


[info]marnanel
2008-02-10 05:50 am UTC (link)
No problem! I hope it was okay to use a link to your Joule page as the example in the post.

(Reply to this) (Parent)(Thread)


[info]smashfantastic
2008-02-10 04:20 pm UTC (link)
Fine by me.

(Reply to this) (Parent)(Thread)


[info]marnanel
2008-02-17 04:10 am UTC (link)
Okay, so, I have finally sat down, and with the aid of an hour's debugging, some coffee, a vanilla milkshake, and some shouting at the computer when I managed to turn off Joule for everyone for five minutes, this is what I have found. Best I can tell at present, all or most of the accounts that are supposedly problematic have no history, i.e. no changes between one day and another day. You seem to have used Joule once a long time ago and never again. Here's what Joule 2 had for you:

>>> pickle.load(file('pandorathene'))
{'date': 13523, 'current': ['abnoba', 'aviria', 'babble_ink', 'bessyboo', 'fr_eek', 'grapeyquoter', 'green_griffin1', 'kass_diamante', 'moonlingmaid', 'rahirah', 'solar__eclipse', 'splatteredink', 'thesploggyist', 'treehousedreams'], 'version': 1, 'history': {}}

Note the empty history. This was making Joule 3 assume there was no data for you, but when it found that Joule 2 *had* known you, it got confused.

The difficult thing is knowing when an account really is a new one we didn't know. So the fix is that accounts with no history are also checked whether there was a "current" list before we assume that.

I hope that's some help; your account seems to be working now. I am sorry for the delay! Please do let me know if there's anything else I can do.

(Reply to this) (Parent)(Thread)


[info]smashfantastic
2008-02-17 04:29 am UTC (link)
Thank you so much!

(Reply to this) (Parent)


[info]mcfnord
2008-02-10 09:19 am UTC (link)
I've got ten million fdatas if you ever feel like swapping bits!

(Reply to this)


[info]malapropos
2008-02-14 06:01 am UTC (link)
Hi, I just got a rename token to change my name from "mysidisvicious" to what I have now. When I tried to check who has added or deleted me, I get that error. Does that also mean I won't be able to see all of my old archives because I've renamed my journal? :[

(Reply to this) (Thread)


[info]marnanel
2008-02-17 04:14 am UTC (link)
There are or were two problems here:

1) You renamed away from one journal to another. I can if you like try to match up the old data with your new account (I've never done it before, but it shouldn't be hard).

2) It happened by chance that you renamed to a name which was previously owned by someone who had visited Joule exactly once. Therefore, you had the same problem as [info]pandorathene did. This part should be fixed now.

(Reply to this) (Parent)(Thread)


[info]malapropos
2008-02-17 07:18 am UTC (link)
Yes, exactly, I think this name (malapropos) was an account that had been deleted and purged. Would you be able to match up my old data from "mysidisvicious" with this one? I would appreciate that soooooo much. :]

(Reply to this) (Parent)


Create an Account
Forgot your login or password?
Login w/ OpenID
English • Español • Deutsch • Русский…