LiveJournal Development

Home

You are viewing the community

lj_dev
Create a LiveJournal Account Learn more

Explore LJ Culture Entertainment Life Music News & Politics Technology

LiveJournal Development

[entries|archive|friends|userinfo]

LiveJournal Development

[	userinfo	\|	livejournal userinfo	]
[	archive	\|	journal archive	]

syncitems response times out if the list is too long

[Jul. 29th, 2008|04:00 pm]

Hi,

I was trying to figure out a problem with the LJ-SEC tool, and I found something interesting.

I have nearly 8,000 entries. When the LJ-SEC tool tries to use syncitems with no start date, the call times out.

EDIT: After investigation, the problem was not the number of entries, but a result of using the LJ built-in Edit Journal Privacy tool. For more details please refer to this post.

Just wanted to report this behavior somewhere in case it's undesirable. In the meantime I'm looking into other, more incremental, ways to get a journal's history.

3 comments|post comment

SQL and Linq

[Jul. 31st, 2008|10:47 pm]

For a team project asignment we are setting up a client - server web site. We have on our back end SQL our database, with a linq layer on top of this. The web site is dyanamically rendered with with AJAX and runs on ASP.net technologies. Pretty standard. Unfortunalty i got cast the job of doing such jobs a database chores, database management, user management and authenitication. I have been considering how best to source control my database as the project procceds throught its iterations. I suspect you could write some kind of sql create scripts that runs tear down and then the rebuilding of the tables and relationships on some agreed upon preinstaled local server.
I have seen that linq is able to to this, by adding and interfacing with some agreeed upon local server. Is this safe, im not sure how exaclty the linq layer, and if it would give the same functionalty. Would deployment onto a like webserver be the same? Are there any pitfalls to this method,?

4 comments|post comment

PostEvent API Tags

[Jul. 31st, 2008|02:38 pm]

Is there a way to add tags with events when using postevent api???
Thanks

1 comment|post comment

Trouble with S2 layers

[Aug. 5th, 2008|10:21 am]

I've just started building my own private livejournal-based server, and I'm having a problem with some of the built-in layers. Specifically, the disjointed, lickable, variableflow, and deardiary layers. If I change these layers to set external_stylesheet = false, they work. However, I'd rather not do this because it will definitely affect the performance of my server. The hardware and bandwidth is limited, and so is the userbase, but the volume of traffic the few users generate will be high, and I'm afraid turning off external_stylesheet for those layers will impact it fairly heavily. The crux of the issue is that the bit of S2 code in the core layer that handles outputting the external stylesheet <link> tag when the property is set doesn't work, probably because Page::stylesheet_url isn't getting generated. I'd like to investigate this further, but so far I haven't been able to get any debugging data to look at. There aren't any errors in my apache log at least.

3 comments|post comment

Problem calling syncitems with no start date on an older journal [Jul. 29th, 2008|05:01 pm]

This is a revision of a previous question I submitted, with more information.

IMPORTANT EDIT: I found that the problem is not what I thought it was, and the error should now be easy to reproduce. The problem occurs when the built-in edit journal privacy tool is used. I have edited this entry to reflect this fact, and removed misleading references to the problem occurring on "large journals."

When the LJ-SEC tool tries to download my journal history (via a syncitems request) the server never responds.

I created a simple test journal to determine the cause:

oak_and_sage. This journal has only seven entries. I did many things to this journal, and tested LJ-SEC after each one; the syncitems call began timing out immediately after I used the built-in edit journal privacy tool to change all public entries to friends only.

I've done a little debugging (since LJ-SEC is open source) to determine what's going on. The server is failing to respond to the initial syncitems call (when it has never done a sync before).

Here is the LJ-SEC code to transmit a web call to LJ:

( LJ-SEC source code )

I wrote a log of the timed-out transmission (on

sithjawa) to a file. Here's what I found.

( Transmission information )

Is this expected behavior? What should be done to prevent it?

EDIT: I found the following in the protocol guide: (link to actual page in the guide)

syncitems. If you are trying to download someone's entire journal, this is the mode to use. This mode is the only way you can account for edits that the user has made to their entries without using your client. This is also the most efficient way of downloading entries, because the server will send you a bunch at a time (say, 100). This mode is used in conjunction with the appropriately titled syncitems client protocol mode.

Looking at the LJ-SEC code, it appears to be following the procedure outlined in the pseudocode example for properly downloading all items in a journal. This makes the timeout even more puzzling.

link 5 comments|post comment

[Jul. 26th, 2008|06:20 pm]

I'm looking for livejournal source code. It's not in sixapart's repository, so where can I find it?

3 comments|post comment

Livejournal vs. Windows Live Writer

[Jul. 26th, 2008|03:07 pm]

Hello All,

I want to hack WLW to make support for user tags and (probably) mood and music.

1. In WLW for LJ interop Blogger API is used. Is in LJ Blogger API implementation any way to send metadata with post? Documentation states:
"LiveJournal-specific meta data (current mood and music) are supported by including a line consisting of lj-metadatakey: metadata in the post body (e.g. lj-mood: happy).", but when I'm trying to include such line in post body in WLW nothing happens. Is it problem of the way how WLW format post or LJ Blogger API have been changed?

2. Another way is to use ATOM Protocol. But WLW can't retrieve categories list. What version of ATOM protocol is used now?

Unfortunately, I haven't enough free time to write complete LJ XML-RPC API implementation for WLW, I can just rewrite or modify some methods in WLW.

API for user profile and photos

[Jul. 24th, 2008|12:18 pm]

whiteprohorenko

Hi,

Are there any LiveJournal API that will allow me to read and update user's profile, as well as photos? I took a look at http://www.livejournal.com/developer/, but didn't find too much about actually profiles there.

Thank you.

2 comments|post comment

Uploading photos on LiveJournal

[Jul. 23rd, 2008|05:35 pm]

[

mood

|

curious

]

Hi All.

I want to write a simple utility (using Java) to upload pictures in LiveJournal Scrapbook directly from my PC (or, say, a cellphone???). I need some help to get started, i.e.

What documentation I should go through.
What APIs I can use.
The general method to accomplish what I intend to accomplish.

Just an outline would be enough; I will find out the rest.

Thanks.

Dexter.

6 comments|post comment

Fotobilder export

[Jul. 20th, 2008|11:48 pm]

I gave up on getting the perl client working in Cygwin and tried OS X instead (I don't have a Linux box). After some effort with CPAN, fotoup.pl stopped complaining about missing modules, but it didn't exactly work:

$ ./fotoup.pl --backup
To upload: 0 from data, 0 from receipt

Fetching export.xml from server...
Couldn't fetch export XML file from server

Can anyone get the perl client to back up their pictures?

I'm getting it from here: http://pics.livejournal.com/site/clients?file=fotoup.pl

4 comments|post comment

Fotobilder export

[Jul. 16th, 2008|11:24 pm]

I'm having trouble with my Fotobilder client. I'd like to be able to export the user's pictures as a backup. I knew that the Perl client did this, so I looked at how it works. It's rather different to the rest of the Fotobilder stuff: it seems to get the export data by POSTing to http://pics.livejournal.com/manage/export, and it seems to authenticate by a challenge/response cookie. I hope I've understood this correctly.

My first problem is that when my client requests an export I get a 302 sending me to the LJ login page - presumably because the server doesn't like my cookie. To find out if it was just me getting it wrong, I tried running the Perl client. My second problem is that when I try ./fotoup.pl --backup it says

Fetching export.xml from server...
Can't locate object method "new" via package "XML::LibXML::SAX" at /usr/lib/perl5/vendor_perl/5.10/XML/SAX/ParserFactory.pm line
 43.

Now I'm stumped.

Is the Perl client broken?
Does the Perl client work under Cygwin?
Does the server still accept this style of authentication?
Is there any way to get the export data through the normal protocol?

4 comments|post comment

MultiLJ: Feedback request and poll

[Jul. 15th, 2008|07:39 pm]

raven_ap_morgan

[

mood

|

curious

]

I've not gotten a lot of feedback yet about MultiLJ and I'm wondering to what extent those who have downloaded it have had success with it. I'm about to post a new version of it, with additional error trapping, bug fixes, and some minor cosmetic upgrades in the friends list. What I'm looking for is some feedback as to how things are going and what I need to concentrate on with it.

Also, I'm looking at several options for continued development. Development of a Mac client is right out for the present, as I'm running Tiger on my Mac and Apple is only distributing a development kit that's compatible with Leopard. However, I recently made my development PC a dual-boot box with Ubuntu, so Linux development is quite doable. So, here's what I'm considering - let me know what there's demand for:

1) An LJ client for Linux/GTK+
2) A LJ archiving program
3) More concentrated effort on MultiLJ, perhaps adding things like uploading photos

Comments would be appreciated.

4 comments|post comment

Captchas

[Jun. 24th, 2008|12:43 pm]

Hello all,

I've been trying to get captcha to work this morning, and I'm almost there. I've got them generated and all, but they're showing up as broken images. I've tried setting the blobserver path to be $HOME/var/blobs, /home/lj/var/blobs/, /home/var/blobs/1/0/000/001/captcha_image/0/ and nothing seems to work, what's the trick to getting it to work?

Here's my current config. It also doesn't seem to be showing them for anon comments :(

%LJ::BLOBINFO = (
"clusters" => {
"1" => "$LJ::HOME/var/blobs/",
},
);
$LJ::ANTI_TALKSPAM = 1;
%LJ::HUMAN_CHECK =
(
create => 1,
anonpost => 1,
);
$LJ::RATE_COMMENT_ANON = [[0, 65535]];

Thanks!

11 comments|post comment

Software Release - MultiLJ

[Jun. 24th, 2008|10:56 pm]

raven_ap_morgan

[

mood

|

hopeful

]

I'm announcing the release of MultiLJ, a new LiveJournal client for Windows. Its unique feature is that all of its functions - journals, profiles, post editors, and so on - are independent windows that are hosted by the application. In other words, it is an MDI application and is also not dependent on the user's default browser. Editing and deletion of past posts are supported, as is custom friends groups. There is a comprehensive Help file available for Windows XP users (not available under Vista).

Because it is a young application, I consider it beta in nature. Hence, feedback and error repost are much appreciated. The download can be found at its community page,

multilj, and issues with the program can be either reported there or at multilj@ravenslakeconsulting.com.

Cron Errors... [Jun. 19th, 2008|08:55 pm]

I'm getting these cron errors very often. Any ideas how I can correct the problem?


Global symbol "$remOteid" requires explicit package name at /var/www/journal/cgi-bin/ljlib.pl line 439.
Compilation failed in require at /var/www/journal/bin/qbufferd.pl line 9.
BEGIN failed--compilation aborted at /var/www/journal/bin/qbufferd.pl line 9.

Less often (but still multiple times daily) I get this:


Global symbol "$remOteid" requires explicit package name at /var/www/journal/cgi-bin/ljlib.pl line 439.
Compilation failed in require at /var/www/journal/bin/ljmaint.pl line 16.

Thanks ahead of time.
TDP.

link 5 comments|post comment

Generating an ECP hash. [Jun. 19th, 2008|01:13 am]

[

mood

|

annoyed

]

(Bumping this up from earlier comments in the hopes of assistance.)

I'm stuck on one issue. I've used the form sent out via comment emails as a basis, but I'm having a hard time generating the ECP hash.

In talklib.pl, the hash is generated like so:


sub ecphash {
my ($itemid, $talkid, $password) = @_;
return "ecph-" . Digest::MD5::md5_hex($itemid . $talkid . $password);
}

In PHP, I'm doing this:


$TalkID = '1010';
$ItemID = '010101';
$Password = 'mypassword';
$ECPHash = md5($ItemID . $TalkID . $Password);

However, the submitted form is rejecting the hash as having the wrong password. Is there some further munging of the password that needs to be done to generate a valid password for hashing? Or is the PHP md5() doing something different than the Perl library?

Now, I know the TalkID and the ItemID aren't the problem, which leaves me with one of two options:

1) The MD5 hashing functions work differently between PHP and Perl (which would be odd).

2) The password being used to generate the hash on LJ's side is not a clear-text password, but rather some sort of encrypted form of the password being pulled from their database

Any clues?

Edited To Add: Thank you,

ciaran_h! Here is the fixed and working code:


	$Journal = 'JournalReceivingReply';
	$Poster = 'UsernameOfReplyingParty';
	$TalkID = '01010';
	$DItemID = '101010';
	$JItemID = intval($DItemID/256);
	$Password = 'apassword';
	$ECPHash = md5($JItemID . $TalkID . $Password);

	echo '
<html>
	<body>
		<form method="post" target="ljreply" action="http://www.livejournal.com/talkpost_do.bml">
			<input type="hidden" name="usertype" value="user" />
			<input type="hidden" name="parenttalkid" value="' . $TalkID . '" />
			<input type="hidden" name="itemid" value="' . $ItemID . '" />
			<input type="hidden" name="journal" value="' . $Journal . '" />
			<input type="hidden" name="userpost" value="' . $Poster . '" />
			<input type="hidden" name="ecphash" value="ecph-' . $ECPHash . '" />
			<input type="hidden" name="encoding" value="windows-1252" />
			<b>Subject:</b> <input name="subject" size="40" value="" />
			<p><b>Message:</b>
			<br />
			<textarea rows="10" cols="50" wrap="soft" name="body"></textarea>
			<br />
			<input type="submit" value="Post Reply" />
		</form>
	</body>
</html>
	';

link 12 comments|post comment

editfriends XML-RPC issue. [Jun. 16th, 2008|03:43 am]

[

mood

|

annoyed

]

Hi!

I'm trying to get my PHP-based XML-RPC client update friends' lists using the editfriends method, but I'm getting an odd response. Here's my PHP code:


	require('Configuration/Configuration.php');
	require($FunctionRoot . 'xmlrpc.php');

	// LJ XML-RPC Variables
	$add = array();
	$add['username'] = 'user_to_be_friended';
	$add['fgcolor'] = '#00688B';
	XMLRPC_prepare($add,'struct');

	$array = array();
	$array['username'] = 'professormass';
	$array['password'] = 'my_password';
	$array['add'] = $add;

	XMLRPC_prepare($array,'struct');

	$result = XMLRPC_request('www.livejournal.com','/interface/xmlrpc','LJ.XMLRPC.editfriends', array($array));

I get this response:

Application failed during request deserialization: wrong element 'username'

Virtually the exact same code works for using the postevent method. Anybody have any clues on this one?

link 1 comment|post comment

Is efg_set_groupnum_public working?

[Jun. 12th, 2008|12:04 am]

raven_ap_morgan

[

mood

|

confused

]

I think my subject line says it all - I'm currently implementing custom friend groups in my LJ client (

multilj), and so far, I can't seem to get that command to work properly. My other "efg" commands seem to be working okay, but that one is not - I execute it and it returns without an error, but without changing the public status of the friend group in question.

Any thoughts?

Adding Analytics Code To Journals

[Jun. 6th, 2008|05:00 pm]

Hello,

I am interested in adding some analytics (Google/Mint) code into journals. I've figured out how to add it into the main site (very simple), but getting into journals is proving to be a bit more difficult. I am not sure if I have to edit each s1 and s2 theme or if there's some place where I can place it once and be done with it.

Any help is much appreciated!

Thanks!

Update: Figured it out! For S2 stuff, edit the file /cgi-bin/LJ/S2.pm. I stuck it in around line 1957, seems to work fine :) As for S1, that took some poking around, but it seems /cgi-bin/ljviews.pl does the trick, I inserted this code:

$lastn_page{'head'} .= qq{YOUR SCRIPT CODE \n};

around line 1106 and it seems to be working as well, hopefully this helps someone!

3 comments|post comment

Delicious Livejournal Abandonment

[May. 28th, 2008|05:45 pm]

Hello,

Long ago I developed a script which parses delicious daily post data to LiveJournal due to (long ago) XMLRPC weirdness.

I called this script Delicious LiveJournal and previously had an open relay for which anyone could relay their delicious information.

Well I've graduated and my college webspace is cancelled so I am going to make the script available once again on a different host, however, there will not be any public relay available, so if you previously used this client, please download this code and put it on your own server.

Delicious LiveJournal

All you need is a server running PHP5. Put both scripts in a web accessible directory, and away you go. I've been really bad about maintaining development on this, I only added what I needed and used, so many others have made additions or subtractions as they saw fit for their uses.

Feel free to edit the code and redistribute but attribute the guy who wrote the XMLRPC library and me.

Have a great day.

7 comments|post comment

navigation

[	viewing	\|	most recent entries	]
[	go	\|	earlier	]