DW Perl module client

[pseudomonas]

Does LJ::Simple work reliably with Dreamwidth? If not, is there a comparable perl module that does? (I'd rather rely on someone else's testing than conduct my own, which is likely to be more slipshod)

Also (and relatedly), is there a way that given a DW entry that's been either imported from, or crossposted to, LJ, I can get (programmatically) the ID or URL of the LJ entry, without resorting to comparing timestamps and post contents?

ETA: if there's no Perl thing suitable, does anyone have any ideas for Java packages that would do the same?

(x-posted from perl, where I got suggestions to try here)

ETA: http://www.chiark.greenend.org.uk/~adamb/dw-thataway.pl.txt is the current state of the script. I've tested it on a small test journal and it seems to do what it's supposed to do. If anyone's brave enough to test it on real-world data and let me have any bug reports, that'd be wonderful.

Comments

[foxfirefey]

My guess is it's going to depend on what you're trying to use it for--thoughts?

[pseudomonas]

I'd like to build something that can go through LJ entries that have already been cross-posted or imported to DW, and for some subset of them based on things like their visibility, length, whether they contain polls, and so on, edit them so that their text is (perhaps partially) commented out, adding a note saying that the canonical version has been moved to such-and-such a DW post which is thataway.

[cesy]

This sounds like a really awesome tool.

[pseudomonas]

If it ever gets built, I'll let you know :)

[pseudomonas]

The current state of the thing is at http://www.chiark.greenend.org.uk/~adamb/dw-thataway.pl.txt

[erika]

Hmmm... well there's a way to turn on "Crosspost URL" so that data must be saved SOMEWHERE (see my entries for examples). I'd wait around here for someone with more code knowledge than me to confirm this though.

[pseudomonas]

The data must be saved, since one can edit entries and the crossposted copy is edited too. I just don't know if its address is exposed to any API.

[exor674]

There aren't that many client packages for the Dreamwidth/LiveJournal protocols, sadly...
LJ::Simple might ( the xpost data might get in the way -- need to make a bug to fix that ) work, but it and the flat protocol itself are the biggest piece of crap ever.

Probably the *best* way to get all entries on ones Dreamwidth is to follow the flow used by the entry importer ( there are so many weird glitches with syncitems-based fetching, but I think we've worked around most of them )

call_xmlrpc and xmlrpc_call_helper from http://hg.dwscoalition.org/dw-free/file/518b72120000/cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm

as well as lines 110 to 167 and lines 188 through 387 of http://hg.dwscoalition.org/dw-free/file/518b72120000/cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm

The source URL for imports can be found inside the import_source logprop
The xpost details can be found in a Storable'd hash under the xpostdetail logprop

[pseudomonas]

LJ::Simple (which uses the flat interface) does seem to work for getting at the content of the entries, but not at the xpostdetail or import_source logprops (although other props like tags are retrieved just fine).

[pseudomonas]

I think I've got something doing the DW-side bits with XML-RPC :) thanks!

[pseudomoans]

The xpost details (when thawed) seem to be keyed on an integer that's presumably the id of the account being used. Is there a way of finding which account goes with which integer?