Question thread #118

[pauamma]

It's time for another question thread!

The rules:

- You may ask any dev-related question you have in a comment. (It doesn't even need to be about Dreamwidth, although if it involves a language/library/framework/database Dreamwidth doesn't use, you will probably get answers pointing that out and suggesting a better place to ask.)
- You may also answer any question, using the guidelines given in To Answer, Or Not To Answer and in this comment thread.

Comments

Re: well howdy

[solarbird]

I don't know if anyone is still following this nonsense but

I did it

I did it by taking the .xml Dreamwith will hand me and processing that and my code is a complete - I must stress, complete - trashfire, but by god it works.

21 years of lj+dw+my old band blog all imported. 7261 messages and their comments.

Wordpress did not enjoy this experience. We both did some things it will regret, and I learned a bunch about resource allocation in php running under a webserver.

But eventually, it worked. Not as perfectly as I'd like but 99%. Thanks for the help, team - particularly denise. :D

Re: well howdy

[denise]

Oh YAY I was hoping you'd be able to get it! Was it the XML/RPC libraries?

Re: well howdy

[solarbird]

Well, once I realised I could just get a big XML chunk I poked at the old approach a little bit more and then just said to hell with it, I'm using the XML I can just, you know, have, and scraped together an importer for that.

Along the way I did start to see... they did some extraordinarily weird things in their comment processing? I mean, what am I looking at?! things?

And I'm wondering now if that's about resource control, because to bring in all my utter nonsense my way I had to up a whole bunch of limits - [wp-home]/wp-includes/functions.php needed to be given a five minute runtime max, everything else I bumped up to 90 seconds (defaults are 30 seconds in all cases); I lifted PHP's ability to allocate ram to an entire gig (though that was almost certainly excessive, it really topped out under 250mb but I was done screwing around with incrementalism lol), and I threw MariaDB's max packet size up also to 1G after reading about that being necessary in other large-database-import environments.

In short, this thing is a complete pig. But it runs - or, well, lumbers to completion - and that's what really matters. xD

Re: well howdy

[denise]

ooooooof, yeah, running into limits might also have been the case! Anyway, either way, I'm glad you figured it out and got it all working!