pauamma: Cartooney crab wearing hot pink and acid green facemask holding drink with straw (Default)
Res facta quae tamen fingi potuit ([personal profile] pauamma) wrote in [site community profile] dw_dev2023-02-01 01:57 am
Entry tags:

Question thread #118

It's time for another question thread!

The rules:

- You may ask any dev-related question you have in a comment. (It doesn't even need to be about Dreamwidth, although if it involves a language/library/framework/database Dreamwidth doesn't use, you will probably get answers pointing that out and suggesting a better place to ask.)
- You may also answer any question, using the guidelines given in To Answer, Or Not To Answer and in this comment thread.
solarbird: (Default)

Re: well howdy

[personal profile] solarbird 2023-02-21 05:38 am (UTC)(link)
Well, once I realised I could just get a big XML chunk I poked at the old approach a little bit more and then just said to hell with it, I'm using the XML I can just, you know, have, and scraped together an importer for that.

Along the way I did start to see... they did some extraordinarily weird things in their comment processing? I mean, what am I looking at?! things?

And I'm wondering now if that's about resource control, because to bring in all my utter nonsense my way I had to up a whole bunch of limits - [wp-home]/wp-includes/functions.php needed to be given a five minute runtime max, everything else I bumped up to 90 seconds (defaults are 30 seconds in all cases); I lifted PHP's ability to allocate ram to an entire gig (though that was almost certainly excessive, it really topped out under 250mb but I was done screwing around with incrementalism lol), and I threw MariaDB's max packet size up also to 1G after reading about that being necessary in other large-database-import environments.

In short, this thing is a complete pig. But it runs - or, well, lumbers to completion - and that's what really matters. xD
denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)

Re: well howdy

[staff profile] denise 2023-02-22 02:53 am (UTC)(link)
ooooooof, yeah, running into limits might also have been the case! Anyway, either way, I'm glad you figured it out and got it all working!