Migration stops every 2000 items or so + YouTube links not imported

bl1zzarD

Hi,

I recently bought a subscription because I needed your K2 to com_content migration plugin. It's pretty much straightforward and overall I think it works great, however before I start the actual migration, I've copied my client's site to a local machine in order to test it.

First, there was the extra field name error, people have already asked about it, but as I've already seen, changing names and aliases to unique values should solve this. But there's two other confusing things:

As I can see, the plugin works with 50-item batches, and I suppose this would be the only way to avoid timeouts when there are many items to import – my client's site, for example, has around 16,000 of them. However, once the modal window count gets to arount 40 batches done, it stops. Sometimes it goes past 40, sometimes it stops at 28, 29. The task manager confirms this: there's no CPU usage for the httpd process. If I re-initiante the import process, it seems to continue where it previously stopped, but there's no easy way to confirm this. Now I can assign as much memory as needed in order for the entire process to complete without any problems, so if you suspect this is the case, could you please advise on how to proceed and what I need to change (post_max_size, memory_limit, something else). Or is it safe to simply run the process again once it stops?
About half of the items (that's thousands) use K2 media field with YouTube IDs. This would be fairly easy to re-embed on the frontend using any of the J4-compatible 3rd party YouTube video plugins (even Joomlaworks' Allvideos is compatible, so why not). The Documentation page for the plugin (https://www.joomlart.com/documentation/joomla-plugins/k2-to-com-content-migration-plugin) says that the plugin imports "Video type Embed(Youtube, Vimeo)", but I can't find this data anywhere inside the newly-created com_content item – not in any of the default fields, nor in the custom fields. This one is very important.

Thank you very much in advance for your answer and all the best in 2023.

saguaros

Hi bl1zzarD

Thanks for using our product!

Yes, please try to run the migration several times if your site has large collection of K2 content.

We're improving this K2 migration plugin so it can handle site with that amount of data better.

Regards

bl1zzarD

saguaros thank for your quick reply, however I don't find it very helpful ... It's not a problem for me to run the plugin 10 times, it works blazingly fast considering the amount of data, but I need to be absolutely certain it won't make double imports or skip some items this way. Also, you seem to have missed my question regarding "video" field import, this is also very important, so I would need you to shed some light on this as I can't figure out where and how exactly the plugin moves this data (video provider, video ID). The hyperlink to the documentation I included in my original post says that the plugin imports video fields, so I guess I'm missing something.

Please take your time, no need to hurry, and I'm not being hostile here – I wouldn't be able to do this without the help of your plugin anyway, plus it does 99% of the job "out of the box" – but I really need helpful answers.

Thanks again in advance!

saguaros

bl1zzarD It will not double or skip items, it will import any item that has not been migrated yet.

For the video, could you share the URL + super admin account so I can take a look?

bl1zzarD

saguaros Thanks for the reply, and sorry I'm a bit late, some problems came up with the dev server because it's full of huge sites (nothing related to your plugin). I'll try and move this particular site to another server, and then send you a PM. Thanks in advance for your assistance with this!