I have a wordpress site with 5k post and each post has average 25 comments. so 125k total nodes have to be added.
I need import those posts and comments into drupal 6 .
I have written a script to import those post/comments into drupal by drupal's cron service.
but the cron service keeps time out. because import 125k nodes one by one is very slow.
what can i do to imporve drupal importing speed?
i am use drupal built in node_save(), comment_save() method to do it.
I have not find out a way to use customized SQL query to increase importing speed yet.
I am execute my script through drupals's cron.php, that mean even i have set 'max_execute_time' to unlimited, but that only affects PHP , apache server has it own time out setting.
PS:
comment is not node in drupal, but that mean, there are still a lot of comment_save() be called, that make this importing process very slow.
Have you looked at the Wordpress Import Module?
http://drupal.org/project/wordpress_import
Usually in Drupal, someone has already done whatever you're looking for, wrote a tutorial, and 5 people have created a module to do the same exact thing. :D
Related
A few months ago I created a staging Wordpress site to implement some changes on my website. The databases run on phpMyAdmin (although I'm not sure if this is relevant). I would like to save the comments (the ones that are already published and the ones I've received recently), so my plan is to save them as it follows:
Save all comments and disallowed IPs from the regular website. I believe this is done by downloading the Commentmeta and Comment databases, although I'm not 100% sure. Are there other relevant databases?
Import those comments to the staging site.
Export the whole staging site (databases and webspace) to the regular website and let it run all the updates.
If this isn't the right way to do it or you know a better / more effective / safer method I'd appreciate to know it.
I'm trying to locate the file in which the Comment Blacklist / Disallowed List of my website is stored. I don't use any comment plugins besides the Subscribe to Comments Reloaded, although I don't think this one would store the data I'm looking for.
I'm fairly new to web developing, but I'm not sure if this file should be on a specific database or on a certain folder of the webspace, so all insights are welcome and much appreciated!
Case:
A old website developed with wordpress and run for serveral years.
Now, this wordpress website is giveup and will be re-developed to a new website which is not using wordpress anymore.
Old data i.e. article content, uploaded image file, members' info etc will be migrated to the new website.
Question:
1. Is it any tools for this type of migration?
2. If there is no tool for data transfer and I need to export the content from mysql, where can I get the article content in database?
3. Where can I find the uploaded file?
Data migration is always dependant on two things.
1. If your current framework/CMS can export the data you have, and
2. If the new framework/CMS can import data that you have just exported.
Since both frameworks are different, i.e. WordPress to any other CMS, your new CMS must be able to map the exported XML files. Which means, it must be able to customize the import process to tell what bits of data is Title, Content, Categories etc.
To answer your questions
Is it any tools for this type of migration?
Since you didn't mention what you new framework is, no one can really suggest a tool. Just google for "WordPress to YOUR-NEW-FRAMEWORK migraiton" and you'll get a number of tools. If the new framework is a custom PHP framework then I think you'll have to import the data manually or code an import script for it.
WordPress has a pretty good export tool. Check this page to learn how to export WordPress content.
Where can I find the uploaded file?
The uploaded files are referenced in the exported XML file, so at the time of import anywhere else, they can be fetched and downloaded if you can. Otherwise, you can find them in the uploads directory located at YOUR-SITE-ROOT/wp-content/uploads/
UPDATE:
As you are not targetting any framework/CMS but want to show the data with custom PHP, I'd suggest two methods.
Use the current database that WordPress is using and build your PHP script around it, benefiting from wp_posts and wp_postmeta tables.
A better way to go with this is using the WP REST API. This way, you keep the WordPress installation as is and still use it's data in your custom PHP site. Advantage of this method is that you won't have to bug your mind with scripting around database structures you have less information of.
I've had to migrate many Wordpress web sites from different domains on the same server to different domains on different servers. In few cases, a simple export was sufficient. In many cases, an import failed to load the media correctly and I was forced to use a common work around.
Workaround (for those wondering):
I download from the original site and upload to the new site the uploads folder where my media is stored via FTP. Once this transfer is complete, I use the plugin Add From Server to select each individual image, one directory at a time.
This is the best workaround I've found, but it's hardly efficient. It's incredibly time consuming and stressful on your bandwidth.
If you have any better suggestions, I'm all ears. But primarily, I want to know the "Why" to this question. What causes Wordpress to have such a hard time managing media migration while migrating posts, pages, and users are much less of a headache?
There is an excellent tool that certainly eases Wordpress migration WordPress (and others) Search and Replace Tool. With that tool it's easy to search through the entire database for all occurrences of old domain, and replace that with the name of new domain. After replacement all the pictures and widgets should work properly.
The way I'm moving WordPress:
export and import the database with phpMyAdmin
transfer the files with FTP program like FileZilla
edit the wp-config.php settings for a new domain
search and replace on the database with InterconnectIT Search and
Replace Tool
I have a site that I has been created in Adobe Business Catalyst. I am not a fan of this CMS. I am looking to change it to a WordPress site. Is there any easy way to do this? Is there any kind of conversion software or service? I want to keep all the file names and redirects, etc the same.
One of my clients wanted to leave Business Catalyst and merge it with a Wordpress.com blog. The way I got around Adobe's lack of export was as follows;
I used my Linux Server to pull everything off the Adobe Servers using
wget --mirror -p --convert-links -P ./Local/Dir Website-ULR
Tutorial Here, Number 10
All the HTML files came down without any extensions so;
I copied the directory to my Mac and used Fork Lift to batch rename the files to add .html - though any renaming software will do.
The import tool for Wordpress needs an index file to find all your pages so I needed to make an index.html page with links to every post so;
I copied them back to the Linux machine and used
tree -H baseHREF ./Local/Dir
depending on OS you may need to download the tree package or similar.
This then generated an onscreen HTML file in the Terminal Window so;
I copied the HTML code it created and put it into Dreamweaver with the rest of the site, though any software will do, to run a batch clean up of the links.
As Wordpress.com doesn't allow you to install plugins I needed to put it on a my local installation of Wordpress to do the import.
I then used the Import HTML 2 plugin to get the pages into my local Wordpress installation
As I was moving the files to a Wordpress.com site;
Export from from my Wordpress and import into their blog.
I hope this helps anyone, in total it took me 12 hours to find all the tools I needed and to work out all the steps I needed. If i needed to do it again it would take up to an hour now I know how to do it.
I had more links in the post but as I'm new to the forum I was only allow 2.
Better people than I might be able tell you a quicker way to do this.
The only things that can be "exported" in Business Catalyst are E-commerce products and Web App items - they can be exported as .CSV files. You can then hire a programmer to convert them over to a format that works with Wordpress.
Exporting blogs from the Business Catalyst blog module is tricky - one way to do it is to enable RSS and copy the RSS feed and open it in excel to save it as a .CSV or .TAB file where you may be able to import the blogs or get a programmer to convert it into soomething Wordpress compatible.
Thank you for taking time to better explain your platform to me.
In the way of an answer, I recommend the following:
Export your current web site details into a csv file using Screaming Frog.
Then use the CVS Importer WordPress Plugin
This is working for me. I would still be pleased to hear if others have found a process that they also find suitable.
Can anyone recommend an xml rpc library or client for wordpress using java?
I've run into migration hell moving a joomla install to wordpress.
Main reason for wanting to use rpc now is because i will be using it as my primary way of posting to the blog so i'm putting a simple client together and it needs to be configurable enough to allow me to port my joomla posts.
Some posts in future will just be reports generated from a java program as well so, its kinda essential i get something now if possible.
BTW if anyone understands the current wordpress table structure and can advise on how to do direct mysql inserts then i'm open to that too.
thanks in advance.
Have a look at http://code.google.com/p/wordpress-java , I've just added a few features.
I've just posted this link on a different WordPress question:
Database Description from WordPress Codex. That will help you understand WordPress' table structure.
Your project sounds pretty interesting. A quick google search shows some info on Java and XML-RPC: 1, 2 (javax.xml.rpc ).
Second link belongs to Apache XML-RPC, probably a good option for your project.