Migrating communities from Google+ to Discourse
I wrote an import script to move Google+ content into Discourse. It is working in my development environment, and I'll be offering it in a PR to Discourse.
Importing Friends+Me (perhaps also the eventual Google Community Takeout format?) into Discourse will be able to preserve both Google login and community content with continued ownership of that content in the new community for users who choose google login to their Discourse forum as at least one authentication method.
~I have been hacking away at an importer for several maker communities moving to forum.makerforums.info and there's also a bounty that a professional Discourse developer might be interested in, so between us it is likely to happen. Don't count on me (this is my first exposure to Ruby) but feel free to sweeten the bounty pot at https://meta.discourse.org/t/bounty-google-private-communities-export-screenscraper-importer/108029/11 if you want to make a professionally-developed importer more likely.~
https://meta.discourse.org/t/bounty-google-private-communities-export-screenscraper-importer/108029/11
I wrote an import script to move Google+ content into Discourse. It is working in my development environment, and I'll be offering it in a PR to Discourse.
Importing Friends+Me (perhaps also the eventual Google Community Takeout format?) into Discourse will be able to preserve both Google login and community content with continued ownership of that content in the new community for users who choose google login to their Discourse forum as at least one authentication method.
~I have been hacking away at an importer for several maker communities moving to forum.makerforums.info and there's also a bounty that a professional Discourse developer might be interested in, so between us it is likely to happen. Don't count on me (this is my first exposure to Ruby) but feel free to sweeten the bounty pot at https://meta.discourse.org/t/bounty-google-private-communities-export-screenscraper-importer/108029/11 if you want to make a professionally-developed importer more likely.~
https://meta.discourse.org/t/bounty-google-private-communities-export-screenscraper-importer/108029/11
Hmm, since I do have experience with Ruby, that bounty might be interesting.
ReplyDeleteI'll let you figure that out with respect to the other interested developer, and my offer to share work in progress at whatever time someone else wants to use it as a basis for development stands for anyone seeking the bounty, if I don't get so far that the bounty closes first. The bounty is clearly too low to really cover costs for someone doing this professionally; I'm working on it for the joy of rescuing data from the gpluscalypse.
ReplyDeleteI think I have most of the guts of user import written including merging with existing google accounts and setting up for users to be able to authenticate and merge accounts later to take ownership of posts, and I'm working on importing posts and comments. My writeup there has a lot of the useful data.
The bulk of my known remaining work before starting what will probably be an epic debugging project is primarily translating from my python script linked from my comment in that Discourse post to Ruby. I'm converting titles differently because Discourse topic titles should be shorter than what I came up with in python, but the formatMessageElement function has the core needs for message formatting handled.
I also haven't yet added a function to add tags based on categories in the import data, which is desired for the first import I want to run.
/sub
ReplyDeleteDiscourse makes the message formatting relatively easy.
ReplyDeleteI'm still pulling together post/comment (in discourse, that's topic/post) import and haven't started image import.
I also need to change it to be able to import lots of imports together, importing all the G+ users across all the community export files first, and then import all the communities. That way, references to users across communities can work right.
Filip H.F. Slagter I should clarify: I'm offering to share my work in progress with anyone who asks, regardless of whether they are seeking the bounty. With respect to timing, I'm quite sure I won't have it finished this weekend, and next weekend I am fully otherwise committed, so realistically I'm looking two weeks out before I have a reasonable hope of working code.
ReplyDeleteMichael K Johnson I'm currently occupied with family arrangements too, so I unfortunately am lacking time too...
ReplyDeleteMy importer is working. I'll be doing a PR soon.
ReplyDelete