Skip to main content

Retrieving Posts via JSON file from Google+ Exporter


Retrieving Posts via JSON file from Google+ Exporter
This is shared only for those really, really interested in working with JSON files and NOT using your content in a blog or website.

Download/Export of all my Collections in G+ took about 2 1/2 hours for me today. I have a LOT of Collections. Then I downloaded all the images and that came to 6.5 GB and about 10 minutes for 11,597 of them. I did NOT bother to download/Export any of the Communities I have been in.

Here's a sample of what I could isolate for one post and then clean it up with a text editor to strip the extra code no longer needed:
>>>>
cobalt please
Date: 2018-01-22T15:40:39
Grossular, Yellow Crystals
A close view of yellow crystals in a fine specimen of unknown origin, [EDIT: I've now learned these are barite crystals on the green fluorite base. Discovered other specimens from the same locality when I went to this year's shows in Tucson.] seen through the glass display case at a venue of the Tucson Gem and Mineral show, Westward Look Resort, 2017.
Possible ID is yellow garnet in the grossular variety

[EDIT: yellow barite crystals!] with green fluorite as the matrix. It is unusual for me to miss getting the label so I can credit the ID, origin and vendor. This piece was displayed by the Sunnywood Collection.

https://www.mindat.org/min-10272.html

https://www.mindat.org/min-1755.html

#fluorite
#crystals
#yellowcrystal
#barite
#TucsonGemandMineralshow
>>>>
(I did not include the many comments here, because this is just a sample post.)
>>>>
NOTE: The posts themselves are found in a folder called google-plus-posts and the images are found in a separate folder called google-plus-images. When you get a JSON file exported for a Collection, you'll have to open it to make sure it's the Collection posts you want. I rename that file right away - in this case TucsonRocks2017.json .

In my text editor I could easier do a search by a word, or I could just browse for a post I wanted. In this case for a sample, I wanted one that had multiple links and many comments with links shared from friends.

Then I have to look for the post image the hard way - eek! The images that were shared with each post are NOT in the posts folder. For me, it was easier to find this particular crystals image in the Google Photos albums I've made. My post file shows the date and I can figure out from the JSON file where the image was stored. My images, all 11, 597 of them, were all stashed by the Google+ Exporter into hundreds of small folders that do not have a recognizable file name and there is no way to search through them.

So on the bright side, you get your posts and all your friends' comments are there and also links to content shared. That is one of the reasons I wanted most of my posts that I have in Collections. Great content and useful links are too much for me to just lose to the ether when G+ bails out.

You have to be creative to FIND your image that went with the post. On the bright side, you HAVE all your photos that were shared with posts but um, they are jumbled up every which way. What's more problematic is that you also end up with LOTS of photos that are not your photos. I think this happens because when other commenters share their photos in your post comments, blammo, they are also downloaded with your image files.

Any tips on matching posts with the images for the post? You can see I did it the hard way.

Today I used the TextEditor which is native to Mac and then stripped out a lot of code and huge lines of code I don't need. Then I copied into a WORD doc just to be able to use the "Find and Replace" tool to get all the content lined up and further refined. I'm going to try out a different text editor for Mac tonight because I want a more full-featured program. I hear Atom is the one to go for and it is free.

Comments

  1. Whoa, Atom is the bomb! This is awesome for Mac users and is free:
    atom.io - A hackable text editor for the 21st Century

    I can strip out excess code at warp speed. It's got a lot of tools geeks will appreciate.

    ReplyDelete
  2. When you Export List at the Images tab then a .csv is created in the folder that has the json. The csv has several fields. One of the fields is the url as stored against the image in the json. Another of the fields is the complete file name where the exporter saved the file on your drive.

    The file name used is supposedly the md5 of the url so in theory you could compute it in one pass through the json without the csv... Except for not knowing the extension.

    With a small amount of awk or perl or JavaScript you can read the csv into memory and create a lookup table that you then use to convert the json.

    ReplyDelete
  3. Walter Roberson sadly I don’t have those skills. I stared at the .cvs list and thought “Isn’t that nice”. But then how to use it escaped me. Are you saying in that table I can retrieve a post url and use some kind of search method to locate the image url?

    ReplyDelete
  4. Walter Roberson Thanks for the reminder. I had been following Gina's post along but since she was using the format for exporting to a blog, I couldn't see where some of the information was applying to my use of JSON. Fortunately, of course I have all the image files backed up originally on my computers and hard drives. So if I have to, yes, I can retrieve my images to match with a post. Since I am mainly going for the content and the links that were in posts and comments, I'm still happy I used the Google+ Exporter.

    ReplyDelete
  5. In particular I refer to plus.google.com - I have just made a prototypical Google+ Viewer written in Javascript! It can ...
    and to my comment that starts "That is going to depend upon the import tool that you use." where I talked about the format of the csv file.

    ReplyDelete
  6. Thank you very much for this, from someone who didn't have a clue what to do after downloading! :))

    ReplyDelete
  7. Or you could upload the zip of the JSON files to MeWe and their importer will sort everything and populate your timeline, complete with original timestamps.

    ReplyDelete
  8. Michael Schrody As soon as MeWe supports true publicly-viewable posts (without a MeWe account), I’ll be doing that. In the meantime, I am hoarding my G+ exports until after the 2nd. If MeWe never supports public posts (they claim to be working on it), I’ll upload to a Blogger or Wordpress site instead.

    ReplyDelete
  9. cobalt please, from what I'm hearing from other users, I suspect it doesn't really matter that we are after different endgames. Whether or not you are re-constructing posts in JSON, WP or Blogger, there still needs to be a way to locate the corresponding images that match posts.

    I wrote the following question on 2 posts this morning:

    Would it be possible for you to please outline the logic of how the images are sorted and provide instructions for how to access them for our individual posts? I am using the WP export.

    They are organized in hundreds of enclosing and 2 levels of subfolders to get each individual .jpg or .png.

    I agree with +Christine Bichler, that the article you referred to doesn't explain what to do with the images in relation to posts once they are downloaded.

    In other words, do you have a suggestion for how to pair them with their respective posts once we have downloaded them and the .csv file? How can we connect the photos with their corresponding posts?

    Here are the two posts I put the question on:

    plus.google.com - There's a new Google+ Exporter release 1.8.0 Tell you Google+ friends about ...

    https://plus.google.com/+FriendsPlusMe/posts/jSFYkqFBMJZ?fscid=z13xcx14nsmxdfqrx04cgv2wrxa2t5aaq0o.1553488070605627

    PS: I love your photo! We were at the Natural History Museum in DC a year ago and have amazing photos and videos from the crystal rooms.

    ReplyDelete
  10. Gina Fiedel and wouldn’t you know last night there was an Exporter release update for 1.8.3

    ReplyDelete
  11. cobalt please oh, I know. My groan could be heard next door. I haven't seen any information about what the update improved so I'm kinda sorta trying to shield my eyes and pretend it isn't there. I have re-exported with practically every update and it's beginning to feel obsessive.

    Here is the post where I received a reply. Maybe it will be helpful to you.

    I'm now wondering if perhaps a JSON export shows the post with the image? So having that would at least provide a visual reference? I tried Takeout and noticed that the posts are saved as .html files that have both text and image.

    plus.google.com - Hi Everyone, We've just released Google+ Exporter, an application that helps...

    ReplyDelete
  12. cobalt please As an alternative to a simple way to match photos with posts, I just did a couple of experiments to (at the least) create visual records of photo posts. Just so I have a reference when I try to re-create posts in my WP site. I'm pretty psyched at how this is working.

    I "Saved" my dog collection to PDF and it created an 89-page pdf that includes a snapshot of every post in the collection.

    I also used the Chrome extension, Full Page Screen Capture, as another option. It took several tries with my Flowers collection which only has 68 posts, but it did grab them all eventually. Not sure if I'll succeed with larger collections but I'm going to try.

    ReplyDelete
  13. Gina Fiedel that’s a good idea! I do screenshots all the time to view large numbers of images and refer back to them. I have a few I made from Google Photos to share. Looks like I’d better decide what are to be my last posts soon.

    ReplyDelete

Post a Comment

New comments on this blog are moderated. If you do not have a Google identity, you are welcome to post anonymously. Your comments will appear here after they have been reviewed. Comments with vulgarity will be rejected.

”go"