Kinja Oppo Revival Update

[FTTOHG]

I'm making slow progress. This is my first attempt at doing something like this and I'm learning as I go. A real search is still a longs ways off, but I've come up with a new way to organize things rather than the flat feed so that it will hopefully be a little easier to find things you want in there. I decided to break things up into months and years. So far I have 2017 uploaded as a test case. The links at the top take you to each month and the posts are displayed in a sortable table.

By default it sorts by the post ID. These were assigned when the post was started so scheduled posts and updates/reposts can end up with lower numbers than other things that were posted before them. Clicking the columns titles will sort if you want to see what had the most likes or you want to group by author, look for a specific date or whatever. These are big tables - there were on average 3700 posts per month - so they might take a second to sort. The sort is a script I grabbed off of the web and not perfect either. It puts ABC before abc for instance. But it is still useful - look I tracked down the very first of Urambo Tauro's My Favorite of JRiTS posts of the week post!

And here we can start to see what I still need to sort out. Embeds don't work yet and show an error. There is no formatting of the text in the posts. Comments don't show who replied to who so they can appear out-of-order. I also only pulled the first 100 comments for each post (technical reasons make it more work to do more - it is possible and we might get to it before the blog is completely deleted but only a few posts hit more than 100 comments so it is a low priority for me).
I plan to fix this stuff but it will take some time.

Here is where to check it out: http://jimisaherb.com/uploader/tablebeta_2017_1.html

Warning: All images arer currently still hosted on Kinja! I have no idea if they will be deleted soon. If you are using this archive to find and save your old posts that you didn't get a chance to before G/O 404'd then us I recommend using the Save Page WE plug-in for Chrome that embeds full images into the files that it saves.

[jminer]

@fttohg This is seriously awesome! Nicely done!

I know @Jb-boin also was doing some work around this as well so you may want to ping him for any help if you want.

[EssExTee]

@fttohg You sir (or ma'am) are a wunderkind

[FTTOHG]

@jminer He's been a big help so far. I've been bugging him on Discord. Amazing the way the community has been coming together.

[jminer]

@fttohg without a doubt, it's been amazing to see everyone come together

[FTTOHG]

@essextee Thanks. I just got pretty annoyed that we were just wiped off the web like that and wanted to make some sort of museum even if it isn't perfect.

[Dr. Zoidberg]

@fttohg I recognize that thumbnail somehow!

[FTTOHG]

@dr-zoidberg hmmm I didn't think anyone would know what it was...

[Qaaaaa]

This is awesome. Is there a plan to host everything off the kinja network?

[davesaddiction]

If you're looking for your old posts to capture them for your own archive, you can use the Find tool (Ctrl-F) to search for text on the page. Thanks, @FTTOHG !

[FTTOHG]

@qaaaaa I don't think there is a firm one. Right now all of the text/replies are off of Kinja but any uploaded images are still on Kinja. I know that the images are a big part of the posts, but the issue is that it is just a huge volume of data. We talked about saving them in reduced quality but didn't go through with that yet because it defeats the purpose of an archive. We might change our minds or go save just the first image from each post if we start to run out of time.

[FTTOHG]

I should add that I'm quarantining right now since I had family come visit for an early Thanksgiving. I'm working from home today but this weekend I should have a lot of time to keep playing with this.

[davesaddiction]

@fttohg So, that was ALL of 2017?

[davesaddiction]

@fttohg Thanks for your efforts on this!

I saved some recent stuff, but thought I had time to get the rest, so you're a life saver.

[dogisbadob]

This is awesome

[FTTOHG]

@davesaddiction Yes ALL of 2017 as far as I can tell. I can't promise that my script was perfect so it's possible some posts fell through the cracks but if you look at a typical day of posting it seems like it is all there. I have 2016 and 2018 on my hard drive but I haven't gotten them up there yet. Lots going on at work today so probably won't be til this weekend. I plan tonight to try to get 2015 and 2014 pulled. I'm ignoring 2019 and 2020 for now because @Jb-boin grabbed them in his archive. I just need to coordinate to get that data over at some point.

[davesaddiction]

@fttohg Fantastic. Thank you again!

[Roundbadge]

@fttohg Between @jminer setting the new forum up, your work here and @Jb-boin also working to archive the good old days, you're all got-dang legends.