No.24287 [View All]
Hello all. You might not remember what the Holonet Wiki is, but I was one of the anons involved with the new SW wiki our board was working on a while back. For those of you who need a quick summary, a while back our wiki hit a rather major snag. I found a way to import a large amount of "Legends" wookieepedia content over to our wiki and thus save ourselves from a lot of work, the problem is that the import process could only be done by the owners of our wiki's domain. So I left for quite a spell in hopes of contacting Shoutwiki's staff (our domain owners) and finding some way to import the content. That feels like ages ago now…
So the end result is, I have some bad news gents. I've been trying to contact the staff of Shoutwiki and to find some way to get around the restrictions but have had no luck. Either Shoutwiki doesn't give a shit or its a dying domain. However, during my period of absence as I did my best to collect content from all Legends articles for importing (as well as any pre-2011 content) I've found several alternative wikis. I've long since given up hope on trying to make any progress with Shoutwiki, so to finally get this over with, I was hoping we could continue discussion on all wiki progress here and vote on what to do and which domain to move to.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.27715
>>27114
Did the Miraheze guys ever upload it? I notice a lot of articles are still missing.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.27716
>>27715
5000 articles alone took weeks to import. There's over 100,000 articles that need to be imported and according to a previous post >>26897
It might take 5 months.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.27806
>>27716
Thanks, I didn't realize that. Guess it's time to buckle in and wait it out.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.27876
>>27008
I agree, TCW should be S-canon, so that vehicles and locations can be preserved for other works withing the EU.
And then we can recanonize it into the Separatist canon, the same way the Marvel comics were with the Essential Guide to Warfare
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28170
https://phabricator.miraheze.org/T3850
Sheeit, looks like the XML seized up again.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28201
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28222
Invidious embed. Click thumbnail to play.
>>28170
>>28201
Well fuck… That XML was our last hope. The only other one I got is one from 2018, and if we use it we'll be stuck with all the Canon/Legends tab crap… There is another though made by someone else… The problem is I can't open the damn thing no matter what I do. If someone can find a way to open this thing, we may still have some hope yet.
https://www.mediafire.com/file/47ek2xh27w0s7vw/starwars_pages_full.xml.gz/file
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28226
>>28222
What about the multiple small ones you made? If nothing else, could we upload the ones we know are good, and surgically cut out the section causing issues? It's still incomplete but at least it's something to start with.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28236
>>28226
The smaller ones have a problem. When I went to check their content, they only had about 7000 articles worth of info. Apparently its due to how Wookieepedia lazily added the Legends/Canon categories, so the Special:Export doesn't recognize them as actually being in those categories. My only other option is to manually edit the 2018 xml (which will take ages) or try and keep looking.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28241
>>28236
Damn. Sorry to hear that anon, I wish I could help but I can't into XML.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28419
>>28222
I have what you guys are looking for. Its 61.2GB large and includes all the history from 2013 and more. Give me a way to contact you and we can sort out the rest. Please try to remain discreet in what we discuss. I also can't guarantee whether the file will work 100% accordingly. It may even crash during import for all I know since I've never seen an import as big as this go smoothly.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28524
>>28419
Assuming you're being legit, then: OH SHIT
Can you set up a download via torrent? If not, just contact me here: givinfag@mail.com
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28537
>>24554
GOD DAMN IT, CARLOS MIKEY!
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28677
Is it up and running now?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28883
I GOT IT BOYS! And boy was it a big doozy. Felt like it would take forever to download and extract. I don't want to get too excited though based on past disappointments, since I'm worried whether or not the Miraheze people will use it or if they'll say its too big. But this could really make us. Articles, history, everything well preserved as it was in 2013 (judging from what little I could peak at before my XML reader crashed). Heck I think this may be a full dump of the site as it was then. Let's just hope it can work… If it doesn't, the guy also gave me a smaller XML which is article text only and is far smaller. So if it fails, we can use that one.
Any thoughts before I should hand this thing over to Miraheze? This thing might take a while to upload.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28890
>>28883
Not much, other than I've noticed that the infobox templates are broken- likely as a consequence of whatever butchery Wikia/Fandom did to mediawiki. I suppose I'll sit down and see what I'd need to do to fix that once the import is complete. My wiki contribution skills are a bit rusty since my SporeWiki/Wikia days. oh, and anything we can do to prevent vandalism? There's a slight possibility that one alderaanfag/rianfag that's been plaguing us could try and cause more drama
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28892
>>28883
>I'm worried whether or not the Miraheze people will use it or if they'll say its too big
Never say too big. Nothing is too big! You gotta believe! Bigger is better! Now go in there and do it!
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28901
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28910
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28914
>>28910
I'm trying. I haven't even gone out all day just waiting for the upload to finish of the file to Miraheze to finish. All day and its only at 18%.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28962
>>28901
Thanks. Finally fixed the template issue.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.28993
>>28914
What's the current status of the upload?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29036
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29183
Something went wrong. The damn thing stopped at 90% and it won't go further than that. I'm going to try and contact our benefactor and see if he can help.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29218
>>29183
If it kept crashing because of a spotty connection I could try uploading the file. I've got a breddy fast connection and it's stable as well.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29768
>>29183
>>29218
You all right, givin? It's been radio silence for a couple of days now.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29937
So it looks like our issue was that if you update too big a file directly to Phabricator, the server will spit it out because they only have so much hosting space for Phabricator. I'll be uploading our xml via Mega and sending a link.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29982
>>29937
Have they started the import thing yet?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.29984
>>29982
I got the file over to the guy who handles imports. Ball's in his court now, and he should be able to start the import.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30012
So the file's been received, but the Wook archive is bigger than the amount of space left on the Miraheze server. If the Givinfag has that smaller file with no history, we can import that for the time being, then switch over to the other one when (or if) Miraheze upgrades their servers.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30024
>>30012
problem is, we need the edit history to be safe on the fair use/attribution front. the only other alternative is to link back to the wook.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30027
>>30024
I was thinking we could just put a disclaimer on the front page–"All content was originally published on Wookiepedia/starwars.wikia.com, and is hosted under fair use terms of Creative Commons [whatever the fuck]." It's not as good as having the histories, but if that's the best we can do I'm not sure if we have a choice.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30190
>>30027
>>30024
Having the histories would be nice, but it would be stupid if we allowed the entire project to get held up on this relatively minor point. The worst that would happen is articles get taken down and we have to find a way to restore them with history, or we recreate them by hand as they're deleted.
If including the histories is this much of an issue then we should just settle on having a disclaimer for now, like >>30027 said.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30317
>>30190
I thought of a possible workaround – maybe have an 'empty shell' history where it shows all the edits and who made them, but without the saved revisions. that would satisfy attribution while keeping the size down, if it's doable.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30320
>>30317
Is that even doable?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30363
>>30320
wiki software allows you to delete revisions (so they appear grey'd and struck-through in edit history), so it should be possible. however, it may take a bit of wizardry to pull it off.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30494
What's the status on the wiki, troopers?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30496
>>30494
The guy in charge of the import got around to it on the 25th. No idea how long it'll take. But he still hasn't mentioned if Miraheze plans to update to 65GB and that's worrying me and annoying me.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30500
>>30496
To be fair to the guy, it's probably not something he knows for certain–I doubt the import guy is the one who makes purchasing decisions about server space. Some kind of upgrade will have to happen eventually, since I doubt we're the only new wiki they see and all the others are getting bigger also.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30564
>>30500
I guess they could do donations to pay for a few more hard drives.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30737
Something to be aware of: it seems like a lot of info from FFG's RPG series, namely information that contradicts established canon, has started creeping its way into wook, namely this extensive shittalking and revisionism of the Victory-class star destroyer. I'm not sure when in the history this started creeping in, but it's something to look out for on the Baobab Archives once we get that up and running. The mouse may be the worst but it wasn't the first to start fucking with canon.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30742
>FFG
I don't really anyone who plays by their rules. And is it just only now starting to creep into wookieepedia? If so we shouldn't be worried if you guys used an older import.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30805
>>30737
FFG only got the license in late 2011 and their first RPG was released late 2012. Pretty much everything they printed has been under Disney.
Saga Edition's Force Unleashed book does say Victory class was obsolete by the end of the Clone Wars, does state that they were in rear line service during the Rebellion era if not outright sold to PDFs or the CSA, states they require plentiful resupply (though this is because they used missile weapons instead of turbolasers) and it is, stat wise, very slow (1 square vs. the 2 or better every ship its size has aside from the Dreadnaught). Those parts at least aren't retcons. The only new thing there is the maintenance issues.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.30806
>>30805
(I wish I could find a better scan of the Force Unleashed book)
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.31416
It's been over a month since the last real update. Is this project dead?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.31417
>>31416
It's not dead, we're still working on things in the background. Miraheze stalled on us, on account of their servers being too small for what we want. We've found an alternative host, but I wanted to make sure that everything is squared away with them before making any announcement.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.31418
>>31416
Its not dead. We are still on the job. We just haven't been posting anything here and have been keeping most of our discussions over at Miraheze. I left a link for all of you to use to keep track of things over there as seen here: >>25285
And as you can see, we've just arrived at a dead end with Miraheze. So we've moved operations to a new domain that I and a few others will be paying for out of our own coffers. A domain that can handle over 100GB of data which is what we need now that we have a working XML with all the data we require. I wanted to offer some updates, but I didn't want to get anyone's hopes up until we knew for certain whether or not Miraheze could be relied upon. Once the new wiki is set up, we'll keep you informed on any new details.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.31491
CODEFAGS WANTED
We're looking at a new possible host, Wikidot. They have everything we need, but in order to import we need to use the API-key and some kind of programming language to set up the automated import (relevant Q/A thread: http://community.wikidot.com/forum/t-10495689/importing-a-new-wiki). Would any anon be willing or able to put such an API together?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.35243
So did this just fizzle out and die? Or is it still going?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.35265
For me it was having grown up with the idea that the OG Trilogy on https://streamingsites.com/ was all there was going to be. Sure… you’d hear fanboy rumors of more, but they were just rumors. Having the original released in theaters in the 90’s was a big deal. So after all this wait & hype the prequels just didn’t live up to it. I don’t want to hear about some “trade dispute” or “political infighting”. Let’s not forget those cringe worthy accents.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.