(Next step: Actually define the comic tree stuff, as in the WC stuff. Some of the branches have their own leaves.)
Wow, I should have gotten to this project sooner, but the fork gives me reason to return to it.
Forum:Temporary forums/Categories for stories without summaries established that this category tree should exist, and that it should look a specific way. However, generating the specific categories takes a bit of work because it requires figuring out where all our, say, PROSE works are, and making sure that we can figure out a relatively simple definition of a PROSE work using our category system. (Obviously we could start from the root Category:Prose sources and work down to the leaves, but this is a monumental amount of work for the bot run and isn't guaranteed to be error free.)
Category tree
- Category:Missing plot summaries
- Clearly to be in this category the bot will need to detect that the "plot" section on whatever page is being tested says some variation of "To be added" or similar. (Perhaps if there both exists a plot section, and it is smaller than a certain length? We'd have to be careful about Vrs (short story) and a few others if we do that, but it's plausible.)
- Category:Missing PROSE plot summaries
- Category:Missing AUDIO plot summaries
- Generate subcategories based on "Category:Audio stories by company", preserving subcategories within this structure. (So, eg, Category:Big Finish audio stories plot summaries, followed by Category:BFBS audio stories plot summaries)
- Category:Missing COMIC plot summaries
- Category:Missing GASPS comic plot summaries
- Category:Missing Cutaway comic plot summaries
- Category:Missing DAN comic plot summaries
- Category:Missing DWA comic plot summaries
- Category:Missing DWAN comic plot summaries
- Category:Missing DWBIT comic plot summaries
- Category:Missing DWM comic plot summaries
- Category:Missing DWM backup comic plot summaries
- Category:Missing The Cybermen plot summaries
- Category:Missing The Daft Dimension comic plot summaries
- Category:Missing First Doctor DWM comic plot summaries
- Category:Missing Second Doctor DWM comic plot summaries
- Category:Missing Third Doctor DWM comic plot summaries
- Category:Missing Fourth Doctor DWM comic plot summaries
- Category:Missing Fifth Doctor DWM comic plot summaries
- Category:Missing Sixth Doctor DWM comic plot summaries
- Category:Missing Seventh Doctor DWM comic plot summaries
- Category:Missing Eighth Doctor DWM comic plot summaries
- Category:Missing Ninth Doctor DWM comic plot summaries
- Category:Missing Tenth Doctor DWM comic plot summaries
- Category:Missing Eleventh Doctor DWM comic plot summaries
- Category:Missing Twelfth Doctor DWM comic plot summaries
- Category:Missing Thirteenth Doctor DWM comic plot summaries
- Category:Missing Fourteenth Doctor DWM comic plot summaries
- Category:Missing Fifteenth Doctor DWM comic plot summaries
- Category:Missing Doctor Who? comic plot summaries
- Category:Missing Dr. Who's Time Tales comic plot summaries
- Category:Missing The History Tour comic plot summaries
- Category:Missing Moments in Time comic plot summaries
- Category:Missing Nix View comic plot summaries
- Category:Missing Tales from the TARDIS comic plot summaries
- Category:Missing DWS comic plot summaries
- Category:Missing FF comic plot summaries
- Category:Missing Four Hours of Doom's Day plot summaries
- Category:Missing Free-Fall Warriors plot summaries
- Category:Missing IDW comic plot summaries
- Category:Missing IHP comic plot summaries
- Category:Missing It's Bigger on the Inside! comic plot summaries
- Category:Missing LP comic plot summaries
- Category:Missing Polystyle comic plot summaries
- Category:Missing PHS comic plot summaries
- Category:Missing TVA comic plot summaries
- Category:Missing TVC comic plot summaries
- Category:Missing First Doctor TVC comic plot summaries
- Category:Missing Second Doctor TVC comic plot summaries
- Category:Missing Third Doctor TVC comic plot summaries
- Category:Missing Fourth Doctor TVC comic plot summaries
- Category:Missing TVC Annual comic plot summaries
- Category:Missing TVC Holiday Special comic plot summaries
- Category:Missing RT comic plot summaries
- Category:Missing TIDH comic plot summaries
- Category:Missing Titan comic plot summaries
- Category:Missing 10D comic plot summaries
- Category:Missing 11D comic plot summaries
- Category:Missing 12D comic plot summaries
- Category:Missing 8D comic plot summaries
- Category:Missing 9D comic plot summaries
- Category:Missing 15D comic plot summaries
- Category:Missing DW20 comic plot summaries
- Category:Missing FCBD comic plot summaries
- Category:Missing FD backup comic plot summaries
- Category:Missing TM comic plot summaries
- Category:Missing TW comic plot summaries
- Category:Missing WeLoveTITANS plot summaries
- Category:Missing TV21 comic plot summaries
- Category:Missing Web-based comic plot summaries
- Category:Missing Who's Where? comic plot summaries
- Category:Missing HOMEVID plot summaries
- No subcategories, generated entirely from the HOMEVID cat defined below
- Category:Missing WC plot summaries
- Category:Missing Arcbeatle WC plot summaries
- Comes from leaves in Category:Arcbeatle webcasts INTERSECT WC
- Category:Missing BBCi WC plot summaries
- Comes from leaves in Category:BBCi, minus BBC Red Button, and then the leaves of Category:TARDIS Cam stories INTERSECT WC
- Category:Missing BBV WC plot summaries
- Comes from leaves inCategory:BBV webcasts INTERSECT WC
- Category:Missing Big Finish WC plot summaries
- Comes from leaves in Category:Big Finish webcasts INTERSECT WC
- Category:Missing Doom's Day WC plot summaries
- Comes from leaves in Category:Doom's Day webcasts INTERSECT WC
- Category:Missing Lego Dimensions WC plot summaries
- Comes from leaves in Category:LEGO Dimensions trailers INTERSECT WC
- Category:Missing Monster Files plot summaries
- Comes from leaves in Category:Monster Files stories INTERSECT WC
- Category:Missing P.R.O.B.E. plot summaries
- Comes from leaves in Category:P.R.O.B.E. webcasts INTERSECT WC
- Category:Missing SJA WC plot summaries
- Comes from Category:SJA webcasts's leaves, not the subcategory. INTERSECT WC
- Category:Missing Mr Smith's data updates WC plot summaries
- Comes from Category:Mr Smith's data updates's leaves. INTERSECT WC
- Category:Missing TLV WC plot summaries
- Comes from Category:TLV webcasts's leaves, not the subcategory. INTERSECT WC
- Category:Missing UNIT Field Log WC plot summaries
- Comes from Category:UNIT Field Log webcasts's leaves. INTERSECT WC
- Category:Missing Arcbeatle WC plot summaries
- Category:Missing GAME plot summaries
- Take the leaves from this category + the leaves from the subcategories of Category:Video games by Doctor
- Category:Missing NOTVALID plot summaries
- Category:Missing publisher summaries
- Same as before, but for publisher summary.
- Category:Missing PROSE publisher summaries
- Category:Missing AUDIO publisher summaries
- Generate subcategories based on "Category:Audio stories by company", preserving subcategories within this structure. (So, eg, Category:Big Finish audio stories plot summaries, followed by Category:BFBS audio stories plot summaries)
- Category:Missing COMIC publisher summaries
- Category:Missing GASPS comic publisher summaries
- Category:Missing Cutaway comic publisher summaries
- Category:Missing DAN comic publisher summaries
- Category:Missing DWA comic publisher summaries
- Category:Missing DWAN comic publisher summaries
- Category:Missing DWBIT comic publisher summaries
- Category:Missing DWM comic publisher summaries
- Category:Missing DWM backup comic publisher summaries
- Category:Missing The Cybermen publisher summaries
- Category:Missing The Daft Dimension comic publisher summaries
- Category:Missing First Doctor DWM comic publisher summaries
- Category:Missing Second Doctor DWM comic publisher summaries
- Category:Missing Third Doctor DWM comic publisher summaries
- Category:Missing Fourth Doctor DWM comic publisher summaries
- Category:Missing Fifth Doctor DWM comic publisher summaries
- Category:Missing Sixth Doctor DWM comic publisher summaries
- Category:Missing Seventh Doctor DWM comic publisher summaries
- Category:Missing Eighth Doctor DWM comic publisher summaries
- Category:Missing Ninth Doctor DWM comic publisher summaries
- Category:Missing Tenth Doctor DWM comic publisher summaries
- Category:Missing Eleventh Doctor DWM comic publisher summaries
- Category:Missing Twelfth Doctor DWM comic publisher summaries
- Category:Missing Thirteenth Doctor DWM comic publisher summaries
- Category:Missing Fourteenth Doctor DWM comic publisher summaries
- Category:Missing Fifteenth Doctor DWM comic publisher summaries
- Category:Missing Doctor Who? comic publisher summaries
- Category:Missing Dr. Who's Time Tales comic publisher summaries
- Category:Missing The History Tour comic publisher summaries
- Category:Missing Moments in Time comic publisher summaries
- Category:Missing Nix View comic publisher summaries
- Category:Missing Tales from the TARDIS comic publisher summaries
- Category:Missing DWS comic publisher summaries
- Category:Missing FF comic publisher summaries
- Category:Missing Four Hours of Doom's Day publisher summaries
- Category:Missing Free-Fall Warriors publisher summaries
- Category:Missing IDW comic publisher summaries
- Category:Missing IHP comic publisher summaries
- Category:Missing It's Bigger on the Inside! comic publisher summaries
- Category:Missing LP comic publisher summaries
- Category:Missing Polystyle comic publisher summaries
- Category:Missing PHS comic publisher summaries
- Category:Missing TVA comic publisher summaries
- Category:Missing TVC comic publisher summaries
- Category:Missing First Doctor TVC comic publisher summaries
- Category:Missing Second Doctor TVC comic publisher summaries
- Category:Missing Third Doctor TVC comic publisher summaries
- Category:Missing Fourth Doctor TVC comic publisher summaries
- Category:Missing TVC Annual comic publisher summaries
- Category:Missing TVC Holiday Special comic publisher summaries
- Category:Missing RT comic publisher summaries
- Category:Missing TIDH comic publisher summaries
- Category:Missing Titan comic publisher summaries
- Category:Missing 10D comic publisher summaries
- Category:Missing 11D comic publisher summaries
- Category:Missing 12D comic publisher summaries
- Category:Missing 8D comic publisher summaries
- Category:Missing 9D comic publisher summaries
- Category:Missing 15D comic publisher summaries
- Category:Missing DW20 comic publisher summaries
- Category:Missing FCBD comic publisher summaries
- Category:Missing FD backup comic publisher summaries
- Category:Missing TM comic publisher summaries
- Category:Missing TW comic publisher summaries
- Category:Missing WeLoveTITANS publisher summaries
- Category:Missing TV21 comic publisher summaries
- Category:Missing Web-based comic publisher summaries
- Category:Missing Who's Where? comic publisher summaries
- Category:Missing HOMEVID publisher summaries
- No subcategories, generated entirely from the HOMEVID cat defined below
- Category:Missing WC publisher summaries
- Category:Missing Arcbeatle WC publisher summaries
- Comes from leaves in Category:Arcbeatle webcasts INTERSECT WC
- Category:Missing BBCi WC publisher summaries
- Comes from leaves in Category:BBCi, minus BBC Red Button, and then the leaves of Category:TARDIS Cam stories INTERSECT WC
- Category:Missing BBV WC publisher summaries
- Comes from leaves in Category:BBV webcasts INTERSECT WC
- Category:Missing Big Finish WC publisher summaries
- Comes from leaves in Category:Big Finish webcasts INTERSECT WC
- Category:Missing Doom's Day WC publisher summaries
- Comes from leaves in Category:Doom's Day webcasts INTERSECT WC
- Category:Missing Lego Dimensions WC publisher summaries
- Comes from leaves in Category:LEGO Dimensions trailers INTERSECT WC
- Category:Missing Monster Files publisher summaries
- Comes from leaves in Category:Monster Files stories INTERSECT WC
- Category:Missing P.R.O.B.E. publisher summaries
- Comes from leaves in Category:P.R.O.B.E. webcasts INTERSECT WC
- Category:Missing SJA WC publisher summaries
- Comes from Category:SJA webcasts's leaves, not the subcategory. INTERSECT WC
- Category:Missing Mr Smith's data updates WC publisher summaries
- Comes from Category:Mr Smith's data updates's leaves. INTERSECT WC
- Category:Missing TLV WC publisher summaries
- Comes from Category:TLV webcasts's leaves, not the subcategory. INTERSECT WC
- Category:Missing UNIT Field Log WC publisher summaries
- Comes from Category:UNIT Field Log webcasts's leaves. INTERSECT WC
- Category:Missing Arcbeatle WC publisher summaries
- Category:Missing GAME publisher summaries
- Take the leaves from this category + the leaves from the subcategories of Category:Video games by Doctor
- Category:Missing NOTVALID publisher summaries
Transversal of tree
(For reference, Category:Sources) Not sure if this will help the bot, but I'm specifying this just in case, our category tree is rather complicated, and it will also allow me to simplify my notation above.
NOTVALID = Floor 500->Real world->Sources->Non-DWU sources->Category:Non-DWU sources by medium (UNION of all subcategories)
Novel = Floor 500->Real world->Sources->PROSE stories->Novels->Category:Novels by year of release (UNION of all subcategories) SETMINUS NOTVALID
Feature = Floor 500->Real world->Sources->PROSE stories->Features->Category:Features by year of release (UNION of all subcategories) SETMINUS NOTVALID
Short Story = Floor 500->Real world->Sources->PROSE stories->Short stories->Category:Short stories by year of release (UNION of all subcategories) SETMINUS NOTVALID
PROSE = Short Story UNION Novel UNION Feature
WC = Floor 500->Real world->Sources->Webcasts->Category:Webcasts by year of release (UNION Of all subcategories)
Film = Floor 500->Real world->Sources->Category:Theatrical films (UNION Of all subcategories) SETMINUS NOTVALID
Tv = Floor 500->Real world->Sources->Television stories->Category:Television stories by airdate (UNION of all subcategories) SETMINUS NOTVALID
TV=Film UNION Tv
GAME = Floor 500->Real world->Sources->Real world video games->Category:Video games by year of release (UNION of all subcategories) SETMINUS NOTVALID (nb: As far as I can tell the other groups can't consistently have plot summaries, they're just not the sorts of things where that makes sense, and almost always have the publisher summaries listed already. Personally I don't see the need for subcategories here for mediums, since the others should be effectively rounding errors. Also, in general I'm skeptical about doing this one by bot run, a lot of these aren't written in such a way that plot summary / publisher's summary are present. Might be better to completely ignore the GAME sources in the bot run and just add them by hand.)
HOMEVID = Floor 500->Real world->Sources->Home videos->Category:Home videos by year of release (UNION of all subcategories) SETMINUS NOTVALID
COMIC = Floor 500->Real world->Sources->Comic stories->Category:Comic stories by year of release (UNION of all subcategories) SETMINUS NOTVALID
AUDIO = Floor 500->Real world->Sources->Audio stories->Category:Audio stories by year of release (UNION of all subcategories) SETMINUS NOTVALID