Forum:Cite source, a new citation template

Index → The Panopticon → Cite source, a new citation template

Spoilers are strongly policed here.
If this thread's title doesn't specify it's spoilery, don't bring any up.

Opening post

After 2 years, I am finally ready to present one of my biggest projects on this wiki: {{cite source}}. It's a project that has taken up hours of my life, undergone 2 major rewrites and expanded in scope beyond what I ever initially imagined. In short, it's a citation template, aimed at making the information on this wiki more verifiable, making it easier to perform further research and helping readers in deciding whether a piece of information is relevant to them. Before going in depth on what the template can do, I'd first like to explore some of my reasoning and methodology behind the template and citations in general.

Methodology

Citations on this wiki fall into 2 categories: in-universe citations, which I'm concerned with here, and out-of-universe citations, which I have plans to work on in the future but will primarily not be concerned with here. In-universe citations currently look like this:

(TV: The Daleks)

They're used on in-universe pages to denote which source information in part of a sentance, a whole sentance, a paragraph, or multiple paragraphs comes from. They're placed in brackets and composed of a prefix, in this case TV, and the source name, in this case The Daleks. That is all of the information that a reader recieves in most cases (the exception to this is that it is permissable to cite a specific, named, parts/episodes, for example with early Hartnell serials, as "The Dead Planet").

I believe that all citations, both in-universe and out-of-universe, serve 2 major goals:

1. Ensuring that information can be verified easily
2. Providing a useful starting point for further research

In addition, I believe that in-universe citations have a third major goal that out-of-universe citations don't:

3. Allowing readers to see whether a piece of information is relevant, or even "true", to them

I feel that 1 and 2 are somewhat self-explanatory. Allowing easy verifying of information is why readers should trust us, and it makes our job easier. It's the primary reason we have citations at all. At the moment, all you're given in the majority of cases is the name of the story, and that makes verifying information hard. It's similar when it comes to further research. If you want to look more deeply into a piece of information's presentation in a given source, you're currently expected to dig through the entire source when less than 1% of it may actually be relevant. I feel, for both of these reasons, that it is good to be able to look at a citation and jump exactly to where in the source the information is from. Some sources on Tardis are long. The War Games is over 4 hours long. Stories like Liberation of the Daleks are serialised over months of magazines or comics with many individual installments to track down. In both of these cases, it would be much more useful to be directed to exactly where in the source the information is from rather than just the source as a whole, and there are hundreds, possibly thousands, of similar cases accross this wiki. This is common in academic citation formats which frequently include page numbers in their references and, while I don't think we should adopt one such format directly, they are commonly used in professional publications for a reason. Making citations more accurate can only serve to make the wiki more useful and trustworthy as a reference resource.

Moreover, sometimes, sources have minor variants such as reprints, special editions, reconstructions, narrated soundtracks, audiobooks and more, and these can have differences. Therefore, it would be helpful to note these variants clearly but there is currently no way to do so.

3 is something that I feel warrants a little more discussion. As many of us know, Doctor Who is not like other franchises. There is no officially defined, exhaustive, canon, and this leads to different fans having different ideas on what "counts" for them. Some don't really care: fiction's fiction. Others may want to be a little more confined, only considering stuff licensed by the BBC to count. Others may go tighter still, only caring about Big Finish and the TV show, or even just the TV show itself! This wiki should cater for as many of these groups as is possible, whether we agree with their stances or not, and I posit that we currently don't do a great job of it. Currently, the only information you get about a source from a citation is its name and its medium (from the prefix). Unless you have the names and contexts of every source memorised, or you have a very weird idea of what "counts" (e.g. only TV and AUDIO, which means you would include Lucifer and Iris Wildthyme Speaks...! while exlcuding Alien Bodies and the prequels. I don't think anyone is using this definition of what "counts" or any similar ones), the information immediately presented is not helpful. Of course, a reader can just click through to the source's page, but this isn't very helpful in giving an immediate picture of whether you should care. It can be quite disruptive to have to break the flow of reading to visit a different page, wait for that to load, learn what you need to learn and then bounce back to the original page. The solution, the way I see it, is to include more contextual information in citations.

The wiki used to do this a lot better but, at the same time, absolutely appallingly. If you aren't currently aware, this wiki used to have prefixes based on series, not medium, so instead of "(TV: Rose)", you'd have "(DW: Rose)". This meant that we had a lot of prefixes. To quote CzechOut, "90. Nine-zero." to be exact. This system was very problematic. There were a ton of prefixes to remember and new ones had to be agreed upon and created reguarly. It was born out of Memory Alpha but the situation there is very different: they only cover TV shows so have a lot less series to worry about. This keeps their list of prefixes small and memorable. Tardis is just not like that. A prefix system like this is just not manageable.

This idea does have merit, though. The context given through these prefixes can be very helpful at times. Knowing whether a piece of information is from K9 or Doctor Who, at least for me, changes how I view it. The same can be said for TV Comic and Titan Comics' output. This information was conveyed by prefixes but now just isn't present. I'm not proposing that we go back to the old system (in fact, my proposal doesn't touch prefixes at all), but I feel that there is room for improvement here.

And that concludes my methodology and motivating princples. It's now time to go over my actual proposal.

The proposal

My proposal is a new template, {{cite source}}. This has been my main passion project for over 2 years now, and I am very happy with it. Feature creep being what it is, the template has grown quite a bit, so I'll go over all of its features briefly.

The basic idea is expressed best through an example:

(TV: The Daleks ^[+]Loading...["The Daleks (TV story)"])

Notice the "+"? If you click it, a bit of information about The Daleks pops up. Immediately, I feel that this makes my idea regarding improving methodology point 3 clear. Included is everything that I feel could be desired when considering a source's context. You know what the source is from, when the source is from, where the source is from and who the source is from. This should be enough for most people to decide whether they care. People who are just here for New Who can see the release date and know that this is perhaps not entirely relevant to them. People interested in Terry Nation's portrayl of the Daleks compared to other writers immediately see that he is indeed this serial's writer. All of this without significantly disrupting the flow of reading or leaving the page (this is particuarly helpful when browsing in the Fandom app, for example, where there are no tabs). For the editor, it's as simple as typing:

([[TV]]: {{cite source|The Daleks (TV story)}})

I'm not going to include template syntax for my other examples, but it doesn't get much harder than this. If you're interested in the details, there is comprehensive usage documentation at Template:Cite source.

The rest of the template's functionality mostly covers methodology points 1 and 2. I will provide a few examples to demonstrate this functionality. Again, more examples can be found at Template:Cite source.

• (TV: "The Dead Planet" ^[+]Part of The Daleks, Loading...{"namedep":"The Dead Planet (1)","1":"The Daleks (TV story)"})
• (PROSE: "The House Military" ^[+]Part of The Book of the War, Loading...{"namedpart":"The House Military","1":"The Book of the War (novel)"})
• (TV: The War Games (episode seven) ^[+]Loading...{"ep":"seven","1":"The War Games (TV story)"})
• (TV: The Five Doctors (special edition) ^[+]Loading...{"var":"special edition","1":"The Five Doctors (TV story)"}) (requires the use of {{Store variant data}} on the source page)
• (PROSE: The Eight Doctors ^[+]Loading...{"page":"10-20","1":"The Eight Doctors (novel)"})
• (PROSE: Doctor Who in an Exciting Adventure with the Daleks ^[+]Loading...{"chaptname":"A Meeting on the Common","chaptnum":"1","ed":"1965 Armada edition","1":"Doctor Who in an Exciting Adventure with the Daleks (novelisation)"})
• (AUDIO: The Boundless Sea ^[+]Loading...{"timestamp":"26:54","1":"The Boundless Sea (audio story)"})
• (TV: "The Dead Planet" ^[+]Part of The Daleks, Loading...{"release year":"1963","namedep":"The Dead Planet (1)","1":"The Daleks (TV story)"}) (note the more specific release year)

I feel that these examples demonstrate a wide range of functionality that I feel significantly improve upon methodology points 1 and 2. On top of this, I have also included functionality related to the ongoing Forum:Revisiting fiction with branching elements and historical policy therein:

• (PROSE: Search for the Doctor: Marker 32 ^[+]Loading...{"marker":"32","1":"Search for the Doctor (novel)"}, Marker 33 ^[+]Loading...{"notital":"1","marker":"33","1":"Search for the Doctor (novel)"})
• (GAME: Attack of the Graske: "good" ending ^[+]Loading...{"path":"\"good\" ending","1":"Attack of the Graske (video game)"})

The final thing I want to mention is the ability to reuse citations. You can define a lengthy named citation like ([[TV]]: {{cite source|The Faceless Ones (TV story)|var=animated reconstruction|ep=1|minute=3|second=4|ed=DVD|name=TFOAR1}}) and reuse it simply by typing ([[TV]]: {{cite source|name=TFOAR1}}):

(TV: The Faceless Ones (animated reconstruction, episode 1) ^[+]Loading...{"ed":"DVD","minute":"3","var":"animated reconstruction","name":"TFOAR1","ep":"1","second":"4","1":"The Faceless Ones (TV story)"})

For a more full discussion of all of the features, see the usage documentation at Template:Cite source.

I'd also like to mention that I've written full TemplateData for the template, meaning that it works nicely with visual editor, reducing the barrier for usage.

Finally, {{cite source|[...]}} is currently quite long. My proposed solution for this is that a redirect be created at {{cs}} or similar.

Problem: Czech's objections

I feel the need to mention that CzechOut told me to stop work on this template back in 2021 (before I was an admin), as can be seen at User talk:Bongolium500#Some of your recent changes and proposals. However, his arguments contained factual innacuracies which I rebutted at User talk:CzechOut#Re: Some of your recent changes and proposals. I then continued to work on the template. In its current form, the template is so different to what it was back then that many of the arguments don't carry over anyway.

Problem: implementation

The information automatically included in the template has to come from somewhere, and this place is the source page's infobox. To accomodate this, I made some changes to {{Infobox Story}} to end up with {{Infobox Story SMW}}. Switching from one to the other isn't particuarly hard or time consuiming (a list of changes is available at Template:Infobox Story SMW#Usage), but a lot of pages use {{Infobox Story}} and so it would take a long time to switch them all over manually. I am planning to investigate automating this with a bot (discussions with User:SOTO, who is more knowledgeable in this area than me, are in order). Once every page is moved over, {{Infobox Story SMW}} can be renamed to {{Infobox Story}} and another bot run used to update the template's name accross the wiki.

The upside to changing this infobox over, though, is that it leads to the potential for loads more automation in the future. One that particuarly comes to mind is automating list of appearance tables which I have plans to do, a lot of the work having been done as a side effect of this new infobox.

The other thing is actually implementing {{cite source}}. I don't believe that it would be hard to automatically apply the template to every citation (once the source page's infobox has been switched over), but it is impossible to automate any of the extra features for precise citations. That would have to come manually. I feel that the work would be worth it, though.

Technical details

This section likely won't be of interest to most people but is here for people that want it.

It may suprise you to know that this template actually barely uses SMW. It is actually written in Lua using Scribuntu and primarily uses LuaCache for storing data across pages. This extension was specifically enabled on this wiki for this template and is much faster than SMW, massively reducing performance issues.

This template is relatively complex and so I have written full technical documentation at Module:Cite source. I believe that this should help in maintaining the template into the future, even if, for whatever reason, I am not around.

Conclusion

Over 2 years of my time on this wiki have led up to this forum post. Just because I've spent a long time on it doesn't mean it should be implemented immediately (a vandal could spent 20 years writing the most complex and well-written vandalism but we'd still revert it in a heart beat), but I do feel it shows my comitment to this project. Even now in (hopefully) the final stages before the template is implemented, things can be changed, so any minor issues putting you off the template can be corrected. Before finishing, I just need to publicly thank the frequenters of the #lua and #smw-on-fandom channels from the Fandom Discord server, particuarly the (previous Fandom wiki representative) User:RheingoldRiver who used a lot of her time to review my code, talk through my ideas and help me realise this project. genuinely, without these people's help, this project would still be in the state shown on User:Bongolium500/Sandbox 5. Thank you for reading. Bongo50 ☎ 20:59, 20 June 2023 (UTC)

Discussion

As the one to have attempted to create a citation template myself (and thoroughly failed!) I completely support this proposal. I have long wanted more precise citations, and have often, where the source pages has subheadings, linked to the page by adding #Subheading title to the link.

You completely addressed my minor concerns about implementation of such a feature, as it was something I was wondering about; automating the bulk of the work with a bot and then making them more precise where needed manually seems like the realistic and logical option, and I would absolutely commit to being as precise as I can whenever possible. Bravo @Bongo50 for making this possible! Your dedication is greatly appreciated and I cannot wait to this template being implemented.

EPSILON^🔎 |📯|📂|📦|📝

22:21, 20 June 2023 (UTC)

I support this proposal. I've read through the possible obstacles, and personally if we just use this everywhere but Infoboxes I think it's still a W. I think, in general, this will greatly improve coverage. OS25🤙☎️ 22:30, 20 June 2023 (UTC)

Huh, wasn't aware we could use Lua. I toyed around with it a little ~10 years ago for computercraft stuff, might see if I can relearn it. After, you know, everything else on my plate.

I am, of course, broadly sympathetic to this idea. But I do see an issue. Suppose I only have a variant of the original and I don't know whether details have changed between the original and the variant I have. How should I cite it? For instance, Erasing Sherlock has two editions. Suppose that I had based my summary off of the second rather than the first. Would I have had to cite everything as being based on "Erasing Sherlock (Second Edition)"? Should the version I've written be based on "Erasing Sherlock (First Edition)"? We're aware that there are some differences, but that they're relatively minor. What about Dead Romance (novel)? It was first published as part of the New Adventures and then republished with slight typographical/grammar changes along with two* short stories as a tie in to Faction Paradox. My ebook calls it Faction Paradox Book 0, though their statements elsewhere are more ambiguous.

I think applying this template to rereleases / new editions is something we need to think about very carefully, because it's already an area that the wiki doesn't quite have the best thought out policies regarding. Najawin ☎ 02:48, 21 June 2023 (UTC)

I fully support this proposal. As for new editions, a specific edition should obly be cited if either theres a narrative difference between the two editions, and you are referring to said difference , or you are also cititng the page number. – The preceding unsigned comment was added by Cousin Ettolrhc (talk • contribs) .

This sounds like a good idea but I'm not convinced Bongo's 'rebuttal' of CzechOut's concerns actually addressed anything. Does the current version still have accessibility issues? If it does that's going to be a hard no from me. On a similar note, what's the mobile experience like? Is there a live page somewhere in main-space for testing? I'd be curious to get some real numbers on the performance part too, by making a copy of something huge like Last Great Time War that has the new citations instead and comparing the generation time and memory use. If it's quite a bit more I imagine it would be good to seek advice from Fandom staff about whether they'd be happy with the extra server load. Just repeatedly calling templates would add up on a long page, regardless of any SMW in play.

May I also ask why prefix part isn't included in the template? If this site is going to go through quite a bit of work to convert all the citations, it makes sense to me to go 'all the way' and make the whole thing a template, prefix and all. It'll probably never happen, but just in case this wiki decided to rename a prefix or change how cites look, it would be much easier to just change the template than all the citations again (I know this was quite a while ago but the move of NOTDWU to NOTVALID comes to mind). guyus24 (talk) 07:52, 21 June 2023 (UTC)

I don't think that bit's viable, because you sometimes want to cite things like (PROSE: SOURCE1, SOURCE2).

I'm also not sure about Ettolrhc's comment, since what she's asking for seems, well, epistemically inaccessible in some instances - surely the person who has only consumed one version of the work only knows what's in that one version. (It also doesn't comment on the different ranges that Dead Romance could be attributed to. But that's something without an obvious solution, so it's understandable.) Najawin ☎ 07:59, 21 June 2023 (UTC)