Index 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11 |
Sections older than 30 days may be automatically archived by lowercase sigmabot III. |
Batch download?
Hi. I've been coming back to something I worked on ages ago, which appears to have used data from the WP 1.0 bot circa 2009, for entire projects of 5-100k articles. The new version looks great - but is there a way to do bulk downloads directly from wp1.openzim.org? I had a look through the archives but couldn't see anything. It looks like "My selections" might be a way to do it if I filled that with a dump of all the articles from a project, there's a "Download" column on the selections page but nothing in it - do I just have to wait until the bot's next run and then it will process my selection and then allow me to download it? It's not terribly clear.... FlagSteward (talk) 19:43, 23 May 2022 (UTC)
- Anybody? FlagSteward (talk) 20:20, 11 June 2022 (UTC)
- Never mind, I've cracked it, or at least got something to start with.
- returns a pageful in JSON form, hopefully I'll be able to script it. FlagSteward (talk) 20:56, 11 June 2022 (UTC)
- and the parameters are detailed here FlagSteward (talk) 20:58, 11 June 2022 (UTC)
- My batch download is all sorted now. Once I'd found the API it was pretty straightforward (it could be better advertised though, unless I was being particularly unobservant). The only real gotcha is that the API pukes if you try to feed it an empty parameter (like
importance=
) whereas the web version just ignores empty parameters. It's easy enough to work round, you just have to test if a parameter is empty before adding it to the URL, but that could be something to fix for consistency's sake? FlagSteward (talk) 14:59, 12 June 2022 (UTC)
- My batch download is all sorted now. Once I'd found the API it was pretty straightforward (it could be better advertised though, unless I was being particularly unobservant). The only real gotcha is that the API pukes if you try to feed it an empty parameter (like
- and the parameters are detailed here FlagSteward (talk) 20:58, 11 June 2022 (UTC)
AAARGGGHHHHH!!!!!! Stepping through pages doesn't work, because the output is shuffled every time you request a page. You can see it on the web version if you refresh this a few times. Obviously it is sorted by "groups" such as High-importance FA's - but if you look within that group you will see that it is in a different order every time you refresh. Which is fine if the whole group fits on one page, but a recipe for total chaos if it breaks across multiple pages. If you take each refresh as a new "run", then you could have the same article on page 1 of run 1, page 2 of run 2, page 3 of run 3 and so on. Which would be fine if it tracked pagination, but it doesn't, going forward or back effectively puts you on a new "run", so you can see the same article on page 1 and page 2 and page 3 of you results. Which in turn means you lose two articles, the ones that would have been in that position on page 2 and page 3 of run 1. My experience is that I'm losing about 32% of my total articles due to this. It's weird, there seems to be some kind of underlying structure, as you can get runs of maybe 40 articles that are almost exactly repeating a run on the previous page - but not quite, it's a bit like when you forget to FALSE a VLOOKUP or something. So please, please @Audiodude: or whoever, can this be fixed ASAP as it makes the API useless? I'd suggest that since you're obviously sorting by importance and quality, that sorting by article name as a third sort should work as a quick fix. TIA FlagSteward (talk) 14:13, 13 June 2022 (UTC)
- Hi @FlagSteward. Sorry for the late reply. I'm glad you found the API, that is definitely the recommended way of doing the kind of bulk download you're asking for. Obviously, if the results are "jumping" between pages, that's a bug in the API that (as you pointed out) also gets reflected in the web interface. So sorry we missed that. I've added a bug on the project's github page to track the issue and hopefully it can be fixed soon (should just be a matter of adding an additional sort as you said). Thanks so much for reporting this. audiodude (talk) 20:49, 10 August 2022 (UTC)
Progress Bar
The progress bar isn't working to update for the Manual Update for WikiProjects. Adamdaley (talk) 23:35, 30 May 2022 (UTC)
- It's fine. The progress bar wasn't appearing on my desktop. I just had to delete my internet history/cache. Adamdaley (talk) 21:56, 31 May 2022 (UTC)
Not working for Finland task force
WP 1.0 bot (talk · contribs) is not generating statistics pages for this Wikipedia:WikiProject_Football/Finland_task_force#Assessment despite all criteria have been met. {{WikiProject Football}} works. Category:Football in Finland articles by quality have existed for almost two years. Hundreds of articles are tagged and sorted into its subcategories. I have run the bot with this link https://wp1.openzim.org/#/ and got a table there. But no Wikipedia project page with the table. God damn it. And don't send me to five different places to ask the same thing, because I will not bother with this anymore. Sorry for sounding rude, but I've already wasted too much time. Thanks. --Mango från yttre rymden (talk) 20:15, 15 July 2022 (UTC)
- @Mango från yttre rymden all that was needed was to create the page Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality statistics. I have done so. Best, UnitedStatesian (talk) 20:59, 15 July 2022 (UTC)
- @UnitedStatesian: Thank you! I eventually figured that that was the missing link, but wouldn't dare to poke into it, the whole thing was entangling and confusing enough. Isn't the bot supposed to create that itself? If so, what went wrong?
- More importantly, what about that list it's supposed to create as well? First bullet point in the Output section of the user guide, exemplified with [[Foobar articles by quality]]. You removed the link to it in the task force, it was Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality. Regards. --Mango från yttre rymden (talk) 22:34, 15 July 2022 (UTC)
- @Mango från yttre rymden The other page you are looking for is Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality log; that one was automatically created, and I have added the transclusion link to the task force page. The pages of the form Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality are no longer used; I will check the user guide and make sure it is updated to reflect that. Best, UnitedStatesian (talk) 03:56, 16 July 2022 (UTC)
- To UnitedStatesian: Thank you very much for your assistance! --Mango från yttre rymden (talk) 16:59, 17 July 2022 (UTC)
- @Mango från yttre rymden The other page you are looking for is Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality log; that one was automatically created, and I have added the transclusion link to the task force page. The pages of the form Wikipedia:Version 1.0 Editorial Team/Football in Finland articles by quality are no longer used; I will check the user guide and make sure it is updated to reflect that. Best, UnitedStatesian (talk) 03:56, 16 July 2022 (UTC)
Norway too
It seems the same issue has occurred for another task force within WP:FOOTY, namely the Norwegian task force. Would be glad if some of you gents could fix that too. --Mango från yttre rymden (talk) 06:12, 19 July 2022 (UTC)
Help!
So I can go to the Wikipedia 1.0 Server and see a table for the Lichen task force (see here), but when I try to use the code {{Wikipedia:Version 1.0 Editorial Team/Lichen task force articles by quality statistics}} (which is the code used without issue on the WP:FUNGI page) to display the results to the taskforce page, it's a red link. What am I doing wrong? MeegsC (talk) 09:47, 21 July 2022 (UTC)
Speaking of help for the Lichen task force, does anyone know how to make the "articles by quality statistics" show the Wikiwork factor numbers at the bottom of the table? Esculenta (talk) 13:44, 25 July 2022 (UTC)
- Hi @Esculenta: I think you're running into this bug. The bot successfully outputs a table with the WikiWork template transcluded, but it doesn't work because WikiWork expects spaces and the bot is producing underscores. I just tried updating the table manually and it worked once I replaced the underscores with spaces. Thanks. audiodude (talk) 21:01, 10 August 2022 (UTC)
- Okay I've fixed that bug and pushed the new code to the bot workers. It should be fixed in tonight's run. audiodude (talk) 22:25, 10 August 2022 (UTC)
- This also fixed the television stations project and presumably others. Thank you! Sammi Brie (she/her • t • c) 03:38, 16 August 2022 (UTC)