→October 15, 2018 - WP 1.0 bot NO log since Oct. 8: Help needed |
→Almost 5 Hours for WP 1.0 bot to process two WP: logs overnight Oct.14 to Oct.15 |
||
Line 498: | Line 498: | ||
[[User:JoeHebda|JoeHebda]] ([[User talk:JoeHebda|talk]]) 14:25, 16 October 2018 (UTC) |
[[User:JoeHebda|JoeHebda]] ([[User talk:JoeHebda|talk]]) 14:25, 16 October 2018 (UTC) |
||
== Almost 5 Hours for WP 1.0 bot to process two WP == |
|||
{{ping|Walkerma}} and {{ping|Audiodude}} Thinking there must be something in error with either category tree or WP content pages? Repeats of same table? Here's the logs for ''Military history'' and ''Biography (military)''. |
|||
<br> |
|||
• 02:28, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 02:24, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 01:19, 15 October 2018 (diff | hist) (-10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 00:48, 15 October 2018 (diff | hist) (+10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 00:04, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 22:52, 14 October 2018 (diff | hist) (-10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 21:52, 14 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) |
|||
<br>---<br> |
|||
• 21:43, 14 October 2018 (diff | hist) (-137) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) |
|||
<br>---<br>[[User:JoeHebda|JoeHebda]] ([[User talk:JoeHebda|talk]]) 02:22, 17 October 2018 (UTC) |
|||
== Third generation WP1.0 bot == |
== Third generation WP1.0 bot == |
Revision as of 02:22, 17 October 2018
This page has archives. Sections older than 45 days may be automatically archived by Lowercase sigmabot III when more than 4 sections are present. |
Bot is weirded out again
Seems like its only doing projects beginning with A&B but only a few at that. In my case the Ships project has not updated since the 16th. Brad (talk) 20:08, 21 August 2018 (UTC)
- The assessment tables are updating but not the logs. Brad (talk) 20:10, 21 August 2018 (UTC)
- And a manual run also just produces the tables but not the logs. ww2censor (talk) 22:13, 21 August 2018 (UTC)
- I've requested help - we'll see if things can be fixed. Walkerma (talk) 01:52, 22 August 2018 (UTC)
- Your manual run may have worked. My understanding of the bot is that it will update the tables right away but logs are posted hours later and only once a day. Ships project logs were updated with all of the missing days included. Wait and see what happens in the next day or two. Brad (talk) 01:02, 23 August 2018 (UTC)
- The logs arenot showing daily. It ran for a few consecutive days & then stopped again. Also, I just ran the Bot for WP Catholicism and the Wikipedia:WikiProject Catholicism/Assessment page has incorrect numbers for the "???" column. for Stubs it displays 1 but when I click on it, 3 articles show. I did purge the page before viewing. — JoeHebda • (talk) 13:31, 29 August 2018 (UTC)
- And a manual run also just produces the tables but not the logs. ww2censor (talk) 22:13, 21 August 2018 (UTC)
Today is Sept. 3 & last logs are on Aug. 31st. When looking at "User contributions" for the Bot, it is still running daily but not making logs. Each day the bot stops processing at User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki). Wondering if something is broken at this WP? Or maybe the next WP in line to be processed? — JoeHebda • (talk) 13:40, 3 September 2018 (UTC)
- Logs are now apparently running! Let's keep an eye on things, though. Walkerma (talk) 03:57, 4 September 2018 (UTC)
- @Walkerma: From "View history" the logs were not created on these dates
- July 14
- August 1, 4, 10, 14, 16, 17, 18, 19, 20, 24, 26, 27, 28, 29
- September 1, 2
- Questions
- What is making the Bot stop creating logs?
- What makes the bot decide to begin making the logs again?
- How does the Bot "know" which days are missing?
- Should this issue be taken to Village Pump-Technical?
- Lastly, should this Bot be divided in half or two Bots? Pass # 1 = Update all assessment tables, then Pass # 2 = create logs.
- Regards, — JoeHebda • (talk) 14:06, 4 September 2018 (UTC)
- The problem is that we don't have anyone on en:WP who is able to maintain the bot, so we have to ask User:Kelson who is more active on fr:WP. He is familiar with the code, but his main focus is on new releases of Kiwix, and his time is very valuable so I don't like to bug him unless it's serious. So it's very hard to get any major changes to the code, though Kelson does what is needed to keep the bot running. It would be great if we could get someone local to this project with the know-how and the time to maintain the bot and to make occasional improvements to the code; however, our last couple of recruitment attempts failed. The problems that occurred at fairly regular intervals before related to (I think) a memory usage part that would max out and have to be expanded. Kelson rewrote the code in March or so, and migrated it to a new server, to try and eliminate that ongoing problem permanently - but apparently the bugs persist. Do you know anyone who could help? Walkerma (talk) 04:16, 5 September 2018 (UTC)
- @Walkerma: At Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log Revision history when I click on "contribs" for WP 1.0 bot, it shows what appears it is looping & then stalls out. https://en.wikipedia.org/wiki/Special:Contributions/WP_1.0_bot.
- At 21:13, 4 September 2018, it completes "Wikipedia:Version 1.0 Editorial Team/Bible articles by quality log", and then waits until 23:54, 4 September 2018.
- It begins "User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)", works on more assessment tables & never continues with creating logs.
- It looks like looping between Tables/Project/Biography (military) and Tables/Project/Biography and Tables/Project/Military history.
- While doing assessments for Category:Unassessed biography articles did notice some kind of inter-connection with these 3 WP. Just a theory but could there be some kind of "tangled web"? Causing the bot to repeat & eventually timeout? I certainly do not understand how any of this WP internal-plumbing works, & do not really need to know.
- Perhaps at Village Pump-Technical there may be someone who can dig into & fix. If the Bot is not broken, maybe changes are needed at 1 or more of above WP. — JoeHebda • (talk) 16:18, 5 September 2018 (UTC)
- I'm quite busy IRL for the next 2-3 days, but as time allows I'll try to reach Kelson again. In the meantime, if you can find someone on en:WP to help, that would be great! Your idea of a "tangled web" is interesting - perhaps it is getting into some type of logic loop that makes it get stuck. 11:40, 7 September 2018 (UTC)
- The problem is that we don't have anyone on en:WP who is able to maintain the bot, so we have to ask User:Kelson who is more active on fr:WP. He is familiar with the code, but his main focus is on new releases of Kiwix, and his time is very valuable so I don't like to bug him unless it's serious. So it's very hard to get any major changes to the code, though Kelson does what is needed to keep the bot running. It would be great if we could get someone local to this project with the know-how and the time to maintain the bot and to make occasional improvements to the code; however, our last couple of recruitment attempts failed. The problems that occurred at fairly regular intervals before related to (I think) a memory usage part that would max out and have to be expanded. Kelson rewrote the code in March or so, and migrated it to a new server, to try and eliminate that ongoing problem permanently - but apparently the bugs persist. Do you know anyone who could help? Walkerma (talk) 04:16, 5 September 2018 (UTC)
- @Walkerma: From "View history" the logs were not created on these dates
@Walkerma: For Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log September 6 the log is missing. Sept.7 is there so somehow 6th was skipped. If I remember correctly, that was the day I did a few article cleanups from the assessment table, then manually ran the Bot for WP Catholicism. This might be another issue--why no log when manual run of the Bot? — JoeHebda • (talk) 12:53, 8 September 2018 (UTC)
Interesting comments about Bot problems at Wikipedia:WikiProject Biography/Popular pages. Might be a different bot, but a clue about how to fix? — JoeHebda • (talk) 14:14, 8 September 2018 (UTC)
- @Walkerma: For Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log September 9, the log is missing. — JoeHebda • (talk) 13:14, 10 September 2018 (UTC)
- @Walkerma: For Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log September 10, the log is missing. I will manually run the Bot for WP Cath. & see if that will trigger logs? — JoeHebda • (talk) 13:02, 11 September 2018 (UTC)
- Thanks for keeping track! Kelson is aware of the problem, but he has a big software launch going on and may be too busy right now. However, he has asked us to gather requirements for a new bot and visualization tool, since he says: "The current solution is not adapted anymore to the needs and can not be further developed properly". So I will start a new thread soon, when I get a break from work. Walkerma (talk) 15:45, 11 September 2018 (UTC)
- @Walkerma: Oneof my concerns is reliance on 1 person for Bot maintenance. While I am not familiar with Kelson, I wonder how a team can be assembled to create a new bot?
- I myself know nothing of how to code a bot. Since I joined wikipedia in 2014, Nettrom has done a great job fixing and improving Suggestbot. User:Nettrom maintains User:SuggestBot which scans all of Wikipedia. On Wikipedia:Community portal is {{open task}} which is updated from Suggestbot. — JoeHebda • (talk) 20:12, 11 September 2018 (UTC)
- I agree - but really we've had no choice. On two occasions we've put the word out for bot help and got no response, despite the fact that this bot is one of the most heavily used on en:WP. For about three years we had a couple of people doing maintenance but they didn't really have the tech skill to amend the code very much. (They still knew more than me!) I think bot maintenance isn't too much work once it's stable, but a rewrite is a major undertaking. The only reason maintenance became such an issue is because it's almost 10 years since this bot had a major rewrite, and much of the infrastructure has changed since then. Kelson does in fact lead a whole team of developers (in fact I had Kelson + four of his developers stay at my house last year!), but their main focus is obviously on Kiwix, which is now officially maintained and supported by WMF. I would say, though, that if Nettrom (and/or others) is/are willing to work on this in the next few months then we should definitely encourage him! Walkerma (talk) 02:35, 12 September 2018 (UTC)
- Update: See this discussion on my talk page, where it seems we may have someone new who is willing (and able!) to help with the bot. That would be excellent news! Walkerma (talk) 03:51, 12 September 2018 (UTC)
- Thanks for keeping track! Kelson is aware of the problem, but he has a big software launch going on and may be too busy right now. However, he has asked us to gather requirements for a new bot and visualization tool, since he says: "The current solution is not adapted anymore to the needs and can not be further developed properly". So I will start a new thread soon, when I get a break from work. Walkerma (talk) 15:45, 11 September 2018 (UTC)
Bot looping
Greetings, when looking at "User contributions" for WP 1.0 bot it seems to be looping after it completes Bibliographies, and does not make any logs for Bio WPs. And stops making logs for all following WP.
06:37, 12 September 2018 (diff | hist) . . (-401) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) (current)
05:30, 12 September 2018 (diff | hist) . . (+402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
05:08, 12 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) (current)
04:50, 12 September 2018 (diff | hist) . . (-402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
04:16, 12 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
04:03, 12 September 2018 (diff | hist) . . (+402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
02:39, 12 September 2018 (diff | hist) . . (-402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
23:07, 11 September 2018 (diff | hist) . . (+402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
22:54, 11 September 2018 (diff | hist) . . (-402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
22:47, 11 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
22:35, 11 September 2018 (diff | hist) . . (+402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
21:55, 11 September 2018 (diff | hist) . . (-402) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
21:37, 11 September 2018 (diff | hist) . . (+545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
21:30, 11 September 2018 (diff | hist) . . (-754) . . Wikipedia:Version 1.0 Editorial Team/Bibliographies articles by quality log (Log for September 12, 2018 (2G r541)) (current)
There must be some inter-connection between these WP causing the bot to repeat. Or with over 5-million articles, the workload is overwhelming the bot? Regards, — JoeHebda • (talk) 12:34, 12 September 2018 (UTC)
Possible alternatives
@Walkerma: Following below, random thoughts and ideas.
When I look at "Popular pages", for example Wikipedia:WikiProject Catholicism/Popular pages it is a different Bot that runs at start of each new month, and takes 15 to 20 days to get to WP Catholicism. Brings to mind questions
- Can only those WP Biography and History (and sub-projects) be ran as a completely seprate job?
- Can bot be changed to run weekly instead of daily?
- Does bot skip Inactive WikiProjects? (to lighten the load)
- Should bot be split into 2 different bots with specific jobs/tasks, for example
- Job 1 = Create all the logs of WP updates,changes, deletes, etc.
- Job 2 = Replace Assessment tables
Hope this helps. — JoeHebda • (talk) 12:18, 12 September 2018 (UTC)
Cloud services
Today, found Cloud Services page and wondering if people there could help with creating a new Bot, or fixing existing? — JoeHebda • (talk) 18:22, 13 September 2018 (UTC)
- That whole infrastructure looks invaluable, thank you so much for the link! I am going to look more into it as I start work on the next version of WP 1.0 Bot. audiodude (talk) 02:36, 20 September 2018 (UTC)
Is tools.wmflabs down?
FYI - I copy/pasted below from WP:VPT so it is recorded here.
Greetings, for several days now when attempting to run tools.wmflabs.org/enwp10/cgi-bin/update.fcgi and getting "504 Gateway Time-out" instead. Not sure who to contact so I thought to start here at VPT. Regards, — JoeHebda • (talk) 13:25, 19 September 2018 (UTC) ping|JoeHebda is a platform for developers to host their programs. So no, not all the tools.wmflabs.org platform is down, only the enwp10 tool :)
- ping|Hedonil|Kelson|Theopolisme, project maintainers of https://tools.wmflabs.org/enwp10 tool. --Framawiki (please notify) (talk) 16:42, 19 September 2018 (UTC)
- Pings to maintainers: ping|Theopolisme, ping|Kelson, and ping|Hedonil. — xaosflux Talk 17:12, 19 September 2018 (UTC)
--
I have restarted the Web service manually and it is back. Kelson (talk) 10:06, 20 September 2018 (UTC)
Posted by — JoeHebda • (talk) 16:07, 20 September 2018 (UTC)
Questions
Please excuse my ignorance, but is this enwp10 tool different than the bot that creates the assessment logs? If they are two different softwares, is enwp10 stopped/shutdown while WP 1.0 bot is running? So they are not conflicting?
Wondering Kelson (talk) if multiple people know how to restart "enwp10 tool"? In case it stops again.
Regards, — JoeHebda • (talk) 16:16, 20 September 2018 (UTC)
- User:audiodude will soon be able to do that soon. Kelson (talk) 08:04, 21 September 2018 (UTC)
September assessment bot logs
Tracking for Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log.
Date | Log created | Comment |
---|---|---|
September 1 | None | - |
September 2 | None | - |
September 3 | Sept. 1, Sept. 2, Sept.3 | at 21:27 |
September 4 | None | - |
September 5 | Sept. 4, Sept. 5 | at 21:34 |
September 6 | skip Sept. 6, log Sept. 7 | at 21:07 |
September 7 | None | - |
September 8 | Sept. 8 | at 21:26 |
September 9 | None | - |
September 10 | None | - |
September 11 | None | - |
September 12 | Sept. 9, 10, 11, 12 | at 22:16 |
September 14 | Sept. 14 | at 21:58 |
September 15 | Sept. 15 | at 22:09 |
September 16 | None | - |
September 17 | Sept. 16 | at 22:05 |
September 18 | None | - |
September 19 | Sept. 18, Sept. 19 | at 21:56 |
September 20 | None | - |
September 21 | Sept. 20, Sept. 21 | at 21:43 |
September 22 | None | - |
September 23 | Sept. 22, Sept. 23 | at 21:46 |
September 24 | None | - |
September 25 | Sept. 24, Sept. 25 | at 21:52 |
September 26 | Sept. 26 | at 21:46 |
September 27 | Sept. 27 | at 21:43 |
September 28 | Sept. 28 | at 21:20 |
September 29 | None | - |
September 30 | None | - |
Questions: Wondering if the bot is actually running? Or is a live person manually forcing bot to run? — JoeHebda • (talk) 14:25, 26 September 2018 (UTC)
WikiProject redirect
Today Kelson (talk) while reviewing the logs for User:WP 1.0 bot, I find that after regular bot processing there are many entries for Biography (military).
- 05:47, 22 September 2018 (diff | hist) . . (-545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki) (current)
- 05:14, 22 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) (current)
- 04:33, 22 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
- 04:31, 22 September 2018 (diff | hist) . . (+545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
- 04:22, 22 September 2018 (diff | hist) . . (-545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
- 03:51, 22 September 2018 (diff | hist) . . (+545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
- 03:50, 22 September 2018 (diff | hist) . . (-545) . . User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
- 03:48, 22 September 2018 (diff | hist) . . (0) . . User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
- 00:24, 22 September 2018 (diff | hist) . . (+344) . . Wikipedia:Version 1.0 Editorial Team/Zoo articles by quality log (Log for September 21, 2018 (2G r541)) (current)
Investigating further, I find a redirect for Wikipedia:WikiProject Biography (military) that points to #REDIRECT [[Wikipedia:WikiProject Biography/Military]], a sub-directory of WP Biography. Wondering if this is causing the bot issues? — JoeHebda • (talk) 13:04, 22 September 2018 (UTC)
September 28, 2018 - enwp10 not running
Greetings @Kelson: and @Audiodude: The web service for enwp10 is not running & needs to be restarted. After timing out it shows 502 Bad Gateway. Requested from wikitable at Wikipedia:WikiProject Catholicism/Assessment. Regards, — JoeHebda • (talk) 13:12, 28 September 2018 (UTC)
September 29, 2018 - enwp10 not running
Greetings @Kelson: and @Audiodude: The web service for enwp10 is not running & needs to be restarted. In browser tab it shows "Loading" and never times out with any error. Eventually browser says "no internet connection" (not true). Requested from wikitable at Wikipedia:WikiProject Catholicism/Assessment. Regards, — JoeHebda • (talk) 14:34, 29 September 2018 (UTC)
- Now running. Thanks :-) — JoeHebda • (talk) 19:12, 29 September 2018 (UTC)
- Great, I have setup a monitoring solution on this service in a attempt to reduce the overall down time. Let see if we can do better ;) Kelson (talk) 07:12, 30 September 2018 (UTC)
- Ok @Kelson: monitor is a great idea. When it trips off then a better idea of what might be conflicting/causing it to stop. And when it happens. Just guessing ,but if it is being stopped before the assessment bot runs, then maybe just need to add more code to restart when assessement bot is done. :-) — JoeHebda • (talk) 20:48, 30 September 2018 (UTC)
- Great, I have setup a monitoring solution on this service in a attempt to reduce the overall down time. Let see if we can do better ;) Kelson (talk) 07:12, 30 September 2018 (UTC)
October assessment bot logs
Tracking for Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log.
Date | Log created | Comment |
---|---|---|
October 1 | None | - |
October 2 | None | - |
October 3 | None | - |
October 4 | Sept. 29 Sept. 30 Oct. 1 Oct. 2 Oct. 3 Oct. 4 |
at 22:01 at 22:02 at 22:02 at 22:02 at 22:02 at 22:02 |
October 5 | None | - |
October 6 | None | - |
October 7 | None | - |
October 8 | Oct. 5 Oct. 6 Oct. 7 Oct. 8 |
at 22:03 at 22:03 at 22:03 at 22:03 |
October 9 | None | - |
October 10 | None | - |
October 11 | None | - |
October 12 | None | - |
October 13 | None | - |
October 14 | None | - |
October 15 | None | - |
October 16 | - | • |
October 17 | - | • |
October 18 | - | • |
October 19 | - | • |
October 20 | - | • |
October 21 | - | • |
October 22 | - | • |
October 23 | - | • |
October 24 | - | • |
October 25 | - | • |
October 26 | - | • |
October 27 | - | • |
October 28 | - | • |
October 29 | - | • |
October 30 | - | • |
October 31 | - | • |
October 3, 2018 - enwp10 not running
Greetings @Kelson: and @Audiodude: The web service for enwp10 is not running & needs to be restarted. In browser tab it shows "Loading" and never times out with any error. Requested from wikitable at Wikipedia:WikiProject Catholicism/Assessment. Regards, JoeHebda (talk) 14:17, 3 October 2018 (UTC)
October 4, 2018 - WP 1.0 bot processed 5 days of assessment logs
Greetings @Kelson: and @Audiodude: - Wondering what happened last night to trigger WP 1.0 bot to process so many days all at once?
Any way of tracking back to see if the bot was manually "jump-started"?
Just my thought but even if the bot is re-written/replaced, will there still be the conflicting WikiProjects that block processing, and will a new bot do the same?
Is there a way to check to software code to see if tool "enwp10" is shutdown/stopped before WP 1.0 bot begins processing? To insure these two are not conflicting. And that enwp10 is re-started when WP 1.0 bot is done?
- Stop/shutdown enwp10 tool.
- WP 1.0 bot processing
- Re-start enwp10 tool.
Regards, JoeHebda (talk) 14:23, 5 October 2018 (UTC)
- Hi @JoeHebda: I was actually watching the log update job run last night. As far as I can tell, it was not manually run, it was the normal cron job. I also downloaded and took a look at past logs for the bot, and could see that, the previous few nights, it had stopped unexpectedly without any stack trace or other error information. The bot does have logic for trying to "catch up" on pages when it falls behind, and I think this logic has served it well in the past to cover for unreliability, since most editors on WikiProjects are likely not closely monitoring it day by day by day.
- It is unclear what is causing it to die in these situations, though. Clearly, a goal for the rewrite is to provide better logging and stack traces so that when something goes wrong, it can be diagnosed.
- I'm interested in your idea about stopping the enwp10 web interface while the logging bot is running. Currently, no attempt is made to do that and the programs run concurrently. What is it that you think that there's a source of contention (presumably for database resources) and why do you think that this would help? audiodude (talk) 03:42, 6 October 2018 (UTC)
- Greetings @Audiodude: Wondering if there is any kind of a "timer" in the job that says "after X hours or minutes" to stop after WP currently being worked on is done. Or after X number of WikiProjects? That would explain randomness. Just as there is a "Start at" time,is there a "Stop time"?
- In looking at Wikipedia:WikiProject Catholicism/Popular pages there is another bot (Community tech bot) doing assessments. It starts at Day 1 of each new month & plows through WikiProjects. It takes anywhere from 12 to 17 days to get to this specific WP. Could this be 2 bots that from time-to-time hit upon the same WP simultaneously, causing "WP 1.0 bot" to stop. Is there any "collision avoidance" logic in there? Like, "this WP is busy/locked, so, skip to the next WP & continue processing".
- Another thing to be checked - is there any kind of WP limit in the code? X number of WP completed so it stops there? If yes, increasing that WP limit to accomodate more WP could be the solution.
- A few more ideas. JoeHebda (talk) 13:34, 6 October 2018 (UTC)
- @JoeHebda: The bot starts with a list of every project it knows about and runs until every item in that list is processed. There is no limit on the number of projects to process. Like I said before, the bot seems to crash sporadically, but it's unclear why. There is also no logic to avoid "collisions" with other bots, but honestly that shouldn't be an issue because they operate on different pages and use different resources. It is not clear how such a collision avoidance mechanism would even be implemented. Cheers! audiodude (talk) 19:48, 7 October 2018 (UTC)
- @Audiodude: Thanks for explaining how the bot works.
- Here are a few more questions.
- 1. Is there a way to view content of that starting project list? To see if any projects are repeated, causing a loop & job to abort.
- 2. That starting list of projects, does it include inactive ones?
- 3. Are there any projects "out there" without assessment table?
- 4. Still wondering why it can go X-number-of-days without logs? Is the bot still running 24/7 during those days?
- Thanks for helping investigate this issue. Regards, JoeHebda (talk) 23:47, 7 October 2018 (UTC)
- @JoeHebda: Responses to your questions:
- 1. Yes, I've downloaded the list from the server and posted it as a as a csv here. There are no repeated projects as far as I can tell. Even if there were, that would not "cause a loop", so I'm afraid that's not the likely culprit.
- 2. Most likely. However I imagine it's a slippery slope, defining a project as "Inactive". Also, if it is Inactive, it is likely to have a relatively small number of pages to process so it shouldn't be a problem really.
- 3. I have no idea.
- 4. The log updating bot doesn't run 24/7. It starts at around Noon UTC time every day and runs until it is finished. Like I said, I looked at the logs and the bot seems to be quitting "mysteriously" and "without a stack trace" on those days that it fails.
- Cheers, audiodude (talk) 03:09, 8 October 2018 (UTC)
@Audiodude: Thanks for the csv-file.
- While I did not read the whole thing, paging through I noticed an "odd line" at #2370. It is very long & unlike other WP lines. Wondering it this is the problem? I have no idea how to fix, or if fixing will solve the issue.
Wiki_Loves_Women,Wikipedia:WikiProject Wiki Loves Women,Wikipedia,Wikipedia:WikiProject,Wikipedia,Wikipedia-Books,Wikipedia:WikiProject,Wikipedia-Books,Wikipedia_1.0_Arts,NULL,Wikipedia_essays,NULL,Wikipedia_vital,Wikipedia:WikiProject Vital articles
- At random I picked "Wikipedia:WikiProject Cartoon Network" in the csv file & see it appears 5 times. Could this be making the bot to run much longer? And maybe causes it to occasionally stop when it becomes confused.
- The CSV file has over 2,400 lines, yet at Wikipedia:WikiProject Council/Directory the category tree there shows 1,490 projects:
674 Active projects
242 Defunct projects
1 Draft project
299 Inactive projects
274 Semi-active projects
- Is there a specific Category tree that drives the bot? I tried looking for one that matches & could not find.
The last Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log was on October 4, so any day now the bot should kick out multiple days. JoeHebda (talk) 14:23, 8 October 2018 (UTC)
- @JoeHebda: Glad the CSV proved useful! The weird line you saw was just a result of the (crude) post-processing I did on the raw database results, it presumably should be broken across several lines. It's not causing any problems for the bot. I've updated the gist to display the "fixed" rows as they should have appeared in the original CSV. Note there were other errors in the CSV because of my (crude) post-processing, but none of these are reflected in the actual data the bot uses. See the updated gist here.
- I looked at the appearances of "Cartoon Network", but it's all different sub-projects:
- WikiProject Cartoon Network/Adult Swim task force
- Wikipedia:WikiProject Cartoon Network/Aqua Teen Hunger Force task force
- WikiProject Cartoon Network/Ben 10 task force
- Wikipedia:WikiProject Cartoon Network/Ed, Edd n Eddy task force
- Wikipedia:WikiProject Cartoon Network
- It is important to understand, even if a project appeared multiple times on this list, it would not necessarily cause problems for the bot. The likely behavior we would see is that the logs and tables for these projects would get multiple edit revisions with the same data, which would not cause any problems for the other projects. Looking for duplicate data as the source of the problem is a dead end. It's far more likely that the data sets are too big and the bot is running out of memory or something similar (though we can't confirm this because the bot dies without a stack trace).
- The bot uses this category exclusively for seeding its list of projects. I believe this is in accordance with the instructions in the WP 1.0 documentation, along the lines of what a WikiProject needs to do to be included in assessments. However, we might be able to revisit this criteria. I think the WikiProject Council links you provided seem very useful! audiodude (talk) 16:23, 8 October 2018 (UTC)
October 8, 2018 - WP 1.0 bot processing logs
@Audiodude: Digging back through last several days, I see, Yes, the bot keeps running. Just stops making logs at Australia, New Zealand and South Pacific military history project.
---
• 21:48, 6 October 2018 (diff | hist) (+174) User:WP 1.0 bot/Tables/Project/Australia, New Zealand and South Pacific military history (Copying assessment table to wiki)
• 21:42, 6 October 2018 (diff | hist) (+660) Wikipedia:Version 1.0 Editorial Team/Big Brother articles by quality log (Log for October 6, 2018 (2G r541))
---
• 21:33, 5 October 2018 (diff | hist) (+1) User:WP 1.0 bot/Tables/Project/Australia, New Zealand and South Pacific military history (Copying assessment table to wiki)
• 21:17, 5 October 2018 (diff | hist) (-14,238) Wikipedia:Version 1.0 Editorial Team/Biography (arts and entertainment) articles by quality log (Log for October 5, 2018 (2G r541))
---
• 02:32, 5 October 2018 (diff | hist) (-1) User:WP 1.0 bot/Tables/Project/Australia, New Zealand and South Pacific military history (Copying assessment table to wiki)
• 02:03, 5 October 2018 (diff | hist) (+177) Wikipedia:Version 1.0 Editorial Team/Zoroastrianism articles by quality log (Log for October 2, 2018 (2G r541)) (current)
---
• 22:59, 3 October 2018 (diff | hist) (+1) User:WP 1.0 bot/Tables/Project/Australia, New Zealand and South Pacific military history (Copying assessment table to wiki)
• 21:41, 3 October 2018 (diff | hist) (+20,896) Wikipedia:Version 1.0 Editorial Team/Biography (arts and entertainment) articles by quality log (Log for October 3, 2018 (2G r541))
---
• 21:37, 2 October 2018 (diff | hist) (+2) User:WP 1.0 bot/Tables/Project/Australia, New Zealand and South Pacific military history (Copying assessment table to wiki)
• 21:28, 2 October 2018 (diff | hist) (+1,407) Wikipedia:Version 1.0 Editorial Team/Bihar articles by quality log (Log for October 2, 2018 (2G r541))
---
It does not seem to matter what project prior to "Australia, New Zealand and South Pacific military history". It just stops making logs when it gets to that project.
Silly question: does the bot not like the "Comma" in the project name? Maybe a different name, without "," & one of the bot's problems solved? JoeHebda (talk) 19:33, 8 October 2018 (UTC)
- @JoeHebda: This is interesting, but I think the actual logs of the bot tell us more about which project it is getting hung up on. I'm going to take a look at those now and get back to you. I don't think the comma has anything to do with it, though, as I successfully ran a "dry run" of that project just now and it queried the database just fine, and when I used the API method that copy_logs.pl uses to retrieve the log page, it also worked. audiodude (talk) 04:07, 10 October 2018 (UTC)
- It looks like today it got past the South Pacific military history project and died on Biography: [1]
- Still no stack trace or explanation in the logs of why it died though. I assume Biography is a big project (the logs say there were 1005 entries for it) and it might have run out of memory? audiodude (talk) 04:18, 10 October 2018 (UTC)
- So I tried a DRY_RUN of copy_logs.pl with project=Biography and sure enough I got this error:
DBD::mysql::st execute failed: MySQL server has gone away at ./copy_logs.pl line 572.
. According to this page, it indicates that the query might have been killed by the server. I have seen references to a "query killer" in the code comments before, so this seems to be the most likely case. - Ideally, the bot would just continue with the next project, which is definitely something I have planned for the next version of the bot. audiodude (talk) 04:32, 10 October 2018 (UTC)
- I asked for help in the wiki toolforge IRC channel, and it looks like there's nothing particularly wrong with the query that seems to be "causing" this. It does in fact seem to be failing "randomly". Again, I think the long term solution is to skip the project when this happens and go on to the next one. audiodude (talk) 05:08, 10 October 2018 (UTC)
- @Audiodude: Thanks for discovering the actual cause for processing to randomly abort. From your previous comments below.
- The bot uses this category exclusively for seeding its list of projects. Since shows over 1.6 million articles (Wikipedia:WikiProject Biography/Assessment). Wondering if that WP & all it's sub-projects could be removed from this tree & a seperate job/process be created to run just that bunch? Regards, JoeHebda (talk) 13:58, 10 October 2018 (UTC)
@Audiodude: 1. Any logic in WP 1.0 bot program so that it skips assessments if already done that day via enwp10 tool? If yes, then bot might have a better success in creating logs.
2. What makes the bot switch over from doing assessments to creating logs?
3. Is there a way of forcing the bot to skip assessments and begin creating logs? Especially since logs are missing the last 4 days.
4. Another idea - if there were 2 jobs, first one starting assessments only, then 1-2 hours later start second job that does logs only.
At this point I'm almost "running on empty" for solutions to this long-standing issue. Regards, JoeHebda (talk) 01:27, 14 October 2018 (UTC) JoeHebda (talk) 01:27, 14 October 2018 (UTC)
October 9, 2018 - WP 1.0 bot processing
@Audiodude: From the bot logs, last night it finished all the Copying assessment table to wiki at 21:17. Then it started with Log for October 8, 2018 (2G r541) creating project log files.
---
• 21:17, 8 October 2018 (diff | hist) (+6,317) Wikipedia:Version 1.0 Editorial Team/AFC articles by quality log (Log for October 8, 2018 (2G r541)) (current)
---
• 21:17, 8 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
---
Definitely a long shot-but wondering if starting the bot job 1 or 2 hours sooner would help? JoeHebda (talk) 13:02, 9 October 2018 (UTC)
- @JoeHebda: I don't think starting the bot earlier will have any effect. The bot does not have any kind of "time limit", it simply starts at a certain time and runs until it is finished. audiodude (talk) 04:05, 10 October 2018 (UTC)
October 13, 2018 - WP 1.0 bot processing
@Audiodude: and @Walkerma: From the bot logs, last night it stopped at 20:52. The next entry for 14 Oct. at 08:14 was me manually running enwp10 tool for WP Saints this morning. Questions are below.
User contributions for WP 1.0
• 08:14, 14 October 2018 (diff | hist) (-123) User:WP 1.0 bot/Tables/Project/Saints (Copying assessment table to wiki) (current)
---
• 20:52, 13 October 2018 (diff | hist) (-23,772) Wikipedia:Version 1.0 Editorial Team/Biography (arts and entertainment) articles by quality log (Log for October 13, 2018 (2G r541)) (current)
---
• 20:51, 13 October 2018 (diff | hist) (-7,281) Wikipedia:Version 1.0 Editorial Team/Biography (actors and filmmakers) articles by quality log (Log for October 13, 2018 (2G r541)) (current)
---
• 20:51, 13 October 2018 (diff | hist) (-34) Wikipedia:Version 1.0 Editorial Team/Biography articles by quality log (Log for October 13, 2018 (2G r541) [chunk 1 of 5]) (current)
---
• 20:51, 13 October 2018 (diff | hist) (+94) Wikipedia:Version 1.0 Editorial Team/Biography articles by quality log (Log for October 13, 2018 (2G r541) [chunk 2 of 5])
---
• 20:51, 13 October 2018 (diff | hist) (-157) Wikipedia:Version 1.0 Editorial Team/Biography articles by quality log (Log for October 13, 2018 (2G r541) [chunk 3 of 5])
---
• 20:50, 13 October 2018 (diff | hist) (+9,089) Wikipedia:Version 1.0 Editorial Team/Biography articles by quality log (Log for October 13, 2018 (2G r541) [chunk 4 of 5])
---
• 20:50, 13 October 2018 (diff | hist) (-9,000) Wikipedia:Version 1.0 Editorial Team/Biography articles by quality log (Log for October 13, 2018 (2G r541) [chunk 5 of 5])
---
• 20:45, 13 October 2018 (diff | hist) (+788) Wikipedia:Version 1.0 Editorial Team/Bihar articles by quality log (Log for October 13, 2018 (2G r541)) (current)
---
Question: Even though the bot is started same time each day (cron job) can it be manually run a second or more times? And if yes, will it pickup where it last left off? That way it will catch-up with all the pending work not completed. JoeHebda (talk) 13:35, 14 October 2018 (UTC)
October 14, 2018 - WP 1.0 bot processing
Greetings @Walkerma: and @Audiodude: Last night it looks like the WP 1.0 bot started processing time of 19:11. Wondering if that is the normal scheduled start time?
From the logs, it stopped (again) at
---
• 02:28, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki) (current)
---
Reporting that Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log was last updated on October 8. After the bot stops, how is it manually re-started?
Is there a problem of letting the bot run 24/7?
How far behind can the bot be & still able to process backlogged work?
Regards, JoeHebda (talk) 13:50, 15 October 2018 (UTC)
Last week
Hi again, in looking at "WP 1.0 bot" logs from last week it looks like when the bot gets behind, it just keeps running 24hrs plus. A question - what does cron do when it attempts to start the bot & it is already running? Could cron be the random "bot killer"? JoeHebda (talk) 19:53, 15 October 2018 (UTC)
October 15, 2018 - WP 1.0 bot NO log since Oct. 8
Greetings @Walkerma: and @Audiodude: Wondering if Wikipedia:Version 1.0 Editorial Team/Catholicism articles by quality log will be losing log data?
Is there a way to force bot to catch up?
JoeHebda (talk) 14:25, 16 October 2018 (UTC)
Almost 5 Hours for WP 1.0 bot to process two WP
@Walkerma: and @Audiodude: Thinking there must be something in error with either category tree or WP content pages? Repeats of same table? Here's the logs for Military history and Biography (military).
• 02:28, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
---
• 02:24, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
---
• 01:19, 15 October 2018 (diff | hist) (-10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
---
• 00:48, 15 October 2018 (diff | hist) (+10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
---
• 00:04, 15 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
---
• 22:52, 14 October 2018 (diff | hist) (-10) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
---
• 21:52, 14 October 2018 (diff | hist) (0) User:WP 1.0 bot/Tables/Project/Military history (Copying assessment table to wiki)
---
• 21:43, 14 October 2018 (diff | hist) (-137) User:WP 1.0 bot/Tables/Project/Biography (military) (Copying assessment table to wiki)
---
JoeHebda (talk) 02:22, 17 October 2018 (UTC)
Third generation WP1.0 bot
As discussed above, we have begun working on the third generation version of User:WP_1.0_bot (the current version is the "second generation"). We are planning what features are needed, and we want to get the input from people who are using the bot regularly. I have also started a wiki page. If you are an active user of the bot (e.g., for WikiProject assessments), we would like to hear from you! We are setting up two venues:
- User:WP_1.0_bot/Third_generation and the related discussion page, which will be for on-wiki discussion.
- We're also planning a Jitsi discussion (audio only) on Thursday, October 18th, 2018, at 1800h UTC (2000h Central European Summer Time, 11am US Pacific Daylight Time).Walkerma (talk) 03:07, 11 October 2018 (UTC)
If you want to join us, then please sign your name below, and we'll contact you: