Page MenuHomePhabricator

Cyberpower678 (Maximilian Doerr)
Voluntary Software Engineer/Bot Operator/Internet Archive Employee

Projects (8)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Nov 14 2014, 4:15 PM (344 w, 3 d)
Availability
Available
IRC Nick
Cyberpower678 or CP678
LDAP User
Cyberpower678
MediaWiki User
Cyberpower678 [ Global Accounts ]

Recent Activity

Fri, Jun 11

Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

[...]
I’m not convinced that this is something that can be fixed bot wide. As pointed out the API correctly identified the invoking user, and the consumer has all the correct grants selected that are needed to do the job, yet MW opted to error out with a blocked code. 172.16.*.* are likely tool UI invoked requests while the 185.15 one is the bot’s dedicated IP.

Would it be possible to log full API response at the bot's side? It'd be interesting to know the block ID, which should be included in the response. I think that would show us some way to go forward.

@Urbanecm can you re-run that last query counting requests made omitting if the api_error_codes field is NULL or not? I’d like to see how those numbers change.

Like this?

spark-sql (default)> SELECT
                   >     http.client_ip, COUNT(*)
                   > FROM event.mediawiki_api_request
                   > WHERE
                   >     year=2021 AND
                   >     month=6 AND
                   >     day=11 AND
                   >     http.request_headers['user-agent'] LIKE "IABot/2.0%"
                   > GROUP BY http.client_ip
                   > ORDER BY COUNT(*) DESC;
client_ip       count(1)
185.15.56.22    7548910
172.16.1.7      8943
172.16.1.28     8104
172.16.1.228    51
172.16.1.4      36
[redacted]      14
Time taken: 65.786 seconds, Fetched 6 row(s)
spark-sql (default)>
Fri, Jun 11, 10:06 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 closed T284844: Athboy - Mordecai Jones as Invalid.
Fri, Jun 11, 9:09 PM · InternetArchiveBot
Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

@Urbanecm can you re-run that last query counting requests made omitting if the api_error_codes field is NULL or not? I’d like to see how those numbers change.

Fri, Jun 11, 9:04 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

I can’t maybe have it pass back the whole API response ad-verbatim for users to report here. I’m absolutely certain that there is nothing wrong with the OAuth module of the bot, or it’s consumers. The many requests that @Urbanecm listed are from the bot’s main execution workers using the bot’s own owner-only consumer to edit with. These consumers have been largely the same since they were first created, as has been the OAuth engine the bot uses. I’m not convinced that this is something that can be fixed bot wide. As pointed out the API correctly identified the invoking user, and the consumer has all the correct grants selected that are needed to do the job, yet MW opted to error out with a blocked code. 172.16.*.* are likely tool UI invoked requests while the 185.15 one is the bot’s dedicated IP.

Fri, Jun 11, 8:59 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

The problem is that I remain convinced this isn’t actually an error with the bot, but with the MediaWiki API. These are errors being passed back by the API itself, otherwise it would report a much more descriptive error, and you would also be barred from using the UI itself if you were actually blocked.

Fri, Jun 11, 5:09 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot

Wed, Jun 2

Cyberpower678 awarded T283980: Phacility (Maintainer of Phabricator) is winding down. Upstream support ending. a Heartbreak token.
Wed, Jun 2, 12:37 AM · Release-Engineering-Team (Seen), User-Matthewrbowker, Phabricator

May 6 2021

Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

It's pretty much confirmed that this is not an issue with IABot. After testing multiple scenarios, a user that is legitimately blocked on Wikipedia will receive an entirely different worded error about their block. Specifically, the user will be greeted with "Blocked: You are currently blocked from using this interface. Check to make sure you are not blocked on Wikipedia and/or this interface." The current wording being returned to the user is "blocked: You have been blocked from editing.". This wording is consistent with what the MediaWiki API returns when a user attempts to submit an edit when MW thinks the user is blocked.

May 6 2021, 4:25 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

The bot was working when I tried to archive the "SB19" (on enwiki) page normally. I tried to archive a page with IABot with the "Add archives to all non-dead references" option enabled, and it marked me as blocked. Likewise, I asked another editor (from a completely different part of the planet, which means there's little chance of an IP-based block to take effect) to archive that same page with that option disabled, and they were also blocked. I think this might be replicated by enabling the "Add archives to all non-dead references" option, however I fail to find what would be the possible underlying cause of why adding archives would cause the bot to interpret the user as blocked. I also can't determine how long this block lasts, and who is blocking who in the first place. IABot devs might find this information useful to some extent.

May 6 2021, 4:05 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot

Apr 29 2021

Cyberpower678 closed T281532: Use of non-free third party analytics tool (Hotjar) by tools-iabot as Declined.

It is made very clear to the end user that this is a third party service, and that this service is opt-in. Users are not opted in by default. The use of Hotjar is not new to the admins of Toolforge.

Apr 29 2021, 9:27 PM · Toolforge-standards-committee, Privacy Engineering, User-Harej, InternetArchiveBot, Privacy, Toolforge

Apr 23 2021

Cyberpower678 moved T274865: Multiple entries about a non-working link are added. [ltwiki] from Syntax-related bugs to URL-related bugs on the InternetArchiveBot board.
Apr 23 2021, 5:07 PM · InternetArchiveBot
Cyberpower678 moved T275895: Owler.com falsely reported as dead link [nlwiki] from Syntax-related bugs to URL-related bugs on the InternetArchiveBot board.
Apr 23 2021, 5:07 PM · InternetArchiveBot

Apr 21 2021

Cyberpower678 closed T279767: Disable issues on InternetArchiveBot GitHub repository as Resolved.
Apr 21 2021, 8:27 PM · Project-Admins, InternetArchiveBot

Apr 15 2021

Cyberpower678 added a comment to T280215: mysqli (PHP 7.3 kubernetes container) fails to communicate with MariaDB v10.4.12 instance hosted on cyberbot-db-01.cyberbot.eqiad1.wikimedia.cloud.

None of those seem to apply as far as I can tell. It’s been discovered that this is only happening on the Kunernetes web service. The grid engine web service works fine.

Apr 15 2021, 10:06 PM · Toolforge, cloud-services-team (Kanban)
Cyberpower678 closed T279341: IABot Management Interface is unavailable as Resolved.
Apr 15 2021, 6:19 PM · InternetArchiveBot
Cyberpower678 reopened T280215: mysqli (PHP 7.3 kubernetes container) fails to communicate with MariaDB v10.4.12 instance hosted on cyberbot-db-01.cyberbot.eqiad1.wikimedia.cloud as "Open".

Oops wrong ticket. This may need some more investigation.

Apr 15 2021, 6:19 PM · Toolforge, cloud-services-team (Kanban)
Cyberpower678 closed T280215: mysqli (PHP 7.3 kubernetes container) fails to communicate with MariaDB v10.4.12 instance hosted on cyberbot-db-01.cyberbot.eqiad1.wikimedia.cloud as Resolved.
Apr 15 2021, 6:18 PM · Toolforge, cloud-services-team (Kanban)
Cyberpower678 added a comment to T279341: IABot Management Interface is unavailable.

https://phabricator.wikimedia.org/T280215

Apr 15 2021, 3:01 AM · InternetArchiveBot
Cyberpower678 created T280215: mysqli (PHP 7.3 kubernetes container) fails to communicate with MariaDB v10.4.12 instance hosted on cyberbot-db-01.cyberbot.eqiad1.wikimedia.cloud.
Apr 15 2021, 2:53 AM · Toolforge, cloud-services-team (Kanban)

Apr 6 2021

Cyberpower678 added a comment to T279207: http://thomas.loc.gov/ is now dead.

Alright. It will have to wait until I get the DB backend fixed. It's being repaired.

Apr 6 2021, 6:54 PM · InternetArchiveBot
Cyberpower678 added a comment to T279207: http://thomas.loc.gov/ is now dead.

@AManWithNoPlan how would you like to help maintain the data contained within IABot? I can grant you the power to do this yourself going forward? Interested?

Apr 6 2021, 6:53 PM · InternetArchiveBot
Cyberpower678 closed T279268: bot creates |archive-url= and |archive-date= for |lay-url= as Resolved.

When v2.0.9 releases, IABot will no longer read LayURL values in the CS1 templates.

Apr 6 2021, 6:52 PM · InternetArchiveBot
Cyberpower678 added a comment to T279268: bot creates |archive-url= and |archive-date= for |lay-url=.

Then what exactly is the lay-url for?

Apr 6 2021, 6:15 PM · InternetArchiveBot
Cyberpower678 merged T279450: No webservice into T279341: IABot Management Interface is unavailable.
Apr 6 2021, 4:24 PM · InternetArchiveBot
Cyberpower678 merged task T279450: No webservice into T279341: IABot Management Interface is unavailable.
Apr 6 2021, 4:24 PM · IABot-Team, InternetArchiveBot

Apr 5 2021

Cyberpower678 added a comment to T279341: IABot Management Interface is unavailable.

Yes. The DB driving it is currently on fire, so to speak. While I’m putting it out, I had to shut down everything to prevent corruption.

Apr 5 2021, 7:37 PM · InternetArchiveBot

Mar 25 2021

Cyberpower678 closed T245481: IABot run page should return JSON data as Resolved.

This is implemented in v2.0.9. Use action=runpages to call it.

Mar 25 2021, 1:53 PM · InternetArchiveBot
Cyberpower678 closed T274739: Trying to use skwiki on IABot's UI results in unusual error as Resolved.
Mar 25 2021, 12:22 PM · InternetArchiveBot
Cyberpower678 added a comment to T274739: Trying to use skwiki on IABot's UI results in unusual error.

Your OAuth URL was borked.

Mar 25 2021, 12:19 PM · InternetArchiveBot
Cyberpower678 added a comment to T274739: Trying to use skwiki on IABot's UI results in unusual error.
Mar 25 2021, 12:19 PM · InternetArchiveBot
Cyberpower678 closed T265840: SQL error message on submitting job as Resolved.

This is fixed in v2.0.9 which will be released in a few days.

Mar 25 2021, 2:33 AM · InternetArchiveBot
Cyberpower678 added a comment to T275205: InternetArchiveBot interface not showing all pages submitted.

I need the full list you submitted and the articles that didn't make their way onto the submitted job.

Mar 25 2021, 2:29 AM · InternetArchiveBot
Cyberpower678 closed T273371: Delete Google Books archives as Invalid.

No response.

Mar 25 2021, 2:28 AM · InternetArchiveBot
Cyberpower678 closed T277274: Bot keeps using wrong parameter on Dutch langauge version template as Resolved.

This is fixed in v2.0.9 which will be released in a few days.

Mar 25 2021, 2:24 AM · InternetArchiveBot
Cyberpower678 closed T278198: Workers/Worker1.out in iabot is huge - please truncate it, a subtask of T276525: 2021-03-05: tools nfs share cleanup, as Resolved.
Mar 25 2021, 2:20 AM · cloud-services-team (Kanban)
Cyberpower678 closed T278198: Workers/Worker1.out in iabot is huge - please truncate it as Resolved.
Mar 25 2021, 2:20 AM · InternetArchiveBot, IABot-Team, cloud-services-team (Kanban)
Cyberpower678 closed T275025: Bot uses nonexistent "dodelink" parameter instead of "dodeurl" [nlwiki] as Resolved.

This is fixed in v2.0.9, which will be released in a few days.

Mar 25 2021, 2:20 AM · InternetArchiveBot

Mar 22 2021

Cyberpower678 added a comment to T262861: InternetArchiveBot recreated a deleted page on zhwiki.

Is this still happening?

Mar 22 2021, 4:59 PM · Chinese-Sites, User-RhinosF1, InternetArchiveBot

Mar 19 2021

Cyberpower678 assigned T264843: InternetArchiveBot is creating new articles to Green_Cardamom.

This is related to a component of IABot Green develops.

Mar 19 2021, 5:09 PM · InternetArchiveBot

Mar 18 2021

Cyberpower678 added a comment to T277333: Request increased quota for cyberbot Cloud VPS project.

I see it attached as /dev/vdb but where does it actually mount? Do I have to do that myself?

Mar 18 2021, 4:47 PM · Cloud-VPS (Quota-requests)

Mar 12 2021

Cyberpower678 updated the task description for T277333: Request increased quota for cyberbot Cloud VPS project.
Mar 12 2021, 8:15 PM · Cloud-VPS (Quota-requests)
Cyberpower678 added a comment to T269914: IAbot sending a huge volume of action=raw requests (HTTP 415 errors).

Is this still happening? I noticed a task that was commented out in my crontab file, was not commented out in the actual crontab.

Mar 12 2021, 8:04 PM · Platform Team Workboards (Clinic Duty Team), SRE, InternetArchiveBot, Traffic
Cyberpower678 created T277333: Request increased quota for cyberbot Cloud VPS project.
Mar 12 2021, 7:11 PM · Cloud-VPS (Quota-requests)

Mar 5 2021

Cyberpower678 added a comment to T269914: IAbot sending a huge volume of action=raw requests (HTTP 415 errors).

Hmmm...it’s interesting. Not sure what is happening. Is there a timeframe when this happen? Is it continuous?

Mar 5 2021, 5:50 PM · Platform Team Workboards (Clinic Duty Team), SRE, InternetArchiveBot, Traffic

Feb 26 2021

Cyberpower678 added a comment to T274050: Users trying to analyze pages are being told they are blocked when they are not.

It’s hard to tell. It could also be other bots/tools getting blocked at the account level with the anon-flag disabled causing the IP to be effectively be hard-blocked. I don’t know how the inner workings of MediaWiki work. All I know is that this error message comes from the API itself, and not IABot.

Feb 26 2021, 12:06 AM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot

Feb 25 2021

Cyberpower678 added a project to T274050: Users trying to analyze pages are being told they are blocked when they are not: MediaWiki-API.

These error messages are not originating from the bot, it’s being passed back by the MW API itself when requesting the edit on behalf of the user. All users edit from the IP 185.15.56.1 which is Toolforge. This is either a glitch in the API, or there are admins hardblocking bots originating from it.

Feb 25 2021, 2:52 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 merged T275777: IABot Error into T274050: Users trying to analyze pages are being told they are blocked when they are not.
Feb 25 2021, 2:48 PM · Anti-Harassment, MediaWiki-Blocks, InternetArchiveBot
Cyberpower678 merged task T275777: IABot Error into T274050: Users trying to analyze pages are being told they are blocked when they are not.
Feb 25 2021, 2:48 PM · InternetArchiveBot

Feb 6 2021

Cyberpower678 closed T265377: Error msg=Analysis error: autoblocked: Your IP address has been blocked automatically, because it was used by a blocked user. as Resolved.

I'm hoping this is resolved.

Feb 6 2021, 1:06 AM · InternetArchiveBot
Cyberpower678 added a comment to T269831: IABot job queue has been stuck for a long time.

It'll take some time before the backlog of 229 pending jobs are completed.

Feb 6 2021, 12:57 AM · InternetArchiveBot
Cyberpower678 closed T269831: IABot job queue has been stuck for a long time, a subtask of T221971: IABot job queue has been stuck for days, as Resolved.
Feb 6 2021, 12:56 AM · InternetArchiveBot (v2.0)
Cyberpower678 closed T269831: IABot job queue has been stuck for a long time as Resolved.
Feb 6 2021, 12:56 AM · InternetArchiveBot
Cyberpower678 closed T273836: Infinite loop causes bot queue to stall as Resolved.
Feb 6 2021, 12:55 AM · InternetArchiveBot, IABot-Team

Feb 2 2021

Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Yes it turns out the bot had robust error handling for prod errors. It didn’t have robust handling for reused OAuth nonces. For some reason it got a lot of OAuth nonce already used errors. This took repeated running the last few days to diagnose.

Feb 2 2021, 10:48 PM · Traffic, SRE
Cyberpower678 moved T261514: Add logging to investigate false positives from New feature to Big projects on the InternetArchiveBot board.
Feb 2 2021, 6:11 PM · InternetArchiveBot
Cyberpower678 moved T273588: Wrong parameter on Dutch Wikipedia from Inbox to Syntax-related bugs on the InternetArchiveBot board.
Feb 2 2021, 5:54 PM · InternetArchiveBot

Feb 1 2021

Cyberpower678 claimed T269831: IABot job queue has been stuck for a long time.
Feb 1 2021, 1:13 AM · InternetArchiveBot
Cyberpower678 triaged T269831: IABot job queue has been stuck for a long time as High priority.
Feb 1 2021, 1:10 AM · InternetArchiveBot
Cyberpower678 closed T245942: URL fälschlicherweise "Weißgelistet" as Resolved.
Feb 1 2021, 1:02 AM · User-Cirdan, InternetArchiveBot
Cyberpower678 closed T270130: https://www.bloomberg.com/tosv2.html urls should not be added as Resolved.
Feb 1 2021, 1:01 AM · InternetArchiveBot
Cyberpower678 closed T259441: Applicable URLs found in manage domain data is empty as Declined.

Unable to reproduce.

Feb 1 2021, 12:57 AM · InternetArchiveBot
Cyberpower678 closed T191277: InternetArchiveBot should detect blank snapshots, a subtask of T193158: Detect unsuitable archive snapshots, as Resolved.
Feb 1 2021, 12:56 AM · Epic, InternetArchiveBot
Cyberpower678 closed T191277: InternetArchiveBot should detect blank snapshots as Resolved.

Closing this as resolved as the Wayback Machine has gotten better over the years.

Feb 1 2021, 12:56 AM · Internet-Archive, InternetArchiveBot
Cyberpower678 moved T187600: Edit summary should clearly distinguish between normalizing existing archive links and adding new ones from New feature to Gathering interest on the InternetArchiveBot board.
Feb 1 2021, 12:55 AM · InternetArchiveBot
Cyberpower678 moved T224584: Add a worker status page to IABot's Management Interface from New feature to Big projects on the InternetArchiveBot board.
Feb 1 2021, 12:55 AM · IABot-Team, InternetArchiveBot
Cyberpower678 moved T210849: IABot should refrain from editing a page more than once within a short time period from New feature to Gathering interest on the InternetArchiveBot board.
Feb 1 2021, 12:54 AM · InternetArchiveBot
Cyberpower678 moved T210852: Show which article a wiki's main process is working on from New feature to Big projects on the InternetArchiveBot board.
Feb 1 2021, 12:54 AM · InternetArchiveBot
Cyberpower678 moved T179350: Add a tool to report dead URLs from New feature to Gathering interest on the InternetArchiveBot board.
Feb 1 2021, 12:53 AM · InternetArchiveBot
Cyberpower678 moved T272927: IABot fails to properly recognize image parameters such as "link=" from Inbox to Syntax-related bugs on the InternetArchiveBot board.
Feb 1 2021, 12:45 AM · InternetArchiveBot
Cyberpower678 closed T272990: IABot would not run because of "ban" message as Invalid.

Unable to reproduce. Tool claims you are not blocked.

Feb 1 2021, 12:44 AM · InternetArchiveBot
Cyberpower678 closed T273268: Unnecessary edits as Resolved.
Feb 1 2021, 12:43 AM · InternetArchiveBot
Cyberpower678 moved T273206: IABot link normalization should be opt-in rather than opt-out from Inbox to Gathering interest on the InternetArchiveBot board.
Feb 1 2021, 12:41 AM · InternetArchiveBot
Cyberpower678 added a comment to T273371: Delete Google Books archives.

If you are getting the first error, make sure you are not set to a "Mixed" status. You need to firmly define the state of the URLs. Alive and Dead resets every individual link while Whitelist and Blacklist sets it on all the selected domains as a whole and the bot will no longer assess if they are alive or not.

Feb 1 2021, 12:40 AM · InternetArchiveBot
Cyberpower678 moved T273388: Bot incorrectly changes "wayback" templates to "cite web" despite of them following other cite templates. [huwiki] from Inbox to Syntax-related bugs on the InternetArchiveBot board.

This does indeed look like a legitimate bug.

Feb 1 2021, 12:32 AM · InternetArchiveBot
Cyberpower678 updated the task description for T273388: Bot incorrectly changes "wayback" templates to "cite web" despite of them following other cite templates. [huwiki].
Feb 1 2021, 12:31 AM · InternetArchiveBot
Cyberpower678 closed T273383: Whitelist ignored? as Resolved.

You did not whitelist it. No log entry for that URL at all aside from the bot scans it did of it. I have gone ahead and whitelisted it for you.

Feb 1 2021, 12:31 AM · InternetArchiveBot

Jan 28 2021

Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Just to note that cyberbot I has been blocked because of the blanking issues on enwiki. The bot has also been blocked on two other wikis for the blanking issues. It would be really great if this issue is fixed, as this has stopped a fair number of tasks.

The solution to this problem is pretty simple:

make the bot handle failures of the API (they will *always* happen, even if in ridiculously low numbers, as shown above) and stop blanking pages when receiving an error.

Even if we get to the bottom of which events caused the few errors we found evidence of, we can definitely guarantee there will be more errors in the future, and at times even a ton of errors, be it for a wrong deployment or some catastrophic hardware failure or something else.

I think the bot should only be unblocked once error management is properly taken into account, not before.

I don't disagree with you, and the block of the bot is because the bot was blanking (and not because of the server side issue). Primarily, the bot should be ready for strange situations like this. But secondarily, when the bot has to deal with the issues the root cause of the issue on the server side should be fixed with some level of speed.

Jan 28 2021, 5:19 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Timestamps of these entries seem to suggest that when the bot encounters these failures almost all API requests being made are erroring out during the timeframe of these batch errors.

Jan 28 2021, 5:11 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.
Jan 28 2021, 5:07 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Got an influx of blank, 500s and 502 overnight. Your errors may be "few" overall, but they are happening in batches.

Jan 28 2021, 5:06 PM · Traffic, SRE

Jan 27 2021

Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

@Cyberpower678 This doesn't sound to be a complete dump of a raw request. I'm pretty confident the response has at least one line (the one starting with HTTP/ that denotes the status etc.).

Jan 27 2021, 11:17 PM · Traffic, SRE
Cyberpower678 added a comment to T272842: Update template parameters @huwiki.

Normalization is by default on, but can be turned off if the community wants it off.

Jan 27 2021, 9:16 PM · InternetArchiveBot
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

I've added additional logging data to the framework.

Jan 27 2021, 7:10 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Got another surge of bad responses from production.

Jan 27 2021, 12:05 PM · Traffic, SRE
Cyberpower678 raised the priority of T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API from Low to Medium.
Jan 27 2021, 12:05 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

Joe, not all requests are 502s. They are insignificant compared to the amount of requests returning null responses. This is a very problematic occurrence as Cyberbot has begun to malfunction badly because of it. Is blanking pages repeatedly, my talk page is littered with malfunction reports. Granted some extra robustness could be implemented, this shouldn’t have to be something I would need to guard against at this level. Cyberbot has never had these problems in the past until I started getting reports around 11 days ago. I see my communication log is starting to grow to a large size recording these failures and has grown to 5 GB.

Jan 27 2021, 7:36 AM · Traffic, SRE
Cyberpower678 added a comment to T272842: Update template parameters @huwiki.

It won’t. It’s not designed to do that. It will only recognize the alias and use what’s there, or add the default preferred alias if not defined.

Jan 27 2021, 2:22 AM · InternetArchiveBot

Jan 26 2021

Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

No changes have been made to the bot whatsoever.

Jan 26 2021, 9:15 PM · Traffic, SRE
Cyberpower678 added a comment to T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.

The IP 172.16.2.21, I don't know what the UA is. The bot is pretty old.

Jan 26 2021, 6:52 PM · Traffic, SRE
Cyberpower678 created T273003: Cyberbot is getting a lot of 502 errors, or blank responses when querying the API.
Jan 26 2021, 6:37 PM · Traffic, SRE

Jan 25 2021

Cyberpower678 moved T179346: Spawn and restart the bot directly from the Web interface from New feature to Big projects on the InternetArchiveBot board.
Jan 25 2021, 6:43 PM · IABot-Team, InternetArchiveBot
Cyberpower678 closed T272842: Update template parameters @huwiki as Resolved.
Jan 25 2021, 6:28 PM · InternetArchiveBot
Cyberpower678 closed T272831: Bot keeps adding archive data to already archived link as Resolved.
Jan 25 2021, 6:08 PM · InternetArchiveBot

Jan 7 2021

Cyberpower678 created T271442: Resource request for cyberbot project.
Jan 7 2021, 5:22 PM · cloud-services-team (Kanban), Cloud-VPS (Quota-requests)

Dec 29 2020

Cyberpower678 changed the status of T270900: IABot needs a new large exec node from Stalled to Open.

Project Name: cyberbot
Type of quota increase requested: 8 CPUs and 16 GB RAM
Reason: IABot is expanding on to more WMF wikis, which requires more processing power. The current exec VM is reaching its limit.

Dec 29 2020, 4:28 PM · Cloud-VPS (Quota-requests)
Cyberpower678 created T270900: IABot needs a new large exec node.
Dec 29 2020, 3:16 AM · Cloud-VPS (Quota-requests)

Dec 11 2020

Cyberpower678 added a comment to T269914: IAbot sending a huge volume of action=raw requests (HTTP 415 errors).

Especially to Wikidata.

Dec 11 2020, 3:07 PM · Platform Team Workboards (Clinic Duty Team), SRE, InternetArchiveBot, Traffic
Cyberpower678 added a comment to T269914: IAbot sending a huge volume of action=raw requests (HTTP 415 errors).

Thursday, as in yesterday? I’m not aware of anything that should have been running to create that massive level of requests.

Dec 11 2020, 3:06 PM · Platform Team Workboards (Clinic Duty Team), SRE, InternetArchiveBot, Traffic

Dec 6 2020

Cyberpower678 assigned T190241: Deploy InternetArchiveBot on Wikimedia Commons (commonswiki) to Harej.
Dec 6 2020, 7:27 PM · User-Harej, InternetArchiveBot, Commons
Cyberpower678 added a comment to T269525: Bot uses "dead-url" instead of "deadlink" [ruwiki].

https://ru.wikipedia.org/wiki/Модуль:Citation/CS1/Configuration

Dec 6 2020, 7:14 PM · InternetArchiveBot
Cyberpower678 added a comment to T269525: Bot uses "dead-url" instead of "deadlink" [ruwiki].

I don’t have access to your Citation module on ruwiki. A local sysop will need to make the changes.

Dec 6 2020, 7:12 PM · InternetArchiveBot