Page MenuHomePhabricator
Feed Advanced Search

Tue, Jun 18

Audiodude closed T226038: "Lost connection to MySQL server during query" using pymysql on toolforge connecting to db replica as Resolved.

That seems to have resolved the issue!

Tue, Jun 18, 11:30 PM · Toolforge, Data-Services
Audiodude added a comment to T226038: "Lost connection to MySQL server during query" using pymysql on toolforge connecting to db replica.

I'm going to try replacing DictCursor with SSDictCursor and see if that helps.

Tue, Jun 18, 5:28 PM · Toolforge, Data-Services
Audiodude created T226038: "Lost connection to MySQL server during query" using pymysql on toolforge connecting to db replica.
Tue, Jun 18, 5:24 PM · Toolforge, Data-Services

May 12 2019

Audiodude closed T223028: enwp10 is returning 503 error as Resolved.

Hi @Kelson , I think you gave extra parameters to your restart command. I tried:

May 12 2019, 11:22 AM · Tools

Mar 28 2019

Audiodude closed T219483: "enwp10" not available anymore and shut down (due to Trusty migration) as Resolved.

Okay, I had previously added a setenv command for adding the PERL5LIB to the environment, but I didn't add it for list2.fcgi and log.fcgi, which now have their own sections in their configs for the environment variable. Things seem to be working now

Mar 28 2019, 7:10 PM · Tools
Audiodude added a comment to T219483: "enwp10" not available anymore and shut down (due to Trusty migration).

This isn't entirely accurate. The tool was in fact migrated to stretch last week. However, certain pages may still be erroring out, and that needs to be addressed. I will look at it later today when I have my laptop.

Mar 28 2019, 4:16 PM · Tools

Jan 7 2019

Audiodude added a comment to T213039: Using a "_test" database that gets created and torn down for every test.

And yes, the ORM I was speaking of was SQLAlchemy. It was much too slow with the session management strategy I was using, and manually managing multiple sessions and object eviction in order to speed it up would make the code too complicated in my opinion and negate the benefits of using the ORM.

Jan 7 2019, 3:37 PM · cloud-services-team
Audiodude closed T213039: Using a "_test" database that gets created and torn down for every test as Resolved.

Thanks for the comments. I realized that the test db never needs to be live in production and that helped me figure out the solution.

Jan 7 2019, 3:35 PM · cloud-services-team
Audiodude added a comment to T213039: Using a "_test" database that gets created and torn down for every test.

That looks promising for the Travis CI environment yes. I guess my problem is that I'm not developing locally, I'm developing directly on the Toolforge instance and I guess I just need to provision a database for test there?

Jan 7 2019, 2:28 AM · cloud-services-team

Jan 6 2019

Audiodude created T213039: Using a "_test" database that gets created and torn down for every test.
Jan 6 2019, 11:18 PM · cloud-services-team

Dec 17 2018

Audiodude added a comment to T207877: tool enwp10 is not working.

The web tool (https://tools.wmflabs.org/enwp10) looks up to me. What specifically is not working?

Dec 17 2018, 5:45 AM · Tools

Dec 3 2018

Audiodude closed T207877: tool enwp10 is not working as Resolved.

Restarted it again. Let me know if it works.

Dec 3 2018, 7:56 PM · Tools

Oct 24 2018

Audiodude closed T207877: tool enwp10 is not working as Resolved.

I just restarted it. The tool seems to die every 30 days or so, this last happened on Sept 28.

Oct 24 2018, 7:25 PM · Tools

Mar 10 2018

Audiodude added a comment to T161773: Make a plain text dump of Wikipedia available alongside the XML.

Actually, I believe plaintext would be more useful, but HTML would be a good starting point since it's reasonable to strip out.

Mar 10 2018, 8:44 AM · Dumps-Generation

Mar 31 2017

Audiodude added a comment to T161773: Make a plain text dump of Wikipedia available alongside the XML.

In fact the XML is not the problem, it's the wiki markup. From what I understand, the wiki markup is not defined by any formal grammar, so parsing it is non-trivial. Tools like mwparserfromhell help, but can be difficult to configure and not always accurate. There's also of course the problem of recursive template expansion.

Mar 31 2017, 10:54 PM · Dumps-Generation

Mar 30 2017

Audiodude updated subscribers of T161773: Make a plain text dump of Wikipedia available alongside the XML.
Mar 30 2017, 2:23 AM · Dumps-Generation
Audiodude created T161773: Make a plain text dump of Wikipedia available alongside the XML.
Mar 30 2017, 2:22 AM · Dumps-Generation