Page MenuHomePhabricator
Create Task
Maniphest T281368

UtteranceStore::flushUtterances() fails to delete files
Closed, InvalidPublic
Actions

Description

When I run the script I observed that it manages to table rows, but not files.

Start command line script maintenance/flushUtterances.php
[localisation] LocalisationCache using store LCStoreCDB
[session] SessionManager using store RedisBagOStuff
[DBQuery] Wikimedia\Rdbms\DatabaseMysqlBase::open [0s] 127.0.0.1: SET group_concat_max_len = 262144, sql_mode = ''
[DBReplication] Wikimedia\Rdbms\LBFactory::getChronologyProtector: request info {
    "IPAddress": "127.0.0.1",
    "UserAgent": false,
    "ChronologyProtection": false,
    "ChronologyPositionIndex": 0,
    "ChronologyClientId": false
}
[DBConnection] Wikimedia\Rdbms\LoadBalancer::lazyLoadReplicationPositions: executed chronology callback.
[DBConnection] Wikimedia\Rdbms\LoadBalancer::getLocalConnection: opened new connection for 0
[DBQuery] Wikimedia\Rdbms\DatabaseMysqlBase::serverIsReadOnly [0s] 127.0.0.1: SELECT @@GLOBAL.read_only AS Value
[DBQuery] Wikimedia\Rdbms\Database::select [0.008s] 127.0.0.1: SELECT  wsu_utterance_id  FROM `wikispeech_utterance`    WHERE wsu_lang = 'en'  
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.001s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '50'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 50 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::getFileBackend: No file backend defined in LocalSettings.php. Falling back on FS storage backend named wikispeech-backend in /srv/images/wikispeech_utterances.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 50.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 50.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.02s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '51'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 51 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 51.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 51.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.003s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '52'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 52 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 52.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 52.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.002s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '53'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 53 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 53.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 53.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.002s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '54'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 54 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 54.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 54.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.002s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '55'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 55 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 55.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 55.
[DBQuery] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances [0.004s] 127.0.0.1: DELETE FROM `wikispeech_utterance` WHERE wsu_utterance_id = '56'
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::flushUtterances: Flushed out utterance with id 56 from database
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete audio file for utterance with identity 56.
[Wikispeech] MediaWiki\Wikispeech\Utterance\UtteranceStore::deleteFileBackendFile: Unable to delete synthesis metadata file for utterance with identity 56.
[DBConnection] Wikimedia\Rdbms\LBFactory::destroy: closing connection to database '127.0.0.1'.

Event Timeline

Sebastian_Berlin-WMSE created this task.Apr 28 2021, 2:20 PM
Restricted Application added a project: Wikispeech-Jobrunner. · View Herald TranscriptApr 28 2021, 2:20 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
kalle added a comment.Apr 28 2021, 3:23 PM

Can you please paste in the logger output too?

UtteranceStore.php:443

			if ( !$successfullyDeletedTableRow ) {
				$this->logger->warning( __METHOD__ . ': ' .
					'Failed to delete utterance {utteranceId} from database.', [
						'utteranceId' => $utteranceId
				] );
			} else {
				$this->logger->debug( __METHOD__ . ': ' .
					'Flushed out utterance with id {utteranceId} from database', [
						'utteranceId' => $utteranceId
				] );
			}

Should be located in /vagrant/logs/mediawiki-wiki-debug.log

kalle claimed this task.Apr 28 2021, 3:23 PM
Sebastian_Berlin-WMSE updated the task description. (Show Details)Apr 29 2021, 5:57 AM
Sebastian_Berlin-WMSE added a comment.Apr 29 2021, 5:59 AM

Of course, I wasn't sure where the log ended up. I replaced the printouts with the log in the description.

Sebastian_Berlin-WMSE added a project: Wikispeech-WMSE.Apr 29 2021, 6:20 AM
Sebastian_Berlin-WMSE renamed this task from UtteranceStore::flushUtterances() fails to delete table rows to UtteranceStore::flushUtterances() fails to delete files.Apr 29 2021, 6:45 AM
Sebastian_Berlin-WMSE updated the task description. (Show Details)

I had it the wrong way around (thanks to bad print outs). Table rows are deleted, but not files.

kalle closed this task as Invalid.Jul 26 2021, 12:49 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL