Per @ori, let's evaluate using libeatmydata. Verify that it leaves things working properly and that it improves performance.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Krinkle | T96229 Creating MySQL tables for MediaWiki sometimes stalled on I/O for several minutes | |||
| Resolved | Krinkle | T95971 Apache on Jenkins slave takes over 30s to respond (QUnit/AJAX "Test timed out") | |||
| Resolved | Krinkle | T96249 MySQL tuning on CI slaves (tracking) | |||
| Resolved | Krinkle | T96308 Evaluate using libeatmydata for mysqld |
Event Timeline
Comment Actions
These two instances currently have libeatmydata installed and configured for mysql:
- integration-slave-trusty-1015
- integration-slave-precise-1013
Observing their behaviour on Jenkins over the next 1-2 days.
Comment Actions
Results from https://integration.wikimedia.org/ci/job/mediawiki-phpunit-hhvm/buildTimeTrend
integration-slave-trusty-1011 Success #6489 3 min 27 sec integration-slave-trusty-1011 Success #6491 3 min 0 sec integration-slave-trusty-1011 Success #6492 3 min 16 sec integration-slave-trusty-1011 Success #6495 3 min 10 sec integration-slave-trusty-1011 Success #6498 3 min 43 sec integration-slave-trusty-1011 Success #6499 3 min 16 sec integration-slave-trusty-1011 Success #6530 5 min 53 sec integration-slave-trusty-1011 Success #6540 4 min 56 sec integration-slave-trusty-1011 Success #6552 3 min 32 sec integration-slave-trusty-1011 Success #6557 3 min 34 sec integration-slave-trusty-1011 Success #6572 3 min 52 sec integration-slave-trusty-1011 Success #6575 4 min 11 sec integration-slave-trusty-1011 Success #6578 3 min 24 sec integration-slave-trusty-1011 Success #6583 4 min 45 sec integration-slave-trusty-1011 Success #6590 3 min 45 sec integration-slave-trusty-1011 Success #6601 3 min 35 sec integration-slave-trusty-1011 Success #6603 3 min 16 sec integration-slave-trusty-1011 Success #6604 4 min 1 sec integration-slave-trusty-1011 Success #6607 3 min 40 sec integration-slave-trusty-1011 Success #6641 3 min 42 sec integration-slave-trusty-1011 Success #6647 3 min 31 sec integration-slave-trusty-1011 Success #6658 4 min 50 sec integration-slave-trusty-1011 Success #6666 4 min 15 sec integration-slave-trusty-1011 Success #6675 4 min 46 sec integration-slave-trusty-1011 Success #6686 5 min 23 sec integration-slave-trusty-1011 Success #6694 4 min 35 sec integration-slave-trusty-1011 Success #6699 4 min 21 sec integration-slave-trusty-1011 Success #6700 5 min 7 sec integration-slave-trusty-1011 Success #6726 4 min 28 sec integration-slave-trusty-1011 Success #6733 3 min 40 sec integration-slave-trusty-1011 Success #6751 3 min 50 sec integration-slave-trusty-1012 Success #6493 2 min 55 sec integration-slave-trusty-1012 Success #6497 3 min 31 sec integration-slave-trusty-1012 Success #6506 3 min 31 sec integration-slave-trusty-1012 Success #6545 3 min 27 sec integration-slave-trusty-1012 Success #6561 3 min 17 sec integration-slave-trusty-1012 Success #6628 3 min 9 sec integration-slave-trusty-1012 Success #6633 3 min 7 sec integration-slave-trusty-1012 Success #6642 3 min 7 sec integration-slave-trusty-1012 Success #6649 3 min 27 sec integration-slave-trusty-1012 Success #6651 3 min 30 sec integration-slave-trusty-1012 Success #6654 3 min 17 sec integration-slave-trusty-1012 Success #6668 3 min 46 sec integration-slave-trusty-1012 Success #6673 3 min 35 sec integration-slave-trusty-1012 Success #6683 3 min 16 sec integration-slave-trusty-1012 Success #6697 3 min 39 sec integration-slave-trusty-1012 Success #6707 3 min 16 sec integration-slave-trusty-1012 Success #6708 3 min 8 sec integration-slave-trusty-1012 Success #6709 3 min 5 sec integration-slave-trusty-1012 Success #6712 3 min 38 sec integration-slave-trusty-1012 Success #6713 5 min 54 sec integration-slave-trusty-1012 Success #6717 3 min 4 sec integration-slave-trusty-1012 Success #6725 3 min 14 sec integration-slave-trusty-1012 Success #6738 3 min 6 sec integration-slave-trusty-1013 Success #6490 3 min 16 sec integration-slave-trusty-1013 Success #6494 3 min 7 sec integration-slave-trusty-1013 Success #6502 3 min 25 sec integration-slave-trusty-1013 Success #6505 3 min 8 sec integration-slave-trusty-1013 Success #6509 3 min 9 sec integration-slave-trusty-1013 Success #6510 3 min 16 sec integration-slave-trusty-1013 Success #6512 3 min 15 sec integration-slave-trusty-1013 Success #6514 3 min 10 sec integration-slave-trusty-1013 Success #6515 3 min 23 sec integration-slave-trusty-1013 Success #6521 3 min 31 sec integration-slave-trusty-1013 Success #6527 3 min 36 sec integration-slave-trusty-1013 Success #6538 3 min 13 sec integration-slave-trusty-1013 Success #6542 3 min 31 sec integration-slave-trusty-1013 Success #6543 3 min 32 sec integration-slave-trusty-1013 Success #6549 3 min 12 sec integration-slave-trusty-1013 Success #6553 3 min 11 sec integration-slave-trusty-1013 Success #6554 3 min 9 sec integration-slave-trusty-1013 Success #6560 3 min 12 sec integration-slave-trusty-1013 Success #6565 3 min 20 sec integration-slave-trusty-1013 Success #6567 3 min 11 sec integration-slave-trusty-1013 Success #6571 3 min 19 sec integration-slave-trusty-1013 Success #6576 3 min 22 sec integration-slave-trusty-1013 Success #6577 3 min 20 sec integration-slave-trusty-1013 Success #6579 3 min 33 sec integration-slave-trusty-1013 Success #6581 3 min 16 sec integration-slave-trusty-1013 Success #6591 3 min 23 sec integration-slave-trusty-1013 Success #6592 3 min 34 sec integration-slave-trusty-1013 Success #6594 3 min 23 sec integration-slave-trusty-1013 Success #6597 3 min 20 sec integration-slave-trusty-1013 Success #6610 3 min 3 sec integration-slave-trusty-1013 Success #6622 2 min 57 sec integration-slave-trusty-1013 Success #6643 3 min 5 sec integration-slave-trusty-1013 Success #6659 3 min 14 sec integration-slave-trusty-1013 Success #6662 3 min 8 sec integration-slave-trusty-1013 Success #6682 3 min 6 sec integration-slave-trusty-1013 Success #6690 3 min 14 sec integration-slave-trusty-1013 Success #6696 3 min 2 sec integration-slave-trusty-1013 Success #6706 3 min 11 sec integration-slave-trusty-1013 Success #6710 3 min 10 sec integration-slave-trusty-1013 Success #6729 3 min 7 sec integration-slave-trusty-1013 Success #6735 3 min 6 sec integration-slave-trusty-1013 Success #6747 3 min 0 sec integration-slave-trusty-1014 Success #6511 4 min 30 sec integration-slave-trusty-1014 Success #6518 4 min 24 sec integration-slave-trusty-1014 Success #6524 5 min 13 sec integration-slave-trusty-1014 Success #6526 5 min 5 sec integration-slave-trusty-1014 Success #6529 4 min 53 sec integration-slave-trusty-1014 Success #6548 4 min 7 sec integration-slave-trusty-1014 Success #6556 4 min 21 sec integration-slave-trusty-1014 Success #6566 5 min 1 sec integration-slave-trusty-1014 Success #6570 4 min 2 sec integration-slave-trusty-1014 Success #6593 5 min 32 sec integration-slave-trusty-1014 Success #6600 5 min 4 sec integration-slave-trusty-1014 Success #6609 3 min 41 sec integration-slave-trusty-1014 Success #6623 3 min 16 sec integration-slave-trusty-1014 Success #6625 3 min 21 sec integration-slave-trusty-1014 Success #6627 3 min 12 sec integration-slave-trusty-1014 Success #6632 3 min 26 sec integration-slave-trusty-1014 Success #6637 3 min 36 sec integration-slave-trusty-1014 Success #6638 3 min 23 sec integration-slave-trusty-1014 Success #6667 3 min 34 sec integration-slave-trusty-1014 Success #6684 5 min 7 sec integration-slave-trusty-1014 Success #6688 4 min 1 sec integration-slave-trusty-1014 Success #6692 3 min 43 sec integration-slave-trusty-1014 Success #6701 3 min 52 sec integration-slave-trusty-1014 Success #6703 3 min 43 sec integration-slave-trusty-1014 Success #6714 4 min 14 sec integration-slave-trusty-1014 Success #6718 3 min 45 sec integration-slave-trusty-1014 Success #6722 4 min 18 sec integration-slave-trusty-1014 Success #6724 4 min 7 sec integration-slave-trusty-1014 Success #6727 3 min 45 sec integration-slave-trusty-1014 Success #6730 4 min 23 sec integration-slave-trusty-1014 Success #6731 4 min 50 sec integration-slave-trusty-1014 Success #6737 3 min 34 sec integration-slave-trusty-1014 Success #6746 3 min 32 sec integration-slave-trusty-1014 Success #6748 3 min 46 sec integration-slave-trusty-1014 Success #6750 3 min 58 sec integration-slave-trusty-1016 Success #6496 3 min 29 sec integration-slave-trusty-1016 Success #6507 3 min 53 sec integration-slave-trusty-1016 Success #6508 4 min 12 sec integration-slave-trusty-1016 Success #6523 6 min 22 sec integration-slave-trusty-1016 Success #6525 5 min 43 sec integration-slave-trusty-1016 Success #6535 3 min 38 sec integration-slave-trusty-1016 Success #6544 4 min 21 sec integration-slave-trusty-1016 Success #6559 3 min 19 sec integration-slave-trusty-1016 Success #6580 3 min 30 sec integration-slave-trusty-1016 Success #6587 3 min 33 sec integration-slave-trusty-1016 Success #6588 3 min 33 sec integration-slave-trusty-1016 Success #6589 3 min 14 sec integration-slave-trusty-1016 Success #6598 3 min 32 sec integration-slave-trusty-1016 Success #6605 3 min 22 sec integration-slave-trusty-1016 Success #6618 3 min 17 sec integration-slave-trusty-1016 Success #6624 3 min 18 sec integration-slave-trusty-1016 Success #6639 3 min 35 sec integration-slave-trusty-1016 Success #6650 4 min 6 sec integration-slave-trusty-1016 Success #6652 3 min 16 sec integration-slave-trusty-1016 Success #6656 3 min 16 sec integration-slave-trusty-1016 Success #6660 3 min 32 sec integration-slave-trusty-1016 Success #6661 3 min 49 sec integration-slave-trusty-1016 Success #6663 3 min 25 sec integration-slave-trusty-1016 Success #6676 4 min 12 sec integration-slave-trusty-1016 Success #6685 4 min 3 sec integration-slave-trusty-1016 Success #6689 3 min 24 sec integration-slave-trusty-1016 Success #6693 3 min 21 sec integration-slave-trusty-1016 Success #6698 3 min 25 sec integration-slave-trusty-1016 Success #6702 3 min 40 sec integration-slave-trusty-1016 Success #6704 3 min 21 sec integration-slave-trusty-1016 Success #6711 3 min 23 sec integration-slave-trusty-1016 Success #6720 3 min 21 sec integration-slave-trusty-1016 Success #6721 3 min 50 sec integration-slave-trusty-1016 Success #6723 3 min 19 sec integration-slave-trusty-1016 Success #6734 3 min 29 sec integration-slave-trusty-1016 Success #6736 3 min 41 sec integration-slave-trusty-1016 Success #6741 3 min 28 sec integration-slave-trusty-1016 Success #6745 3 min 32 sec integration-slave-trusty-1016 Success #6749 4 min 14 sec integration-slave-trusty-1017 Success #6640 3 min 24 sec integration-slave-trusty-1017 Success #6655 3 min 45 sec integration-slave-trusty-1017 Success #6679 3 min 42 sec integration-slave-trusty-1017 Success #6728 3 min 49 sec integration-slave-trusty-1017 Success #6740 3 min 18 sec integration-slave-trusty-1017 Success #6743 3 min 26 sec
integration-slave-trusty-1015 Success #6519 4 min 21 sec integration-slave-trusty-1015 Success #6522 4 min 0 sec integration-slave-trusty-1015 Success #6528 3 min 44 sec integration-slave-trusty-1015 Success #6539 3 min 27 sec integration-slave-trusty-1015 Success #6547 3 min 34 sec integration-slave-trusty-1015 Success #6550 4 min 34 sec integration-slave-trusty-1015 Success #6551 6 min 9 sec integration-slave-trusty-1015 Success #6555 4 min 10 sec integration-slave-trusty-1015 Success #6563 3 min 57 sec integration-slave-trusty-1015 Success #6564 5 min 23 sec integration-slave-trusty-1015 Success #6569 3 min 14 sec integration-slave-trusty-1015 Success #6573 3 min 53 sec integration-slave-trusty-1015 Success #6574 4 min 18 sec integration-slave-trusty-1015 Success #6582 4 min 12 sec integration-slave-trusty-1015 Success #6584 3 min 38 sec integration-slave-trusty-1015 Success #6585 3 min 17 sec integration-slave-trusty-1015 Success #6586 3 min 17 sec integration-slave-trusty-1015 Success #6595 3 min 57 sec integration-slave-trusty-1015 Success #6596 4 min 33 sec integration-slave-trusty-1015 Success #6599 4 min 8 sec integration-slave-trusty-1015 Success #6602 3 min 59 sec integration-slave-trusty-1015 Success #6606 3 min 36 sec integration-slave-trusty-1015 Success #6608 3 min 16 sec integration-slave-trusty-1015 Success #6611 3 min 7 sec integration-slave-trusty-1015 Success #6615 3 min 13 sec integration-slave-trusty-1015 Success #6619 3 min 10 sec integration-slave-trusty-1015 Success #6626 3 min 6 sec integration-slave-trusty-1015 Success #6629 3 min 9 sec integration-slave-trusty-1015 Success #6630 3 min 11 sec integration-slave-trusty-1015 Success #6636 3 min 8 sec integration-slave-trusty-1015 Success #6644 3 min 5 sec integration-slave-trusty-1015 Success #6645 3 min 27 sec integration-slave-trusty-1015 Success #6646 3 min 41 sec integration-slave-trusty-1015 Success #6648 3 min 4 sec integration-slave-trusty-1015 Success #6653 3 min 7 sec integration-slave-trusty-1015 Success #6657 4 min 32 sec integration-slave-trusty-1015 Success #6664 3 min 16 sec integration-slave-trusty-1015 Success #6665 3 min 10 sec integration-slave-trusty-1015 Success #6669 3 min 21 sec integration-slave-trusty-1015 Success #6680 3 min 30 sec integration-slave-trusty-1015 Success #6695 3 min 9 sec integration-slave-trusty-1015 Success #6705 3 min 19 sec integration-slave-trusty-1015 Success #6719 3 min 10 sec integration-slave-trusty-1015 Success #6739 3 min 23 sec integration-slave-trusty-1015 Success #6742 5 min 27 sec
I don't see a notable gain or loss on the instance with libeatmydata. So for the moment I'm recommending we don't increase roll out and maintain status quo for sake of simplicity.