User Details
- User Since
- Sep 2 2022, 7:28 AM (88 w, 4 d)
- Availability
- Available
- IRC Nick
- pfischer
- LDAP User
- Peter Fischer
- MediaWiki User
- PFischer-WMF [ Global Accounts ]
Today
Yesterday
Mon, May 6
Thu, May 2
Tue, Apr 30
Fri, Apr 26
@EBernhardson, according to @JMeybohm there is no way to limit the IP ranges of pod/service/namespace to associated them closely with an application (SUP).
Thu, Apr 25
Thu, Apr 18
I brought up this discussion with @JMeybohm and as it turns out, rate-limiting is a long-wanted feature for the MW API anyways, see T248543. Service/Ops is willing to discuss implementing it the envoy-way: Envoy supports local and remote/distributed rate limits, as described here. The least invasive approach to test this would be the following:
Tue, Apr 16
What is required for the test environment? Currently I would follow those steps:
Apr 11 2024
Apr 8 2024
Apr 4 2024
Apr 2 2024
Here's a list of metrics and alerts based on them:
- alert if the combined kafka message-in-rate (see grafana panel) is 0 for more than 5 minutes, for the following topics
- eqiad.cirrussearch.update_pipeline.update.rc0
- codfw.cirrussearch.update_pipeline.update.rc0
- alert if the combined kafka message-in-rate (see grafana panel) is 0.1 for more than 5 minutes, for the following topics
- eqiad.cirrussearch.update_pipeline.fetch_error.rc0
- codfw.cirrussearch.update_pipeline.fetch_error.rc0
Mar 15 2024
@Jdforrester-WMF, I looked at the code. The CirrusSearch SearchEngine does not handle Special:… searches itself, instead it delegates to the (core) implementation which in turn delegates to the default TitlePrefixSearch where searches inside NS_SPECIAL are processed in PrefixSearch::specialSearch( $search, $limit, $offset ). This performs an in-memory search against pages listed in SpecialPageFactory::CORE_LIST.
Mar 13 2024
Mar 5 2024
Feb 29 2024
Feb 20 2024
Jan 18 2024
Jan 17 2024
As of today, all non-private wikis featuring the cirrussearch extension publish page_rerender events by default.
Jan 15 2024
Jan 10 2024
For reference, here's a screenshot of more kafka metrics around enabling compaction:
Jan 9 2024
Partitions + keyed records are already enabled on kafka-test, see T354064.
Jan 8 2024
consumer-devnull (no resource request/limit overrides) correctly gets ioThreadCount=1, see logs:
Yes, you are right, Janis just told me. Alternatively, we can send a header x-envoy-max-retries: 0, see docs.
@JMeybohm, thanks! That brought down the throttling.
Jan 4 2024
Jan 3 2024
Jan 2 2024
@Ottomata, we considered this but but decided against it since
@Ottomata, yes, this was intended to a) save disk space and b) reduce the number of records that have to be processed in case of a back fill. Events representing "page X has been re-rendered" seemed a perfect use case where only the latest event is meaningful and worth to be kept.