HomePhabricator

Transactions T97828 Change Details

Change Details

Old
New
Diff

Webrequest refinement is currently done using Hive. Refactoring it using Spark should bring performance improvement and allow wrapping multiple jobs together to take advantage of memory caching of data.

Webrequest refinement is currently done using Hive. Refactoring it using Spark should bring performance improvement and allow wrapping multiple jobs together to take advantage of memory caching of data.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL