model_upload.sh
No One
Actions

Authored By

	• ACraze
	May 13 2021, 10:17 PM

Size

508 B

Referenced Files

None

Subscribers

None

model_upload.sh
View Options

	#!/bin/bash


	TIMESTAMP=`date "+%Y%m%d%H%M"`
	MODEL_BUCKET='wmf-ml-models'
	MODEL_TYPE='goodfaith'
	MODEL_LANG="enwiki"
	MODEL_PREFIX="${MODEL_TYPE}/${MODEL_LANG}/${TIMESTAMP}"
	MODEL_FILE="enwiki.goodfaith.gradient_boosting.model"
	S3_PATH="s3://${MODEL_BUCKET}/${MODEL_PREFIX}"
	echo "CHECKING FOR MODEL_BUCKET"
	# make sure model bucket exists
	s3cmd mb s3://${MODEL_BUCKET} --skip-existing

	echo "UPLOADING ${MODEL_FILE} to ${S3_PATH}"
	s3cmd put "${MODEL_FILE}" "${S3_PATH}/model.bin" --multipart-chunk-size-mb=5