Page Menu
Home
Phabricator
Search
Configure Global Search
Log In
Files
F34453275
model_upload.sh
No One
Actions
View File
Edit File
Delete File
View Transforms
Subscribe
Mute Notifications
Award Token
Flag For Later
Authored By
•
ACraze
May 13 2021, 10:23 PM
2021-05-13 22:23:42 (UTC+0)
Size
512 B
Referenced Files
None
Subscribers
None
model_upload.sh
View Options
#!/bin/bash
TIMESTAMP
=
`
date
"+%Y%m%d%H%M"
`
MODEL_BUCKET
=
'wmf-ml-models'
MODEL_TYPE
=
'goodfaith'
MODEL_LANG
=
"enwiki"
MODEL_PREFIX
=
"
${
MODEL_TYPE
}
/
${
MODEL_LANG
}
/
${
TIMESTAMP
}
"
MODEL_FILE
=
"enwiki.goodfaith.gradient_boosting.model"
S3_PATH
=
"s3://
${
MODEL_BUCKET
}
/
${
MODEL_PREFIX
}
"
echo
"CHECKING FOR MODEL_BUCKET"
# make sure model bucket exists
s3cmd mb s3://
${
MODEL_BUCKET
}
--skip-existing
echo
"UPLOADING
${
MODEL_FILE
}
to
${
S3_PATH
}
"
s3cmd put
"
${
MODEL_FILE
}
"
"
${
S3_PATH
}
/
${
MODEL_FILE
}
"
--multipart-chunk-size-mb
=
5
File Metadata
Details
Attached
Mime Type
text/plain; charset=utf-8
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
9072547
Default Alt Text
model_upload.sh (512 B)
Attached To
Mode
P15960 model_upload.sh
Attached
Detach File
Event Timeline
Log In to Comment