from modelscope.pipelines import pipeline
from modelscope.utils.constant import Tasks
pipeline_ins = pipeline(
'fill-mask',
model='dienstag/minirbt-h256',
model_revision='v1.0.0'
)
print(pipeline_ins('生活的真谛是[MASK]。'))
In order to further promote the research and development of Chinese information processing, we launched a Chinese small pre-training model MiniRBT based on the self-developed knowledge distillation tool TextBrewer, combined with Whole Word Masking technology and Knowledge Distillation technology.
This repository is developed based on:https://github.com/iflytek/MiniRBT
You may also interested in,
More resources by HFL: https://github.com/iflytek/HFL-Anthology