hugging_face_transformers
Model
transformers.AutoConfig
-
doc -
impl
-
Training
transformers.TrainingArguments
-
doc
-
-
-
-
Early Stopping
Custom Loss Function to add class weights for unbalanced datasets: Subclass
Trainer
and override the
compute_loss
method (see example
here).
-
Tokenizer
tokenizers.BertWordPieceTokenizer
- for vocab generation -
impl
tokenizers.normalizers.BertNormalizer
-
impl
transformers.tokenization_bert.BertTokenizer
- tokenizer for normal usage -
impl
transformers.tokenization_bert.BertTokenizerFast
- fast tokenizer for normal usage -
impl
tokenizers.AutoTokenizer
-
doc -
impl
PreTrainedTokenizerBase.__call__
-
doc
Pipelines
Data Handling
Important Torch Classes
Links & Know-how
hugging_face_transformers.txt · Last modified: 2020/10/12 10:27 by pmay