[QUESTION]when pretraining bert，meet bug：cuBLAS Error: the requested functionality is not supported

[shanyuaa]

Your question
Ask a clear and concise question about Megatron-LM.

my train_bert_340m_distributed.sh(specialize part) is as follows:
CHECKPOINT_PATH=/proj/bert/checkpoints/null/
TENSORBOARD_LOGS_PATH=/proj/bert/logs
VOCAB_FILE=/proj/bert/checkpoints/bert-large-uncased-vocab.txt
DATA_PATH=/proj/bert/dataset/ag_news_text_sentence

the error is:

[andrewvli]

also encountered this issue, were you able to resolve the cuBLAS error?

[shanyuaa]

你好，我已收到信件，在阅读后会尽快给回复。祝好。

[yaox12]

This NVIDIA/TransformerEngine#845 may help. Try to install TE after this commit.

[github-actions[bot]]

Marking as stale. No activity in 60 days.

[shanyuaa]

你好，我已收到信件，在阅读后会尽快给回复。祝好。