Issues

• Question related to the loss calculation

  Beomi/InfiniTransformer#28 · Filter by author zeyuliu1037 opened on Nov 19, 2024

• Support Zero-3?

  Beomi/InfiniTransformer#27 · Filter by author WF0511 opened on Jun 25, 2024
  1

• Issue while runing test_train.small.gemma.infini.py

  Beomi/InfiniTransformer#26 · Filter by author raghavgarg97 opened on Jun 15, 2024
  2

• Model loses information very quickly

  Beomi/InfiniTransformer#25 · Filter by author Lazy3valuation opened on May 28, 2024
  2

• BitLinear

  Beomi/InfiniTransformer#24 · Filter by author DewEfresh opened on May 24, 2024

• About memory missing location information

  Beomi/InfiniTransformer#23 · Filter by author LzhinFdu opened on May 10, 2024
  6

• What is the min GPU memory required to fine-tune the model?

  Beomi/InfiniTransformer#22 · Filter by author Ozawa333 opened on May 10, 2024

• Are there any trained InfinityTransformer weights available?

  Beomi/InfiniTransformer#17 · Filter by author PasiKoodaa opened on Apr 19, 2024
  1

• Limitations of the method

  Beomi/InfiniTransformer#13 · Filter by author fyang064 opened on Apr 17, 2024
  2

• Model generating random sequence

  Beomi/InfiniTransformer#11 · Filter by author Lazy3valuation opened on Apr 17, 2024
  8

• When will the code be made public, please?

  Beomi/InfiniTransformer#1 · Filter by author zzr-idam opened on Apr 13, 2024
  3