How it is possible to set up evaluation metrics? #2336
Answered
by
NanoCode012
elements72
asked this question in
Q&A
-
|
Hi, I am using Axolotl to train my model but I wanted to evaluate my models on some metrics that do not seem to be included in the supported ones. Is it possible to define some custom callbacks for the evaluation? |
Beta Was this translation helpful? Give feedback.
Answered by
NanoCode012
Feb 17, 2025
Replies: 1 comment
-
|
Yes, you could add your custom callback within say, |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
elements72
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes, you could add your custom callback within say,
src/axolotl/utils/callbacks/__init__.py, and hack it intosrc/axolotl/core/trainer_builder.py'sget_callbackfn.