I followed the approach described at the two
links above, but no luck. My
class weka.classifiers.evaluation.MyEvaluationMetric extends
AbstractEvaluationMetric and implements StandardEvaluationMetric. I
created the Description.props and build_package.xml as you describe in
package structure link (note that some weeks ago I successfully deployed
a custom classifier in Weka and everything went fine). However, when I
install the resulted zip file through Weka's tools->package manager menu,
I do not get a new folder inside the wekafiles/packages folder from my
home folder. For the classifier mentioned above, this happened
automatically. Moreover, when perform some evaluation, the classical
scores - RMSE etc - are reported, but mine - not.
What should I do?
1. is it ok to declare my evaluation package as part of
weka.classifiers.evaluation? should I put it into another package?
2. after a successfull deploy, should I see "MyEvaluationMetric"
somewhere under the classification node, in Weka Explorer? Or maybe in
More options->evaluation metrics... window?
I am using Win 7 x86 SP1, Java 1.7, ant 1.8.4 and Weka 3.7.9.
I discovered that:
1. For the question 1 above, the answer is "yes".
2. The file PluginManager.props file described at the end of
was not copied inside the zip file containing the package. Adding the
suitable line into the build_package.xml ant file solved the problem, and
my custom metric appears now in More options->evaluation metrics... window
and it is checked.
3. The method getStatistic which I define in my custom metric is never
called; I logged all the calls to any method from my class and this one is
never called. The metric object is notified for any Instance to be
evaluated, but at the end the call to getStatistic is never made, and thus
the result is not shown at the end testing phase.
How do I solve the issue from point 3?
After a clean install of Weka, it worked :)
View this message in context: