benchmarkstt.metrics package

%%{init: {'theme': 'base', 'themeVariables': { 'primaryColor': '#e7f2fa', 'lineColor': '#2980B9' }}}%% classDiagram Schema Metric Item Mapping <|-- Item Schema <.. Metric Item <.. Schema Schema <.. Metric class Item { <<len>> <<mapping>> <<contains>> <<iterable>> <<comparable>> *args **kwargs +get(key, default=None) +items() +json(**kwargs) +keys() +values() } class Schema { <<len>> <<mapping>> <<iterable>> <<comparable>> +append(obj: Item) +extend(iterable) +json(**kwargs) data=None dump(*args, **kwargs)$ dumps(*args, **kwargs)$ load(*args, **kwargs)$ loads(*args, **kwargs)$ } class Metric { <<abstract>> +compare(ref: Schema, hyp: Schema) }

Responsible for calculating metrics.

class benchmarkstt.metrics.Metric

Bases: abc.ABC

Base class for metrics

abstract compare(ref: benchmarkstt.schema.Schema, hyp: benchmarkstt.schema.Schema)

Submodules

• benchmarkstt.metrics.core module