Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
b79d4022-3359-42ba-8d1d-c5e625667be7
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Mathias Barragan
mathias
3 months ago
text
train_data_subset
train_data_subset
completed 1000 rows279048 tokens$ 0.0056 5 iterations
d610b9fe-116e-40b8-9dfe-0894fd18624d
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Mathias Barragan
mathias
4 months ago
text
train_data_subset
train_data_subset
completed 1000 rows279048 tokens$ 0.0056 2 iterations
cc83c559-67bf-4208-925b-7201c64cd00a
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Mathias Barragan
mathias
4 months ago
text
completed 5 row sample983 tokens$ 0.0000 1 iteration
20650666-c8e5-4f73-a486-3f968d3192fa
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Mathias Barragan
mathias
4 months ago
text
error An exception occurred indexing, getting dataframe and running evaluation: %Req.TransportError{reason: :closed} 10 / 50000 rows1282 tokens$ 0.0000 2 iterations
fa591ba6-34b1-4d12-84d3-c986212704d4
GoogleGoogle/Text Embedding 004text → embeddings
Bessie
ox
5 months ago
title
error bad_request 290 / 50000 rows0 tokens$ 0.0000 2 iterations
8960e54d-a4cf-46cf-b8a8-e2a07c64cf40
OpenAIOpenAI/Text Embedding 3 - Smalltext → embeddings
Mathias Barragan
mathias
5 months ago
text
error An exception occurred indexing, getting dataframe and running evaluation: %Req.TransportError{reason: :econnrefused} 10 / 50000 rows1282 tokens$ 0.0000 3 iterations