Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
151a40d1-5df5-4a47-b81c-938fd600a6e4
OpenAI/GPT 4o minitext → text
ox
5 months agoWhat is the sentiment
{text}main
74c32628-437f-422d-8fa5-70cea1ffa195
OpenAI/GPT 4otext → text
mathias
5 months agoCompute the sentiment of the text based on the how well the companies are performing in the market. Return only one of three options: positive, negative or neutral. Respond with one word all lowercase.
Text:
{text}main
main
1a60e9eb-2a97-4eb4-ac0c-95f78eda3af0
OpenAI/GPT 4otext → textmathias
5 months agoCompute the sentiment of the text based on the how well the companies are performing in the market. Return only one of three options: positive, negative or neutral. Respond with one word all lowercase.
Text:
{text}main
error An error occurred when committing workspace: %Ecto.StaleEntryError{message: "attempted to update a stale struct:\n\n%{id: \"8379b549-8fab-4b05-8ec8-11ec06736235\", user: #Ecto.Association.NotLoaded<association :user is not loaded>, __struct__: Oxen.Schemas.Workspaces.Workspace, user_id: \"69956aa2-30a5-4b1e-b9fa-2fa74481eca9\", __meta__: #Ecto.Schema.Metadata<:loaded, \"workspace\">, inserted_at: ~U[2024-10-25 22:25:39Z], updated_at: ~U[2024-10-25 22:25:39Z], commit: %Oxen.Schemas.Repositories.Commit{__meta__: #Ecto.Schema.Metadata<:loaded, \"commits\">, uuid: \"1ee21050-7994-4ca1-bdeb-1a56d0b557de\", id: \"91dce55b449d9efc\", repository_id: \"7c050719-88de-4535-8228-eb1f7257facf\", repository: #Ecto.Association.NotLoaded<association :repository is not loaded>, message: \"remove the prediction column\", author: \"ox\", email: \"ox@oxen.ai\", timestamp: ~U[2024-10-14 23:56:23Z], inserted_at: ~U[2024-10-14 23:56:24Z], updated_at: ~U[2024-10-14 23:56:24Z]}, repository: %Oxen.Schemas.Repositories.Repository{__meta__: #Ecto.Schema.Metadata<:loaded, \"repositories\">, id: \"ecb38c14-c616-4cf3-802a-840a1aff8f20\", name: \"financial_sentiment\", description: nil, namespace: \"mathias\", url: nil, backend_url: \"http://ip-10-0-0-4.us-west-1.compute.internal/api/repos/69956aa2-30a5-4b1e-b9fa-2fa74481eca9/ecb38c14-c616-4cf3-802a-840a1aff8f20\", is_public: false, default_branch: \"main\", size: 104372, star_count: 0, clone_started_count: 1, clone_completed_count: 1, push_started_count: 7, push_completed_count: 1, download_started_count: 0, download_completed_count: 0, last_merge_request_number: 0, searchable_content: [%Postgrex.Lexeme{word: \"financi\", positions: [{1, :A}, {4, :B}]}, %Postgrex.Lexeme{word: \"mathia\", positions: [{3, :B}]}, %Postgrex.Lexeme{word: \"sentiment\", positions: [{2, :A}, {5, :B}]}], created_by_id: \"69956aa2-30a5-4b1e-b9fa-2fa74481eca9\", created_by: #Ecto.Association.NotLoaded<association :created_by is not loaded>, organization_id: nil, organization: #Ecto.Association.NotLoaded<association :organization is not loaded>, user_id: \"69956aa2-30a5-4b1e-b9fa-2fa74481eca9\", user: #Ecto.Association.NotLoaded<association :user is not loaded>, owner_user_id: \"69956aa2-30a5-4b1e-b9fa-2fa74481eca9\", owner_user: #Ecto.Association.NotLoaded<association :owner_user is not loaded>, latest_commit_id: \"1ee21050-7994-4ca1-bdeb-1a56d0b557de\", latest_commit: #Ecto.Association.NotLoaded<association :latest_commit is not loaded>, data_import: #Ecto.Association.NotLoaded<association :data_import is not loaded>, collection_repositories: #Ecto.Association.NotLoaded<association :collection_repositories is not loaded>, commits: #Ecto.Association.NotLoaded<association :commits is not loaded>, compares: #Ecto.Association.NotLoaded<association :compares is not loaded>, repository_users: #Ecto.Association.NotLoaded<association :repository_users is not loaded>, type_counts: #Ecto.Association.NotLoaded<association :type_counts is not loaded>, categories: #Ecto.Association.NotLoaded<association :categories is not loaded>, tags: #Ecto.Association.NotLoaded<association :tags is not loaded>, users: #Ecto.Association.NotLoaded<association :users is not loaded>, inserted_at: ~U[2024-10-25 21:40:33Z], updated_at: ~U[2024-10-25 22:20:43Z]}, repository_id: \"ecb38c14-c616-4cf3-802a-840a1aff8f20\", commit_id: \"1ee21050-7994-4ca1-bdeb-1a56d0b557de\", closing_commit_id: nil, closing_commit: nil, target_branch: \"main\", branch_name: \"main\", closing_branch: nil, entity_type: :rmod, repository_data_import_id: nil, resource_path: \"train.parquet\", repository_data_import: #Ecto.Association.NotLoaded<association :repository_data_import is not loaded>, commits_behind_entries: []}\n", changeset: #Ecto.Changeset<action: :update, changes: %{closing_commit_id: "2c6a8bb8-e349-412b-90ec-b7879fa7417a", closing_branch: "main"}, errors: [], data: #Oxen.Schemas.Workspaces.Workspace<>, valid?: true>} 2000 rows154533 tokens$ 0.4013 1 iteration