[GH-ISSUE #113] [Feature Request] Create Testing dataset and evaluation workflows for AI Tasks #94

Closed
opened 2026-03-02 11:46:32 +03:00 by kerem · 1 comment
Owner

Originally created by @medo on GitHub (Apr 20, 2024).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/113

The project has a big potential for various AI workflows that can use the saved data to do different useful tasks for users.

To ease the development of different AI workflows and enable collaboration, I suggest creation of different golden test datasets that simulates the behaviour of different users. This will enable eveyone to run experiments on those golden datasets and share results (on jupyter notebooks?)

I think this could be a starting point for developers to showcase different ideas on typical Hoarder data.

Originally created by @medo on GitHub (Apr 20, 2024). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/113 The project has a big potential for various AI workflows that can use the saved data to do different useful tasks for users. To ease the development of different AI workflows and enable collaboration, I suggest creation of different golden test datasets that simulates the behaviour of different users. This will enable eveyone to run experiments on those golden datasets and share results (on jupyter notebooks?) I think this could be a starting point for developers to showcase different ideas on typical Hoarder data.
kerem closed this issue 2026-03-02 11:46:32 +03:00
Author
Owner

@kamtschatka commented on GitHub (May 19, 2024):

Can you elaborate a bit more? I honestly have no idea what you are asking.

<!-- gh-comment-id:2119147718 --> @kamtschatka commented on GitHub (May 19, 2024): Can you elaborate a bit more? I honestly have no idea what you are asking.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#94
No description provided.