Hey guys,
I want to store my OpenAI chat histories and its settings somewhere for further MANUAL filtering, sorting and in general, for further evaluation.
I mean I’d manually review my chats ( System and User Prompts) and their settings and rate the Assistant’s completions.
i think it is a very important task when you have to work with AI manually ( eg. learning or developing a Proof-of-Concept app ).
I mean something like Notion or Airtable or like that.
Now I store them in Notion pages, but it still requires too much manual activity…
What no-code / low-code SaaS tool(s) and what datatype would you use for this purpose?
Is there a GitHub like SaaS solution which stores eg. JSON in a version controlled way?
i think I could do it in eg. MongoDB, where there would be a Goal document ( eg.: "summarize this TechCrunch article: {{URL}} and there would be multiple related OpenAI Submission documents, in each with its settings ( Temp, Max Tokens, etc. and chat history ( System, User, Assistant, optionally repeated ) and every each Assistant Completion with ratings of different aspects ( like completeness, accuracy, etc.),
but it is too complex, there must be other best practices.
So any suggestion of best practices or new ideas of methods and tools is gladly welcomed! 