Skip to content

A Streamlit app for eollecting, analyzing and gaining insights on Open Interpreter prompt efficacy

License

Notifications You must be signed in to change notification settings

nate-dryer/oi-prompt-insights

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Open Interpreter Prompt Insights (WIP)

A Streamlit app for collecting, analyzing, and gaining insights on Open Interpreter prompts and their overall efficacy at executing local code.

GitHub license GitHub stars GitHub issues

Note: This project is a Work-In-Progress (WIP). Features and functionalities are continuously being developed and improved.

Table of Contents

Quick Start

git clone https://github.com/actual-username-or-org/oi-prompt-insights.git
pip install -r requirements.txt
streamlit run oi_prompt_insights.py

About

This tool helps users track, analyze, and improve prompts for Open Interpreter. It offers an intuitive interface for recording prompt performance and visualizing analytics.

Why This Tool?

Minor variations in prompt wording can significantly impact token usage and code execution. For instance, two similar prompts led to vastly different outcomes:

  • Prompt A: Simple execution, efficient token use
  • Prompt B: Complex local code execution, 100x more tokens used

This tool aims to:

  • Track prompt variations and outcomes
  • Analyze prompt efficiency
  • Identify effective patterns
  • Develop best practices
  • Enhance Open Interpreter user experience

Features

  • Record and categorize prompts
  • Visualize prompt effectiveness
  • Track satisfaction rates and execution times
  • Compare token usage across prompts
  • Interactive analytics dashboard
  • Data persistence across sessions
  • Efficiency Prompt Index in Leaderboard: Rank prompts based on their efficiency

Usage

After launching the app:

  • Use the sidebar to navigate
  • Record new prompts
  • View analytics
  • Explore insights
  • Compare prompt variations

Contributing

We welcome contributions from the community! Please see the CONTRIBUTING.md file for guidelines on how to contribute to this project.

About

A Streamlit app for eollecting, analyzing and gaining insights on Open Interpreter prompt efficacy

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages