Phoenix for inspecting LLM traces and evaluations
Use OpenTelemetry-based traces to inspect model, retrieval and agent activity.
AI GitHub
Explore AI projects, understand what they do and find something you can build with.
Showing 97–102 of 224 projects · Page 17 of 38
Langfuse for tracing and evaluating LLM applications
Collect traces around model calls, prompts and application steps.
LightEval for configurable language-model benchmarks
Evaluate checkpoints and inference backends using standardized or custom tasks.
LM Evaluation Harness for benchmark runs
Run documented language-model benchmark tasks through a shared evaluation interface.
OpenAI Evals for reproducible model evaluations
Use a registry and evaluation runner to define test cases for model responses.
Ragas for evaluating retrieval-augmented generation
Measure retrieval and answer behavior with metrics designed for RAG workflows.
AI GitHub Repos FAQ
What does an AI GitHub project page explain?
Each page introduces the project, explains its capabilities and highlights practical takeaways. Follow the repository link for the latest documentation and setup instructions.
How do I add a GitHub repository?
Sign in, choose Add Repo and paste the main URL of a public AI repository, not a file or issue link. Franklin AI uses the project’s README to build and publish a page and links your contribution to your profile. Each account can add up to 20 repositories a day.
What if a repository cannot be published straight away?
Private repositories cannot be added. If the README is too short for an automatic page, or the project is already being reviewed, the repository is saved in your submissions with the reason for an admin to complete, and you are credited when it is published.
What happens if the project is already listed?
Its existing page stays as it is. Adding it again links that page to your profile instead of creating a second one.
How do I find projects for one kind of work?
Use the Category filter. Each card shows its categories, such as AI Agents or AI Development, and the repository’s owner and name.