ExLlamaV3 for EXL3 quantization
Run and quantize compatible language models for GPU inference with the EXL3 format.
AI GitHub
Explore AI projects, understand what they do and find something you can build with.
Showing 193–198 of 224 projects · Page 33 of 38
LMDeploy for quantized model serving
Deploy supported language and vision-language checkpoints with optimized inference backends.
Modal Examples for remote GPU jobs
Study runnable patterns for GPU inference, training and jobs on Modal.
KServe for Kubernetes model deployments
Declare inference services on Kubernetes with model serving runtimes and lifecycle controls.
BentoML for packaging model APIs
Define Python inference services with explicit endpoints and runtime dependencies.
Ray for distributed training and serving
Scale Python ML work across workers while keeping resource needs explicit.
AI GitHub Repos FAQ
What does an AI GitHub project page explain?
Each page introduces the project, explains its capabilities and highlights practical takeaways. Follow the repository link for the latest documentation and setup instructions.
How do I add a GitHub repository?
Sign in, choose Add Repo and paste the main URL of a public AI repository, not a file or issue link. Franklin AI uses the project’s README to build and publish a page and links your contribution to your profile. Each account can add up to 20 repositories a day.
What if a repository cannot be published straight away?
Private repositories cannot be added. If the README is too short for an automatic page, or the project is already being reviewed, the repository is saved in your submissions with the reason for an admin to complete, and you are credited when it is published.
What happens if the project is already listed?
Its existing page stays as it is. Adding it again links that page to your profile instead of creating a second one.
How do I find projects for one kind of work?
Use the Category filter. Each card shows its categories, such as AI Agents or AI Development, and the repository’s owner and name.