LLMs and Agentic AI are evolving fast, and like many in tech, I’ve been diving into them. Here’s a collection of resources I’ve found useful—hope they help you too!
Community-driven Evaluation for the Best LLM and AI Chatbots
📌 Llama Arena – A platform that lets users compare and vote on AI chatbot performance.
SEAL LLM Leaderboards for Precise and Reliable LLM Rankings
📌 Scale SEAL Leaderboard – A benchmark for evaluating and ranking AI models across multiple dimensions.
Tokenizer
📌 Tiktokenizer – A handy tool for visualizing how text is tokenized before being processed by LLMs.
Local Chatbot with Different Models
📌 Nomic AI – A platform for running open-source LLMs locally on your machine.
Personalized AI Assistant from Google
📌 NotebookLM – A research tool from Google that helps summarize, analyze, and interact with your personal notes using AI.
Building AI Agents with a Powerful Toolset
📌 LlamaIndex – A framework for connecting LLMs with private or structured data to create intelligent agents.
Extracting Metadata and Text from Sources
📌 Apache Tika - A toolkit detects and extracts metadata and text from over a thousand different file types.
Embeddings, Rerankers and Readers
📌 Jina AI – Different tools/products for building LMs.
Working with Complex Workflow
📌 LangChain – Build context-aware and reasoning applications.
Build and Manage MLOps
📌 METAFLOW – A Python library that makes it straightforward to develop data-intensive applications.
LLM Testing and Evaluation
📌 LLM Studio - A platform for testing and evaluating LLMs.
🚀 To be continued…