Useful Resources for LLMs

Image Alt Text

LLMs and Agentic AI are evolving fast, and like many in tech, I’ve been diving into them. Here’s a collection of resources I’ve found useful—hope they help you too!

Community-driven Evaluation for the Best LLM and AI Chatbots

📌 Llama Arena – A platform that lets users compare and vote on AI chatbot performance.

SEAL LLM Leaderboards for Precise and Reliable LLM Rankings

📌 Scale SEAL Leaderboard – A benchmark for evaluating and ranking AI models across multiple dimensions.

Tokenizer

📌 Tiktokenizer – A handy tool for visualizing how text is tokenized before being processed by LLMs.

Local Chatbot with Different Models

📌 Nomic AI – A platform for running open-source LLMs locally on your machine.

Personalized AI Assistant from Google

📌 NotebookLM – A research tool from Google that helps summarize, analyze, and interact with your personal notes using AI.

Building AI Agents with a Powerful Toolset

📌 LlamaIndex – A framework for connecting LLMs with private or structured data to create intelligent agents.

Extracting Metadata and Text from Sources

📌 Apache Tika - A toolkit detects and extracts metadata and text from over a thousand different file types.

Embeddings, Rerankers and Readers

📌 Jina AI – Different tools/products for building LMs.

Working with Complex Workflow

📌 LangChain – Build context-aware and reasoning applications.

Build and Manage MLOps

📌 METAFLOW – A Python library that makes it straightforward to develop data-intensive applications.

LLM Testing and Evaluation

📌 LLM Studio - A platform for testing and evaluating LLMs.

🚀 To be continued…

updatedupdated2025-03-212025-03-21