The open-source visual AI programming environment and TypeScript library

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

An extremely fast Python package and project manager, written in Rust.

A playbook for effectively prompting post-trained LLMs

A Lightweight Recommendation System

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

Software Architecture for ML engineers

This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

Fit interpretable models. Explain blackbox machine learning.

Get your documents ready for gen AI

📚 Process PDFs, Word documents and more with spaCy

Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024

Whisper realtime streaming for long speech-to-text transcription and translation

Summaries and resources for Designing Machine Learning Systems book (Chip Huyen, O'Reilly 2022)

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

xkcd styled chart lib

AKGR: Awesome Knowledge Graph Reasoning is a collection of knowledge graph reasoning works, including papers, codes and datasets

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Open-source platform for extracting structured data from documents using AI.

Framework for building and maintaining self-updating prompts for LLMs

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

An AI web browsing framework focused on simplicity and extensibility.

Machine Learning Journal for Intermediate to Advanced Topics.

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

Universal LLM Deployment Engine with ML Compilation

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

A Bulletproof Way to Generate Structured JSON from Language Models

HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieval Results in RAG Systems (WWW 2025)