Task-specific LLM evals that do and don't work (eugeneyan.com)

Screenshot of eugeneyan.com: Task-specific LLM evals that do and don't work

First screen, captured 1 year ago.

Looks similar

Screenshot of eugeneyan.com: Experimenting with LLMs to Research, Reflect, and Plan

Experimenting with LLMs to Research, Reflect, and Plan (eugeneyan.com)

131 points by gk1 3 years ago | 14 comments

Screenshot of eugeneyan.com: Don't mock machine learning models in unit tests

Don't mock machine learning models in unit tests (eugeneyan.com)

55 points by 7d7n 2 years ago | 50 comments

Screenshot of eugeneyan.com: Patterns for building LLM-based systems and products

Patterns for building LLM-based systems and products (eugeneyan.com)

372 points by 7d7n 3 years ago | 49 comments

Eugene Yan's long-form blog post describing seven practical patterns, such as evals, RAG, and fine-tuning, for integrating large language models into systems and products.

llm llm-evals retrieval-augmented-generation fine-tuning

Screenshot of marble.onl: Task-free intelligence testing of LLMs

Task-free intelligence testing of LLMs (marble.onl)

59 points by amarble 9 months ago | 17 comments

Screenshot of eugeneyan.com: Counterfactual evaluation for recommendation systems

Counterfactual evaluation for recommendation systems (eugeneyan.com)

69 points by kurinikku 9 months ago | 5 comments

Screenshot of eugeneyan.com: Improving recommendation systems and search in the age of LLMs

Improving recommendation systems and search in the age of LLMs (eugeneyan.com)

379 points by 7d7n 1 year ago | 88 comments

Eugene Yan's long-form survey of how industrial recommendation and search systems are using LLMs across model architecture, data generation, training paradigms, and unified frameworks.

recommendation-systems search llm information-retrieval

Looks similar

Experimenting with LLMs to Research, Reflect, and Plan(eugeneyan.com)

Don't mock machine learning models in unit tests(eugeneyan.com)

Patterns for building LLM-based systems and products(eugeneyan.com)

Task-free intelligence testing of LLMs(marble.onl)

Counterfactual evaluation for recommendation systems(eugeneyan.com)

Improving recommendation systems and search in the age of LLMs(eugeneyan.com)