Projects
- 50project records
- 6categories
- 20reference implementations executed
Project records
- Flagship: passenger-rights document Q&A with a retrieval baseline, one controlled improvement and an honest generation mode
An airline customer-care team wants an internal assistant that answers agents' questions about passenger-rights rules (EU Regulation 261/2004, the Commission's 2024 interpretative guidelines, and the US DOT rules in 14…
aviationpublic - Hybrid lexical/latent retrieval and lightweight reranking ablation over the academy's own knowledge base
The academy wants a search box across its glossary, insights and lessons so a learner who types "why did my validation score drop after I scaled the whole dataset" lands on the right explanation.
cross-industrybundled-with-libraryreference executed - Chunking experiment on long technical papers: evidence recall at a fixed context budget
An R&D team wants to ask questions of long technical reports and feed retrieved chunks to a model with a fixed context budget.
cross-industrypublic - Structured extraction from disruption notices: JSON-schema validation, safe repair and injected-instruction detection
An airline operations team wants free-text disruption notices turned into a JSON record (flight, date, airports, disruption type, delay minutes, cause category, whether rebooking was offered) that downstream automation…
aviationsyntheticreference executed - Tool-calling agent vs deterministic workflow for rebooking proposals after a cancellation
After a cancellation, agents need rebooking proposals: later flights on the same route with spare seats. Should the airline build this as a deterministic workflow (parse the ticket, query, rank, draft), as a…
aviationsynthetic - Prompt-injection red-team harness for a product-Q&A assistant, run on safe fixtures
An online retailer's shopping assistant reads product descriptions and customer reviews and can call tools (catalogue search, order status for the signed-in customer, and a coupon tool that needs approval).
e-commercesyntheticreference executed - LLM-as-judge reliability study: agreement with human pairwise labels, position bias and length bias
An evaluation team wants to replace part of its human pairwise review with an LLM judge. Is the judge reliable enough to rank model versions: how often does it agree with expert human preferences, how often does its…
cross-industrypublicreference executed - Golden-set regression suite that gates prompt changes for a claims-intake triage assistant
An insurer's first-notice-of-loss assistant reads a customer's message and returns a triage record (claim type, urgency, documents to request, escalate or not). Prompt engineers change the prompt every few weeks.
insurancesyntheticreference executed - Cost and latency routing study: small model, large model, router and cascade on checkable answers
A team runs a high-volume assistant where many requests are easy and some are hard. Would routing easy requests to a cheaper, faster model and escalating the rest keep accuracy close to always using the large model at a…
cross-industrypublicreference executed - Intent classification for banking support: LLM zero/few-shot vs a TF-IDF baseline on cost, accuracy and failure modes
A bank's support team routes incoming customer messages to 77 fine-grained intents. Is an LLM prompted with the label list (zero- or few-shot) better than a TF-IDF + logistic regression model trained on labelled…
bankingpublic - Summary faithfulness evaluation for legislative bills: human claim labels vs automatic checks
A legislative-tracking team wants machine summaries of US bills for analysts. Analysts accept a shorter summary but not a wrong one.
public-sectorpublic - Similar-ticket search for a software support desk: BM25, TF-IDF, embeddings and hybrid on human-labelled duplicates
A software support desk wants to show agents "similar past tickets" when a new ticket arrives, so known issues are linked instead of re-solved.
saaspublic - LoRA/QLoRA adaptation plan for fine-grained banking intents (implementation-ready, docs-only, GPU optional)
Project-045 compares prompting and a TF-IDF model on BANKING77. Would parameter-efficient fine-tuning of a small open-weight model close the remaining gap on confusable intents at a serving cost the bank can carry?…
bankingpublic - Embedding drift monitoring for a virtual assistant, evaluated on simulated traffic with known injected shifts
A virtual-assistant platform wants an early warning when incoming user requests change - a new topic surging, more out-of-scope requests - before intent accuracy quietly degrades.
cross-industrypublic - PII redaction pipeline evaluation before documents cross an LLM trust boundary
A financial-services team wants to send customer documents to an LLM summariser hosted outside its trust boundary, but only after personal data is redacted.
financepublic