Domain-Specific Data Enrichment Benchmark
Comparing Kirha's domain-specific knowledge against standard web search.
Kirha Average Score
45.3/50Winner
Web Search Average Score
31.6/50
Fallback baseline
Methodology
This benchmark compares Kirha against standard web search on domain-specific queries where Kirha has specialized knowledge integrations: Company Data, Insurance, and Crypto/Blockchain.
Kirha uses web search as a fallback when it doesn't have domain-specific knowledge. This benchmark tests domains where Kirha's specialized integrations provide structured, accurate, and actionable data compared to generic web results.
Evaluation Criteria
Relevance — How well does the response address the query?
Accuracy — Is the information correct and verifiable?
Completeness — Does it cover all aspects of the request?
Freshness — Is the data current and up-to-date?
Actionability — Can the user act on this information directly?
Score Comparison
By Metric
Performance Profile
Test Results
Click on a row to see detailed results and raw outputs
| # | Query | Kirha | Web Search | Winner | |
|---|---|---|---|---|---|
| 1 | list Construction and Real Estate latest 10 tenders in France and Germany above 10m euros. | 47/50 | 9/50 | Kirha | |
| 2 | Show the volume trend for OpenSea over the past month. | 49/50 | 28/50 | Kirha | |
| 3 | Give me the last Bitcoin news about the top 3 Bitcoin company holders. | 45/50 | 44/50 | Kirha | |
| 4 | Find 5 contributors to C++ OCR projects. | 50/50 | 43/50 | Kirha | |
| 5 | Summarize 5 latest Nvidia SEC filings. | 37/50 | 26/50 | Kirha | |
| 6 | Find latest fundraising in crypto. | 49/50 | 45/50 | Kirha | |
| 7 | List the 10 latest authors of research papers on RAG. | 49/50 | 35/50 | Kirha | |
| 8 | Track the portfolio of the top 5 wallets related to Tornado Cash. | 29/50 | 26/50 | Kirha | |
| 9 | is https://assets.kirha.com/fake_car_crash.png AI-altered? | 50/50 | 17/50 | Kirha | |
| 10 | Insurance Risk related to Weather at Valence (spain), the 29 october 2024. | 48/50 | 43/50 | Kirha |