Spaces:
Build error
Build error
File size: 1,245 Bytes
9c7d451 175746c 9c7d451 e4a41fa 9c7d451 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 | """Headroom SDK Benchmark Suite.
This package provides performance benchmarks for Headroom transforms and relevance
scorers. Benchmarks use pytest-benchmark for accurate timing measurements.
Usage:
# Run all benchmarks
pytest benchmarks/ --benchmark-only
# Run specific suite
pytest benchmarks/bench_transforms.py --benchmark-only
# Generate comparison report
python benchmarks/run_benchmarks.py --suite all --output report.md
Performance Targets:
- SmartCrusher: < 10ms for 1000 items
- CacheAligner: < 1ms for date extraction
- RollingWindow: < 5ms for 200 turns
- BM25Scorer: < 1ms for 100 items
- HybridScorer: < 50ms for 100 items (with embeddings)
"""
__version__ = "0.2.0"
from .scenarios.conversations import (
generate_agentic_conversation,
generate_rag_conversation,
)
from .scenarios.tool_outputs import (
generate_api_responses,
generate_database_rows,
generate_log_entries,
generate_search_results,
)
__all__ = [
# Data generators
"generate_search_results",
"generate_log_entries",
"generate_api_responses",
"generate_database_rows",
# Conversation generators
"generate_agentic_conversation",
"generate_rag_conversation",
]
|