0.1.7

Features

• feat: Add JSON configuration with 8MB limit and clean up unused imports in http.rs (@karolisg) (4689128)
• feat: Introduce RunSpanBuffer for efficient span management and update trace service to utilize it (@karolisg) (483148c)
• feat: Update provider credentials handling to include GatewayTenant in update_provider_key function (@karolisg) (60e4fee)
• feat: Introduce thread handling module with service and middleware integration (@karolisg) (a5a9ccb)
• feat: add option to control UI opening on startup and update configuration handling (@karolisg) (e5ecdf4)
• #175 Feat: Tracing MCP server (@karolisg)
• feat: Add Slack notification for new brew releases (@karolisg) (a1632b2)
• feat: add Slack notification job to GitHub Actions workflow for release updates (@karolisg) (cf7b148)
• feat: Support claude sonnet 4.5 (@karolisg) (931dd56)
• feat: add cost field to span model for enhanced tracking capabilities (@karolisg) (64f3a7b)
• feat: add message_id field to span model and track elapsed time for processing streams across models (@karolisg) (d3dda6d)
• feat: add model and inference model names to tracing fields in TracedEmbedding (@karolisg) (6c096ca)
• feat: add LLMStartEvent logging for Bedrock, Gemini, and OpenAI embedding models (@karolisg) (f24fea3)
• feat: capture spans for Bedrock, Gemini, and OpenAI embeding models (@karolisg) (7197ae6)
• feat: Replace custom error handling with specific ModelError variants (@karolisg) (7839211)
• feat: Support base64 encoding in embeddings (@karolisg) (def4f90)
• feat: Add methods for token pricing in ModelPrice enum (@karolisg) (631664a)
• feat: Enhance OpenAI embeddings support with Azure integration and improve error handling (@karolisg) (16b401d)
• feat: Add Bedrock embeddings support and enhance error handling (@karolisg) (4d7858b)
• feat: Introduce Gemini embeddings model and enhance provider error handling (@karolisg) (785371a)
• feat: Add is_private field to model metadata for enhanced privacy control (@karolisg) (217ee73)
• feat: Add new embedding models and enhance model handling (@karolisg) (9ffa27a)
• #129 feat: Fetch models from Google Vertex (@karolisg)
• feat: Add async method to retrieve top model metadata by ranking (@karolisg) (6f45d3d)
• feat: Add model metadata support to chat completion execution (@karolisg) (e4d1b8f)
• feat: Add support for roles in ClickhouseHttp URL construction (@karolisg) (dabdfdd)
• feat: Extend ChatCompletionMessage struct to include optional fields for tool calls, refusal, tool call ID, and cache control (@karolisg) (529d4ea)
• feat: Add build_response method to AnthropicModel for constructing MessagesResponseBody from stream data (@karolisg) (1c42ef5)
• feat: Enhance GenerateContentResponse structure to include model_version and response_id, (@karolisg) (3d6d572)
• feat: Implement build_response method to construct CreateChatCompletionResponse from stream data for tracing purpose (@karolisg) (e305a0b)
• feat: Extend ModelMetadata with new fields for service level, release date, license, and knowledge cutoff date (@karolisg) (797aff5)
• feat: Add serde alias for InterceptorType Guardrail to support legacy "guard" identifier (@karolisg) (9dc6c43)
• #116 feat: Implement conditional routing strategy (@karolisg)
• feat: Integrate cache control logic into message content handling in MessageMapper (@karolisg) (416cb1d)
• feat: Update langdb_clust to version 0.9.4 and enhance token usage tracking in cost calculations (@karolisg) (489a4a9)
• feat: Add benchmark_info field to ModelMetadata (@karolisg) (1b7904f)
• feat: Introduce CacheControl struct and integrate it into message mapping for content types (@karolisg) (cc715da)
• feat: Add support for cached input token pricing in cost calculations and update related structures (@karolisg) (f1d4077)
• feat: Return template directly if no variables are provided in render function (@karolisg) (6adaf12)
• feat: Enhance logging by recording request payloads in Gemini client (@karolisg) (86a9875)
• feat: Add API_CALLS_BY_IP constant for enhanced rate limiting functionality (@karolisg) (5e5958c)
• feat: Add optional user_email field to RequestUser struct (@karolisg) (982c240)
• feat: Implement maximum depth limit for request routing in RoutedExecutor (@karolisg) (357ffca)
• feat: Handle max retries in request (@karolisg) (31d9d41)
• feat: add custom event for model events (@karolisg) (7299233)
• feat: Support project traces channels (@karolisg) (ce0efef)
• feat: add run lifecycle events and fix model usage tracking (@karolisg) (31875af)
• feat: implement tenant-aware OpenTelemetry trace (@karolisg) (ee48ae3)
• #92 feat: Basic responses support (@karolisg)
• #86 feat: Support http streamable transport (@karolisg)
• feat: Add options struct for prompt caching (@karolisg) (61181bc)
• feat: add description and keywords fields to thread (@karolisg) (11411ec)
• feat: Add key generation for transport type (@karolisg) (3238632)
• feat: add version support for virtual model retrieval via model@version syntax (@karolisg) (b1f4045)
• #73 feat: Add variables field to chat completions (@karolisg)
• #72 feat: Enhanced support for MCP servers (@karolisg)
• feat: Support azure url parsing and usage in client (@karolisg) (cb4c665)
• feat: Store tools results in spans (@karolisg) (4f8deff)
• feat: Store openai partner moderations guard metadata (@karolisg) (0415257)
• feat:Support openai moderation guardrails (@karolisg) (0285528)
• feat: Return 446 error on guard rejection (@karolisg) (e0dd668)
• #54 feat: Support custom endpoint for openai client (@karolisg)
• #46 feat: Implement guardrails system (@VG)
• feat: Support multiple identifiers in cost control (@karolisg) (302a84c)
• feat: Support all anthropic properties (@karolisg) (59dec4b)
• feat: Add support of anthropic thinking (@karolisg) (ff9815a)
• feat: Add extra to request (@karolisg) (a9d3c32)
• #29 feat: Support search in memory mcp tool (@VG)
• #28 feat: Use time windows for metrics (@karolisg)
• feat: Refactor targets usage for percentage router (@karolisg) (0445101)
• #21 feat: Support langdb key (@karolisg)
• #20 feat: Integrate routed execution with fallbacks (@karolisg)
• feat: Add missing gemini parameters (@karolisg) (5f1d15e)
• #15 feat: Improve UI (@karolisg)
• feat: Add model name and provider name to embeddings API (@karolisg) (452cb91)
• feat: Print provider and model name in logs (@karolisg) (3403968)
• #4 feat: Implement tui (@VG)
• #3 feat: Build for ubuntu and docker images (@VG)
• feat: Support .env variables for config (@karolisg) (65561e9)
• feat: Use in memory storage (@karolisg) (75bf2a1)
• feat: implement mcp support (@VG) (a97bc68)
• feat: Add rate limiting (@karolisg) (7066d87)
• feat: Add cost control and limit checker (@karolisg) (1300266)
• feat: Use user in openai requests (@karolisg) (96213dc)
• feat: Add api_invoke spans (@karolisg) (329ace4)
• feat: Enable otel when clickhouse config provided (@karolisg) (edbd16c)
• feat: Add database span writter (@karolisg) (72bd326)
• feat: Add clickhouse dependency (@karolisg) (78fe8ca)

Bug Fixes

• fix: Change From implementation to TryFrom for GenericGroupResponse and handle errors with GatewayError (@karolisg) (ff34d81)
• fix: Update tools definition to use Option for type field (@karolisg) (1b8d21b)
• fix: Update trace ID and span ID conversion in span_to_db_trace function (@karolisg) (ccc8881)
• fix: Add serde aliases for ListGroupQueryParams and GroupByKey fields (@karolisg) (09b35e7)
• fix: Fix filter params aliases (@karolisg) (db0219f)
• fix: Support postgres table for mcp configs (@karolisg) (a6235b7)
• fix: correct version formatting in check_version function for header and update check (@karolisg) (554b79d)
• fix: format version header in session check_version function (@karolisg) (1aa7c88)
• #178 fix: enhance error logging in Actix OTEL middleware (@karolisg)
• fix: Invalidate Rust build cache when UI content changes (@duonganhthu43) (1e8dc3f)
• fix: fmt (@duonganhthu43) (a2d3c3e)
• fix: Use tool.name instead of label in tools span (@karolisg) (a3f2e6f)
• fix: Send only part of headers to session track (@karolisg) (137da3d)
• fix: build ui part (@duonganhthu43) (c1ac76a)
• fix: enhance usage tracking by adding raw_usage field and implementing content comparison in Message struct (@karolisg) (309a772)
• fix: Improve error message for invalid ModelCapability (@karolisg) (25973bf)
• fix: Update token calculation in OpenAIModel to include reasoning tokens (@karolisg) (7f54726)
• #140 fix: Add support for custom headers in transports. Fixes #135 (@karolisg)
• fix: Update routing logic to always return true for ErrorRate metric when no metrics are available (@karolisg) (ead8fc0)
• fix: Update apply_guardrails call to use slice reference for message to ensure proper handling (@karolisg) (f00c778)
• fix: Improve error handling in stream_chunks by logging send errors for GatewayApiError (@karolisg) (74c6d54)
• fix: Update GatewayApiError handling for ModelError to return BAD_REQUEST for ModelNotFound (@karolisg) (bacb9ef)
• fix: Correct input token cost calculation by ensuring cached tokens are properly subtracted (@karolisg) (f42a00b)
• fix: Workaround xai tool calls issue (@karolisg) (da836f1)
• fix: Add workaround for XAI bug (@karolisg) (aeef458)
• fix: Handle template error during rendering (@karolisg) (45d960c)
• fix: Fix operation name for model spans (@karolisg) (ba68f69)
• fix: Fix retries handle in llm calls (@karolisg) (7c5354b)
• fix: Fix retries logic (@karolisg) (3edfae3)
• fix: Handle thought signature in gemini response (@karolisg) (f1e1501)
• fix: Fix duplicated tools labels in gemini tools spans (@karolisg) (233b100)
• fix: Properly handle model calls traces in gemini (@karolisg) (f57d522)
• fix: Empty required parameters list (@karolisg) (4e887b3)
• fix: Fix required default value (@karolisg) (c2ebf62)
• fix: Fix tracing for cached responses (@karolisg) (b9422cd)
• fix: handle cache response errors gracefully in gateway service (@karolisg) (38eba17)
• fix: Handle nullable types in gemini (@karolisg) (4a5a3ad)
• fix: Fix nested gemini structured output schema (@karolisg) (e97a592)
• fix: Fix gemini structured output generation (@karolisg) (45b376a)
• Fix: Fix gemini tool calls (@karolisg) (5331e2c)
• fix: Store call information in anthropic span when system prompt is missing (@karolisg) (c856d9a)
• fix: Handle empty arguments (@karolisg) (694a040)
• fix: Fix tags extraction (@karolisg) (732d872)
• fix: Add index to tool calls (@karolisg) (1963d20)
• fix: Support proxied engine types (@karolisg) (30d04b0)
• fix: Fix nested json schema (@karolisg) (2fcecc7)
• fix: Fix models name in GET /models API (@karolisg) (af93b7c)
• #38 fix: Fix ttft capturing (@karolisg)
• fix: Fix gemini call when message is empty (@karolisg) (77dfb2e)
• fix: Return formated error on bedrock validation (@karolisg) (b36434a)
• fix: Create secure context for script router (@karolisg) (5adfcd7)
• fix: Fix serialization of user properties (@karolisg) (af3e20b)
• fix: Fix routing direction for tps and requests metrics (@karolisg) (74317bb)
• fix: Return authorization error on invalid key (@karolisg) (08b870c)
• fix: Fix map tool names to labels in openai (@karolisg) (f434dd7)
• #26 fix: Fix langdb config load (@karolisg)
• fix: Add router span (@karolisg) (789261c)
• #22 fix: Fix response format usage (@karolisg)
• fix: Fix model name in models_call span (@karolisg) (ba57d2b)
• fix: Store inference model name in model call span (@karolisg) (a446bee)
• fix: Fix tags in tracing (@karolisg) (f0f6ffd)
• Fix: Fix provider name in tracing (@karolisg) (8754804)
• #18 fix: Fix provider name (@karolisg)
• fix: Improve error handling in loading config (@karolisg) (d4fbc25)
• fix: Fix tracing for openai and deepseek (@karolisg) (679aaa8)
• fix: Fix connection to mcp servers (@karolisg) (562852d)
• fix: Fix tonic shutdown on ctrl+c (@karolisg) (d83828f)

Documentation

• docs: add license section to README with details on fair-code distribution and enterprise licensing (@MrunmayS) (ecfdc72)
• docs: Update image URLs in README to use main branch for consistency (@MrunmayS) (a46c3e6)
• docs: Update README to rename section from 'Using Homebrew' to 'Quick Start' for improved clarity (@MrunmayS) (7df392e)

Code Refactoring

• refactor: Remove mcp_server module and associated TavilySearch implementation (@karolisg) (ae7dbb1)
• refactor: Remove unnecessary logging in thread service middleware (@karolisg) (f775dc9)
• refactor: Migrate codebase to vllora functionality (@karolisg) (78575b3)
• refactor: Enhance embedding handling and introduce new model structure (@karolisg) (013b214)
• refactor: Remove unused EngineType variants from the engine module (@karolisg) (69e12a7)
• refactor: Clean up code formatting and remove unused dependency (@karolisg) (7b19a1b)
• refactor: Update model handling and enhance Azure OpenAI integration (@karolisg) (868ffef)
• refactor: Consolidate CredentialsIdent usage across modules and enhance cost calculation (@karolisg) (8cd96e8)
• refactor: Integrate price and credentials identification into model handling (@karolisg) (88fbae0)
• refactor: Update ModelIOFormats enum to include PartialEq derive and remove Bedrock model file (@karolisg) (65152c3)
• refactor: Introduce BedrockCredentials type and update AWS credential handling (@karolisg) (fa28214)
• refactor: Enhance metric routing to include default metrics for missing models (@karolisg) (54c7e2c)
• refactor: Update default context size in Bedrock model provider to zero (@karolisg) (1211217)
• refactor: Enhance Bedrock model ID formatting with region prefix (@karolisg) (8f80b92)
• refactor: Update Anthropic model to handle optional system messages (@karolisg) (b3859a8)
• refactor: Simplify message sending in stream_chunks function (@karolisg) (00b657e)
• refactor: Enhance Bedrock model ID handling with version replacement (@karolisg) (ec5ab40)
• refactor: Update Bedrock model provider to skip specific model ARNs and use model ARN for metadata (@karolisg) (d4034c1)
• refactor: Simplify Bedrock model ID handling and remove unused model ARN assignment (@karolisg) (968ba0a)
• refactor: Improve AWS region configuration handling in get_user_shared_config (@karolisg) (36c62c9)
• refactor: Add warning logs for Bedrock model name during conversation (@karolisg) (c4a7ed0)
• refactor: Remove debug logging for Bedrock client credentials (@karolisg) (5991121)
• refactor: Update BedrockModel to utilize ChatCompletionMessageWithFinishReason and adjust region configuration (@karolisg) (b7fb560)
• refactor: Remove unnecessary error logging in GeminiModel response handling (@karolisg) (343df18)
• refactor: Enhance OpenAIModel response handling with finish reason and usage tracking (@karolisg) (91aaf32)
• refactor: Update ChatCompletionMessage to include finish reason and adjust related model implementations (@karolisg) (f884c47)
• refactor: Simplify match expression for ModelError in GatewayApiError and streamline error logging in stream_chunks (@karolisg) (68deec6)
• refactor: Remove redundant logging of system messages in AnthropicModel (@karolisg) (f6d3a73)
• refactor: Simplify ProjectTraceMap type by removing receiver from tuple (@karolisg) (ea1c088)
• refactor: Add alias for InMemory transport type in McpTransportType enum (@karolisg) (04710a1)
• refactor: Clean up unused app_data references in ApiServer and adjust telemetry imports (@karolisg) (a40a683)
• refactor: Remove unused TraceMap references from RoutedExecutor and related modules (@karolisg) (2fe3067)
• refactor: integrate InMemoryMetricsRepository into routing logic (@karolisg) (329e153)
• refactor: split chat completion streaming into separate chunks for delta, finish reason and usage (@karolisg) (c67d478)
• refactor: Fix use of variables (@karolisg) (5e5ad6b)
• refactor: rename PromptCache to ResponseCache for better clarity and consistency (@karolisg) (bc9677f)
• refactor: move caching logic to dedicated cache module and update response types (@karolisg) (708797e)

Miscellaneous Chores

• chore: release v0.1.7 (@karolisg) (640d865)
• chore(release): 0.1.7 (@karolisg) (2f1c19d)
• chore: Remove vllora_core dependency from workspace configuration (@karolisg) (4d468f0)
• chore: Remove unused types (@karolisg) (4cf8737)
• chore: Fix formatting (@karolisg) (6eea36f)
• chore: remove unnecessary logging in list_root_runs function (@karolisg) (2beeb6c)
• chore: standardize the GetGroupSpansQuery (@duonganhthu43) (e905408)
• chore: preserve dto, using snake case for dto (@duonganhthu43) (67f7df9)
• chore: update using snake case for ListRunsQueryParams (@duonganhthu43) (1901960)
• chore: Update GroupByKey enum to use untagged serialization and add aliases for fields (@karolisg) (d9e3c27)
• chore: preserve dto format (@duonganhthu43) (13a50ef)
• chore: Move fetch of batch spans to service (@karolisg) (9ad5ab3)
• chore: Move fetch of spans group to service (@karolisg) (179e11c)
• chore: add group by to deserialize as snake_case (@duonganhthu43) (09f3b44)
• chore: Add group module and refactor metadata services to utilize new types and improve query handling (@karolisg) (32e1611)
• chore: Fix tests (@karolisg) (d47cfb3)
• chore: Remove redundant trace service trait (@karolisg) (e9624a9)
• chore: Refactor metadata services to separate traits and implementation (@karolisg) (96f9d77)
• chore: Introduce JsonVec and UUID types for enhanced run metadata handling and update RunUsageInformation structure (@karolisg) (90b7595)
• chore: Refactor trace service integration to use DatabaseService for improved initialization and project handling (@karolisg) (f03cfa8)
• chore: Move models grouping to core (@karolisg) (ef1f91a)
• chore: Fix formatting (@karolisg) (1c4c138)
• chore: Move providers handler to core (@karolisg) (919c3e4)
• chore: Move event handling to core (@karolisg) (084b4cd)
• chore: Update vllora_core dependency in workspace and adjust default features in guardrails (@karolisg) (c675aeb)
• chore: Add from string conversion for provider credentials (@karolisg) (e1e6777)
• chore: update latest ui ref (@duonganhthu43) (c49f028)
• #176 Chore: unify grouping logic for run, time, thread (@duonganhthu43)
• chore: Remove unused library (@karolisg) (d890987)
• #174 chore(deps): bump reqwest from 0.12.23 to 0.12.24 (@dependabot[bot])
• #173 chore(deps): bump bytemuck from 1.23.2 to 1.24.0 (@dependabot[bot])
• #172 chore(deps): bump tokio from 1.47.1 to 1.48.0 (@dependabot[bot])
• chore: update vllora (@VG) (e33d648)
• chore: release v0.1.6 (@karolisg) (8f3ca23)
• chore(release): 0.1.6 (@karolisg) (43ab281)
• chore: update vllora_guardrails to version 0.1.5 and enhance logging for OTEL gRPC collector startup (@karolisg) (7c29020)
• chore: update package versions to 0.1.5 for vllora, vllora_core, vllora_guardrails and adjust release script for tagging and publishing (@karolisg) (2fc562a)
• chore: update latest ui ref (@duonganhthu43) (78c8e10)
• chore: Restore dist symlink for local development (@duonganhthu43) (40fdc14)
• chore: clean up and update dist folder (@duonganhthu43) (4a9cce6)
• chore: update latest ui ref (@duonganhthu43) (ce9a80e)
• chore: Update Slack notification message for new beta releases (@karolisg) (67da439)
• chore: Add is_prerelease condition to GitHub Actions workflow (@karolisg) (e516320)
• chore: Update dist (@karolisg) (03806a7)
• chore: Add dist symbolic link (@karolisg) (89c0796)
• chore: Make SQLite feature default in core (@karolisg) (d3c1b81)
• chore: Bump package versions to 1.0.0 across all components (@karolisg) (a24e925)
• chore: update UI assets and scripts (@karolisg) (4768a6d)
• chore: Update deps (@karolisg) (bd5ac13)
• chore: update UI with fixed thread view (@karolisg) (269095f)
• chore: Rename project from LangDB AI Gateway to vLLora and update related documentation (@MrunmayS) (01ad228)
• chore(deps): update rmcp and rmcp-macros to version 0.8.3 (@karolisg) (baa0ca7)
• #168 chore(deps): bump regex from 1.11.1 to 1.12.2 (@dependabot[bot])
• chore(deps): update AWS SDK and related dependencies (@karolisg) (f21cfee)
• #169 chore(deps): bump serde_with from 3.14.0 to 3.15.1 (@dependabot[bot])
• chore: Remove unused code (@karolisg) (a5534ef)
• chore: Add formula (@karolisg) (769acde)
• #171 chore: Rename project from LangDB AI Gateway to vLLora and update rel… (@MrunmayS)
• chore: Update clust dependency version to 0.9.8 (@karolisg) (dbafca2)
• chore: Update lock files after release (@karolisg) (0b08262)
• #159 chore: Release v0.3.2 (@karolisg)
• chore(release): 0.3.2 (@karolisg) (8ab76c4)
• chore: Update lock file (@karolisg) (c8f52fa)
• chore: simplify error handling in TraceService by removing explicit error logging for trace sending (@karolisg) (aa4dfdd)
• chore(deps): update serde_json version to 1.0.145 and remove unused parent_trace_id from telemetry (@karolisg) (ba08ce5)
• chore(deps): update async-openai version to 0.29.6 in Cargo.toml (@karolisg) (65ee6e1)
• fix(gemini): enhance finish reason handling to include MaxTokens and update related tests (@karolisg) (056a3b3)
• fix(tests): correct comments and expected output for requests metric test in MetricSelector (@karolisg) (a21cc3d)
• fix(metric): adjust optimization direction for Tps in MetricSelector (@karolisg) (80b4b6f)
• Revert "feat(database): add async_insert parameter to insert_values method for Clickhouse integration" (@karolisg) (534d74c)
• feat(database): add async_insert parameter to insert_values method for Clickhouse integration (@karolisg) (95b1500)
• chore(deps): update package versions to 0.3.1 for ai-gateway, langdb_core, langdb_guardrails, and udfs (@karolisg) (2ba2d8a)
• chore: update release script to include guardrails/Cargo.toml in version bump (@karolisg) (21a18a7)
• #153 chore: Release v0.3.1 (@karolisg)
• fix(docs): update contact link for enterprise solutions in README (@karolisg) (afa891c)
• fix(executor): increase mpsc channel capacity for better event handling (@karolisg) (f6f9f00)
• #150 chore(deps): bump actix-cors from 0.7.0 to 0.7.1 (@dependabot[bot])
• #149 chore(deps): bump indexmap from 2.10.0 to 2.11.4 (@dependabot[bot])
• #148 chore(deps): bump clap from 4.5.41 to 4.5.48 (@dependabot[bot])
• feat(image-generation): Add moderation option to CreateImageRequest and update OpenAIImageGeneration (@karolisg) (f1cb96e)
• feat(routing): Enhance routing conditions and improve error handling (@karolisg) (9c90a71)
• feat(models): Add get_models_by_name method to ModelMetadataFactory (@karolisg) (cdcb4dc)
• feat(ci): Add GitHub Actions workflow for building AI Gateway (@karolisg) (43fa381)
• feat(models): Add min_service_level and update is_private field in ModelMetadata (@karolisg) (f251e29)
• chore: Replace ModelError with GatewayError in error handling (@karolisg) (8c17bfe)
• chore: Clean up type annotations in model initialization (@karolisg) (3ee2922)
• #145 chore(deps): bump uuid from 1.18.0 to 1.18.1 (@dependabot[bot])
• #144 chore(deps): bump crossterm from 0.28.1 to 0.29.0 (@dependabot[bot])
• #143 chore(deps): bump bytemuck from 1.23.1 to 1.23.2 (@dependabot[bot])
• #142 chore(deps): bump jsonschema from 0.30.0 to 0.33.0 (@dependabot[bot])
• feat(gemini): Enhance FinishReason enum with additional reasons (@karolisg) (78d5444)
• feat(models): Add langdb_release_date to ModelMetadata and model provider instances (@karolisg) (c92b7b8)
• feat(models): Add Reasoning capability to ModelCapability enum (@karolisg) (23e5833)
• #147 chore: Add instrumentation to main functions (@karolisg)
• refactor(errors): Introduce ModelFinishError for improved error handling (@karolisg) (3f6f041)
• fix(gemini): log last chunk in stream processing for better error tracking (@karolisg) (73d3587)
• chore(deps): bump async-openai-compat version from 0.29.3 to 0.29.4 (@karolisg) (300db48)
• #137 chore(deps): bump reqwest from 0.12.22 to 0.12.23 (@dependabot[bot])
• #136 chore(deps): bump chrono from 0.4.41 to 0.4.42 (@dependabot[bot])
• chore(deps): update rmcp and schemars dependencies in Cargo files (@karolisg) (3139145)
• chore(deps): update AWS SDK dependencies in Cargo.lock (@karolisg) (4999ab5)
• chore(deps): update AWS SDK dependencies to latest versions (@karolisg) (d908bef)
• #133 chore(deps): bump actix-web from 4.9.0 to 4.11.0 (@dependabot[bot])
• chore: Update lock file (@karolisg) (aaf9756)
• #134 Release v0.3.0 (@karolisg)
• chore: Enhance model pricing structures with PartialEq derivation (@karolisg) (01e83e2)
• #128 chore(deps): bump tracing-subscriber from 0.3.19 to 0.3.20 (@dependabot[bot])
• #127 chore(deps): bump minijinja from 2.11.0 to 2.12.0 (@dependabot[bot])
• #124 chore(deps): bump async-trait from 0.1.88 to 0.1.89 (@dependabot[bot])
• chore: Update async-openai-compat dependency version to 0.29.3 in Cargo.lock and Cargo.toml (@karolisg) (90cbe62)
• chore: Update dependencies in Cargo.lock and Cargo.toml (@karolisg) (dd16951)
• chore: Update clust dependency version from 0.9.5 to 0.9.6 in Cargo.toml (@karolisg) (3b08f95)
• chore: Update default AWS region in Bedrock client configuration from "us-west-2" to "us-east-1" (@karolisg) (4e54356)
• chore: Implement Display trait for ModelCapability and ModelIOFormats (@karolisg) (1d9fd1a)
• chore: Fix code formating (@karolisg) (7ce864a)
• chore(deps): update aws-sdk-bedrock and aws-sdk-bedrockruntime to latest versions (@karolisg) (d839be0)
• #121 chore(deps): bump aws-config from 1.8.0 to 1.8.1 (@dependabot[bot])
• #120 chore(deps): bump uuid from 1.17.0 to 1.18.0 (@dependabot[bot])
• chore: Fix formatting (@karolisg) (1034bdd)
• chore(deps): update aws-sdk dependencies and bump versions in Cargo.lock and Cargo.toml (@karolisg) (a6fedc9)
• #117 chore(deps): bump tokio-util from 0.7.13 to 0.7.16 (@dependabot[bot])
• chore: Refactor token usage calculation in AnthropicModel to include cached tokens (@karolisg) (1168402)
• chore: Fix serialization of message (@karolisg) (337fc95)
• chore: enhance deserialization for MessageContentPart to support both 3-tuple and 4-tuple formats (@karolisg) (f4b44aa)
• chore: Update async-openai-compat to version 0.29.0 and add prompt_cache_key to request and model parameters (@karolisg) (a2a639f)
• chore: Update dependencies and enhance usage tracking in Anthropic and OpenAI models (@karolisg) (9f987f0)
• chore: Update dashmap dependency to version 6.1.0 and simplify sender retrieval in TraceService implementation (@karolisg) (c3205fa)
• chore: Add optional serialization for parameters in ModelMetadata (@karolisg) (33c24c2)
• chore: Add eq trait to limit period (@karolisg) (85e1da9)
• chore: update lint workflow to trigger on push to main branch (@karolisg) (385460a)
• #114 chore(deps): bump aws-sdk-bedrock from 1.100.0 to 1.102.0 (@dependabot[bot])
• #113 chore(deps): bump bytemuck from 1.21.0 to 1.23.1 (@dependabot[bot])
• #112 chore(deps): bump rand from 0.8.5 to 0.9.1 (@dependabot[bot])
• chore: Update openai model (@karolisg) (664e65a)
• #111 chore(deps): bump clap from 4.5.40 to 4.5.41 (@dependabot[bot])
• #110 chore(deps): bump aws-smithy-runtime-api from 1.8.1 to 1.8.3 (@dependabot[bot])
• chore: Remove debug statement (@karolisg) (55b6c96)
• chore: Add qualified_name function (@karolisg) (7ae08b3)
• chore: Make models serializible (@karolisg) (095e06e)
• chore: Update lock file (@karolisg) (81210be)
• #109 Release v0.2.4 (@karolisg)
• chore(release): 0.2.4 (@karolisg) (6a8f0a1)
• chore: Use official rmcp library (@karolisg) (81c54d3)
• chore(release): 0.2.3 (@karolisg) (36b7b50)
• #108 Release v0.2.3 (@karolisg)
• chore: When serializing span use attribute name (@karolisg) (7065de4)
• #107 chore(deps): bump crossterm from 0.27.0 to 0.29.0 (@dependabot[bot])
• #106 chore(deps): bump reqwest from 0.12.20 to 0.12.22 (@dependabot[bot])
• #105 chore(deps): bump ratatui from 0.24.0 to 0.29.0 (@dependabot[bot])
• #104 chore(deps): bump minijinja from 2.7.0 to 2.11.0 (@dependabot[bot])
• #103 chore(deps): bump chrono from 0.4.39 to 0.4.41 (@dependabot[bot])
• chore: Refactor events (@karolisg) (33c08ad)
• chore: Refactor events (@karolisg) (2a7d68f)
• chore: Create macro for model spans (@karolisg) (637ccf4)
• feature: Add raw request to llm call spans (@karolisg) (f6e027b)
• chore: Move max_retries to chat completions request (@karolisg) (6b0bf40)
• chore: Fix formatting errors (@karolisg) (63486b6)
• #101 chore(deps): bump parking_lot from 0.12.3 to 0.12.4 (@dependabot[bot])
• #100 chore(deps): bump clap from 4.5.38 to 4.5.40 (@dependabot[bot])
• #99 chore(deps): bump serde_with from 3.12.0 to 3.13.0 (@dependabot[bot])
• #98 chore(deps): bump serde_tuple from 0.5.0 to 1.1.0 (@dependabot[bot])
• #97 chore(deps): bump indexmap from 2.7.1 to 2.10.0 (@dependabot[bot])
• chore: Remove unused view struct (@karolisg) (194b790)
• chore: Fix clippy warnings after rust update (@karolisg) (07bb7eb)
• chore: Update aws bedrock dependencies (@karolisg) (2911dd7)
• chore: upgrade tokio dependency to version 1.45.1 (@karolisg) (9b02ba0)
• chore: Update reqwest (@karolisg) (dca1770)
• chore: Update either (@karolisg) (ddb999f)
• chore: update JSONSchema dependency (@karolisg) (bb1831f)
• chore: upgrade OpenTelemetry and Tonic dependencies to latest versions (@karolisg) (249937d)
• chore: Dont store message id if is not passed (@karolisg) (72481ee)
• chore: Update rmcp (@karolisg) (acf48af)
• #91 chore(deps): bump aws-sdk-bedrockruntime from 1.71.0 to 1.72.0 (@dependabot[bot])
• #89 chore(deps): bump uuid from 1.13.1 to 1.17.0 (@dependabot[bot])
• chore: Remove unused events store (@karolisg) (b580eb8)
• chore: Remove debug statements (@karolisg) (761d95e)
• #88 chore(deps): bump ring from 0.17.8 to 0.17.14 (@dependabot[bot])
• #85 chore(deps): bump openssl from 0.10.71 to 0.10.73 (@dependabot[bot])
• #80 chore(deps): bump tokio from 1.43.0 to 1.45.1 (@dependabot[bot])
• #78 chore(deps): bump serde from 1.0.217 to 1.0.219 (@dependabot[bot])
• #77 chore(deps): bump bytes from 1.9.0 to 1.10.1 (@dependabot[bot])
• chore: Remove unnecessary debug statement (@karolisg) (d618ca8)
• chore: Add distance cache options (@karolisg) (26b93e3)
• chore: Update clust library (@karolisg) (679337c)
• chore: update clust library (@karolisg) (94408af)
• #79 chore: add title in message thread (@duonganhthu43)
• chore: Add default model metadata (@karolisg) (ea920c3)
• chore: remove unused file from codebase (@karolisg) (f56f456)
• chore: Add display to routing strategies (@karolisg) (10d4f40)
• chore: add public threads (@karolisg) (2e4b650)
• chore: Use serde_json::Value in variables (@karolisg) (90dc8e1)
• #74 chore(deps): bump clap from 4.5.27 to 4.5.38 (@dependabot[bot])
• #68 chore(deps): bump crossbeam-channel from 0.5.14 to 0.5.15 (@dependabot[bot])
• #61 chore(deps): bump mockall from 0.11.4 to 0.13.1 (@dependabot[bot])
• #59 chore(deps): bump async-trait from 0.1.85 to 0.1.88 (@dependabot[bot])
• #57 chore(deps): bump thiserror from 2.0.11 to 2.0.12 (@dependabot[bot])
• #56 chore(deps): bump openssl from 0.10.70 to 0.10.71 (@dependabot[bot])
• chore: Ignore output if choices are empty (@karolisg) (fc9e3d5)
• #64 Release v0.2.2 (@karolisg)
• chore: Fix release (@karolisg) (300ce0d)
• chore: Move guardrail span under model_call span (@karolisg) (2229f84)
• Fix output store in traces (@karolisg) (8baeead)
• #43 chore(deps): bump serde_json from 1.0.138 to 1.0.140 (@dependabot[bot])
• chore: Add missing guardrails version bump (@karolisg) (21c65a0)
• chore: Fix release script (@karolisg) (fbc6722)
• #60 chore: Release v0.2.1 (@karolisg)
• chore(release): 0.2.1 (@karolisg) (0e292f9)
• Revert "fix: Handle empty arguments" (@karolisg) (3e0f8c3)
• chore: Rename user tags property (@karolisg) (5ab5657)
• chore: Add meta in guardrails cargo (@karolisg) (c5002e0)
• chore: Update clust version (@karolisg) (d5dad01)
• #55 Release v0.2.0 (@karolisg)
• chore(release): 0.2.0 (@karolisg) (9fd4669)
• chore: Remove redundant error enum (@karolisg) (0112847)
• chore: Use custom error for missing prompt (@karolisg) (3a64a89)
• chore(deps): Update dependencies (@karolisg) (48b3f4d)
• #14 chore(deps): bump directories from 5.0.1 to 6.0.0 (@dependabot[bot])
• #50 Enhance BedrockError handling by adding specific error variants for timeouts and authentication issues
• chore: Modify is_virtual to virtual_model_id (@karolisg) (57a54c7)
• chore: Add is_virtual to model definition (@karolisg) (d35175a)
• chore: Fix formatting (@karolisg) (6c4f1cc)
• chore: Simplify usage (@karolisg) (02326f4)
• #42 chore: gif Update (@MrunmayS)
• #41 Disable file logging by default (@santrancisco)
• chore: Use updated clust version (@karolisg) (27aac57)
• #37 Release v0.1.3 (@karolisg)
• chore: Update release script (@karolisg) (ff1a8ef)
• #36 chore: fix for timeout (@MrunmayS)
• chore: Update lock file (@karolisg) (da0ad5f)
• #13 chore(deps): bump aws-sdk-bedrock from 1.71.0 to 1.72.0 (@dependabot[bot])
• #35 Release v0.1.2 (@karolisg)
• chore: Update async-openai (@karolisg) (d929c18)
• #34 Chore: Make experimental changes in script engine and indexes to trace table (@karolisg)
• chore: update release.sh (@VG) (4cec06f)
• #33 Release v0.1.1 (@VG)
• chore: update release.sh (@VG) (9fdd867)
• #31 chore: update config to be a function argument (@VG)
• chore: Add missing alias (@karolisg) (a30ec24)
• #30 validate mcp sever (@VG)
• chore: Skip serializing for llm usage if it is none (@karolisg) (6d0290f)
• chore: Add additional test case for metrics router (@karolisg) (76c14c3)
• chore: Docs update (@MrunmayS) (909e925)
• chore: Add support for error rate and tps metrics (@karolisg) (f8e44c0)
• #11 chore(deps): bump thiserror from 1.0.69 to 2.0.11 (@dependabot[bot])
• Chore: Update docs (@MrunmayS) (ab2c4aa)
• chore: Update langdb models (@karolisg) (d41c56d)
• #19 chore: fix using system prompt (@VG)
• #10 chore(deps): bump validator from 0.18.1 to 0.20.0 (@dependabot[bot])
• #9 chore(deps): bump openssl from 0.10.69 to 0.10.70 (@dependabot[bot])
• chore: export dashmap and header extractor (@karolisg) (d455332)
• #17 chore: add parameters metadata info in model definition (@duonganhthu43)
• chore: include crates.io link (@VG) (02ea35d)
• #16 chore: Update async openai (@karolisg)
• #8 chore: Cleanup dependencies (@karolisg)
• chore: fix the docs link (@VG) (84a6c5b)
• #7 Chore/docs (@MrunmayS)
• #5 chore: get ready to publish (@VG)
• chore: remove gif (@VG) (edd1691)
• chore: refactor readme (@VG) (28f6159)
• chore: Use compact logs and error level (@karolisg) (9aa1f09)
• chore: fix minor information (@VG) (14e8634)
• chore: include helpful messages (@VG) (91ae443)
• chore: Add config load warning message (@karolisg) (dc3c447)
• chore: updated readme (@MrunmayS) (58799c1)
• chore: fixed docker image bug (@MrunmayS) (88ff7fc)
• chore: Update async-openai (@karolisg) (de71703)
• chore: added supported providers (@MrunmayS) (14cc6e3)
• chore: updated readme (@MrunmayS) (991e426)
• chore: added contributing md (@MrunmayS) (8ef5f98)
• Create CODE_OF_CONDUCT.md (@MrunmayS) (c09c7bc)
• chore: Change IP to 0.0.0.0 in sample config (@karolisg) (e370906)
• chore: minor edit (@MrunmayS) (a35e435)
• chore: centre the image (@MrunmayS) (5052d8c)
• chore: added assets (@MrunmayS) (28d4230)
• chore: added raw gif (@MrunmayS) (2d897a8)
• chore: update readme with gif (@MrunmayS) (9f40373)
• chore: update readme with gif (@MrunmayS) (e9246a7)
• chore: Remove unused config property (@karolisg) (9c38e59)
• chore: Add directinstallation command to readme (@karolisg) (2b1d18d)
• chore: Update readme (@karolisg) (a84ab8c)
• chore: Update readme (@karolisg) (271ab49)
• Refactor span tracing for openai (@karolisg) (f8e6208)
• chore: Reexport bytes (@karolisg) (70b13cd)
• chore: adjust types (@VG) (f87ebeb)
• chore: include ws transport (@VG) (72a2d58)
• chore: Add docker compose example for clickhouse (@karolisg) (177483b)
• chore: Add elastic 2.0 license (@karolisg) (da15a15)

Tests

• test: Add unit test for deserialization of prohibited content in GenerateContentResponse (@karolisg) (df6d852)