ZacharyZhang-NY
a02b555e66
Sweep every first-party crate source (1956 .rs files) to the project comment guidelines: delete redundant restatements, decorative banners, change narration, and end-of-line comments; keep and tighten the crucial ones (invariants, bug rationale, SAFETY blocks, ported-source attribution). No functional code changed. Every edit is proven comment-only against the prior tree by a comment-stripping lexer (string/char/raw-string aware) plus a separate doctest-fence check. Where removing a comment made rustfmt or clippy want to re-lay-out adjacent code, the minimal triggering comment is restored so code tokens stay byte-identical. Gates green: cargo fmt --all --check (0 diffs), cargo check and cargo clippy --workspace --all-targets (0 warnings). Adds scripts/check_codegen_comment_guidelines.py — the enforcement gate for these guidelines (flags banners, end-of-line comments, change narration, and commented-out code).
44 lines
1.4 KiB
Rust
44 lines
1.4 KiB
Rust
//! Internal actor protocol.
|
|
//!
|
|
//! `SamplerCommand` is `pub(crate)` because it is the wire between
|
|
//! [`SamplerHandle`](crate::handle::SamplerHandle) and the actor task.
|
|
//! External callers always go through `SamplerHandle`.
|
|
|
|
use tokio::sync::oneshot;
|
|
|
|
use kigi_sampling_types::{ConversationRequest, ConversationResponse, SamplingError};
|
|
|
|
use crate::config::SamplerConfig;
|
|
use crate::metrics::InferenceLatencyStats;
|
|
use crate::types::RequestId;
|
|
|
|
/// Large payloads (`ConversationRequest`, `SamplerConfig`) are boxed so every
|
|
/// variant stays cheap to move through the mpsc channel.
|
|
pub(crate) enum SamplerCommand {
|
|
/// Fire-and-forget — results arrive as events. When `completion_tx` is set
|
|
/// the per-request task also signals that channel, for
|
|
/// `submit_and_collect` callers.
|
|
Submit {
|
|
request_id: RequestId,
|
|
request: Box<ConversationRequest>,
|
|
config: Option<Box<SamplerConfig>>,
|
|
completion_tx: Option<
|
|
oneshot::Sender<Result<(ConversationResponse, InferenceLatencyStats), SamplingError>>,
|
|
>,
|
|
},
|
|
|
|
/// Cancel an in-flight request.
|
|
Cancel { request_id: RequestId },
|
|
|
|
/// Sent on a model switch or an auth refresh.
|
|
UpdateConfig { config: Box<SamplerConfig> },
|
|
|
|
IsActive {
|
|
request_id: RequestId,
|
|
reply: oneshot::Sender<bool>,
|
|
},
|
|
|
|
/// Query: how many requests are in flight?
|
|
ActiveCount { reply: oneshot::Sender<usize> },
|
|
}
|