Core ABI extensions (voicecat.h): - vc_list_channels / vc_list_users / vc_list_user_streams — pull-based snapshot getters for the channel-tree and user-list UI; session_model_mu_ guards cross-thread reads - VC_EVENT_JOIN_RESULT / vc_join_channel — channel join with optional password - VC_EVENT_SERVER_IDENTITY + vc_confirm_server_identity — TOFU gate that blocks io_thread_ until the UI approves or rejects; pins TLS leaf-cert SHA-256 (not declared Ed25519) - vc_get_server_identity_display — Ed25519 fingerprint for human-readable display only - VC_INPUT_ALWAYS_ON = 2 in vc_input_mode — transmit unconditionally, no VAD gate - vc_set_vad_threshold — live RMS threshold update (0.0–1.0); EnergyVadProcessor stores it atomically so the audio RT path reads without a lock C++ implementation: - SessionModel::apply_snapshot / apply_channel_event fixed to populate parent_id, password_protected, and max_users (were permanently zeroed) - TlsContext::peer_cert_fingerprint — SHA-256 of peer leaf cert DER via mbedTLS - TofuStore split into peek (read-only) + pin (write) so first-connect only persists after user approval; tofu_store_path in vc_config for per-user pin file location - TcpAcceptor uses dual-stack IPv6+IPv4 fallback (fixes localhost → ::1 on Windows) - windows-client CMake preset: Release shared DLL, static MinGW runtime, no tools/tests - New C++ tests: test_channel_user_list_abi, test_tofu_flow (14/14 green) Windows client (clients/windows/ — .NET 10 WinForms): - VoiceCat.Interop: LibraryImport P/Invoke surface, UnmanagedCallersOnly callbacks, Channel<VoiceCatEvent> event delivery drained by 30ms WinForms Timer - VoiceCat.App: ConnectDialog (saved servers, DPAPI password storage), ServerIdentity- Dialog (TOFU first-connect / mismatch warning), MainForm (channel TreeView, user ListBox, RichTextBox chat, voice controls, device pickers, VAD/PTT/always-on mode, per-user gain/mute/NR tuning, VAD sensitivity TrackBar, level meter ProgressBar) - PttKeyCaptureDialog — focus-scoped PTT key capture (documented limitation) - PerUserTuningDialog — real-time gain/mute/NR applied to all of a user's streams - Accessibility: explicit AccessibleName/Description on every control, & mnemonics, Activity log ListBox as durable screen-reader record, AutomationNotification for curated live announcements Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
74 lines
2.9 KiB
C++
74 lines
2.9 KiB
C++
#include "audio/apm_processor.h"
|
|
|
|
#include <atomic>
|
|
#include <chrono>
|
|
#include <cmath>
|
|
|
|
namespace voicecat::audio {
|
|
|
|
namespace {
|
|
int64_t steady_now_ms() {
|
|
return std::chrono::duration_cast<std::chrono::milliseconds>(
|
|
std::chrono::steady_clock::now().time_since_epoch())
|
|
.count();
|
|
}
|
|
} // namespace
|
|
|
|
// ── ApmPassthrough ────────────────────────────────────────────────────────────
|
|
// No-op: returns true (VAD always open), does not modify PCM.
|
|
// Replaced by WebrtcApmProcessor when VOICECAT_HAS_APM is defined.
|
|
class ApmPassthrough final : public ApmProcessor {
|
|
public:
|
|
void process_render(const int16_t*, int, int) override {}
|
|
bool process_capture(int16_t*, int, int) override { return true; }
|
|
};
|
|
|
|
// ── EnergyVadProcessor ──────────────────────────────────────────────────────
|
|
// Lightweight, dependency-free energy/RMS VAD — see apm_processor.h's create_vad() doc comment
|
|
// for why this exists instead of a real APM. No AEC (process_render is a no-op); doesn't modify
|
|
// the PCM it's given, only inspects it.
|
|
class EnergyVadProcessor final : public ApmProcessor {
|
|
public:
|
|
EnergyVadProcessor(float rms_threshold, int64_t hang_time_ms)
|
|
: threshold_(rms_threshold), hang_time_ms_(hang_time_ms) {}
|
|
|
|
void process_render(const int16_t*, int, int) override {}
|
|
|
|
bool process_capture(int16_t* pcm, int samples, int /*sample_rate*/) override {
|
|
if (samples > 0) {
|
|
double sum_sq = 0.0;
|
|
for (int i = 0; i < samples; ++i) {
|
|
double s = static_cast<double>(pcm[i]) / 32768.0;
|
|
sum_sq += s * s;
|
|
}
|
|
double rms = std::sqrt(sum_sq / samples);
|
|
if (rms >= threshold_.load(std::memory_order_relaxed)) last_voice_ms_ = steady_now_ms();
|
|
}
|
|
return (steady_now_ms() - last_voice_ms_) < hang_time_ms_;
|
|
}
|
|
|
|
void set_threshold(float t) override {
|
|
threshold_.store(t, std::memory_order_relaxed);
|
|
}
|
|
|
|
private:
|
|
std::atomic<float> threshold_;
|
|
int64_t hang_time_ms_;
|
|
int64_t last_voice_ms_ = 0; // epoch start -> gate begins closed until first loud frame
|
|
};
|
|
|
|
std::unique_ptr<ApmProcessor> ApmProcessor::create() {
|
|
#ifdef VOICECAT_HAS_APM
|
|
// TODO: return std::make_unique<WebrtcApmProcessor>(); — see create_vad()'s doc comment for
|
|
// why this isn't wired up yet (no working Windows/MSVC build upstream).
|
|
#endif
|
|
return std::make_unique<ApmPassthrough>();
|
|
}
|
|
|
|
std::unique_ptr<ApmProcessor> ApmProcessor::create_vad(float rms_threshold,
|
|
int64_t hang_time_ms) {
|
|
return std::make_unique<EnergyVadProcessor>(rms_threshold, hang_time_ms);
|
|
}
|
|
|
|
} // namespace voicecat::audio
|