Skip to content
@North-Shore-AI

North Shore AI

README.md

North Shore AI

Reliability-first AI infrastructure on Elixir/BEAM. We build systems that make LLMs behave predictably in production.

27 public repos · 5 stars

Crucible Reliability Stack

Open research platform targeting 99%+ LLM reliability through ensembles, hedging, and statistical testing.

Repository Description
crucible_adversary Adversarial testing and robustness evaluation for the Crucible fram...
crucible_bench Statistical testing and analysis framework for AI research
crucible_datasets Dataset management and caching for AI research benchmarks
crucible_ensemble Multi-model ensemble voting strategies for LLM reliability
crucible_examples Interactive Phoenix LiveView demonstrations of the Crucible Framewo...
crucible_framework CrucibleFramework: A scientific platform for LLM reliability resear...
crucible_harness Experimental research framework for running AI benchmarks at scale
crucible_hedging Request hedging for tail latency reduction in distributed systems
crucible_ir Intermediate Representation for the Crucible ML reliability ecosystem
crucible_telemetry Advanced telemetry collection and analysis for AI research
crucible_trace Structured causal reasoning chain logging for LLM transparency
crucible_ui Phoenix LiveView dashboard for the Crucible ML reliability stack
crucible_xai Explainable AI (XAI) tools for the Crucible framework

Ingot Labeling Stack

Human-in-the-loop labeling infrastructure for ML datasets with inter-rater reliability.

Repository Description
anvil Labeling queue library for managing human labeling workflows
forge Sample factory library for generating, transforming, and computing ...
ingot Phoenix LiveView interface for sample generation and human labeling...
labeling_ir Shared IR structs for the North Shore labeling stack (Forge/Anvil/I...

ML Safety & Quality

Repository Description
ExDataCheck Data validation and quality library for ML pipelines in Elixir
ExFairness Fairness and bias detection library for Elixir AI/ML systems
LlmGuard AI Firewall and guardrails for LLM-based Elixir applications

Infrastructure

Repository Description
tinkerer Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipeli...
tinkex Elixir SDK for the Tinker ML platform—LoRA training, sampling, and ...

Research

Repository Description
cns Chiral Narrative Synthesis - Dialectical reasoning framework for au...
cns_ui Phoenix LiveView interface for CNS dialectical reasoning experiments

Data & Tooling

Repository Description
ex_topology Pure Elixir library for graph topology, TDA, and computational topo...
nx_penalties Composable regularization penalties for Elixir Nx. L1/L2/Elastic Ne...

BEAM Native · OTP supervision, telemetry, distributed resilience Research Backed · Every feature tied to reliability research Production Ready · Hex packages, docs, test suites

@nshkrdotcom

Updated 2025-12-06

Pinned Loading

  1. crucible_harness crucible_harness Public

    Experimental research framework for running AI benchmarks at scale

    Elixir

  2. crucible_adversary crucible_adversary Public

    Adversarial testing and robustness evaluation for the Crucible framework

    Elixir

  3. crucible_bench crucible_bench Public

    Statistical testing and analysis framework for AI research

    Elixir

  4. crucible_framework crucible_framework Public

    CrucibleFramework: A scientific platform for LLM reliability research on the BEAM

    Elixir

  5. crucible_telemetry crucible_telemetry Public

    Advanced telemetry collection and analysis for AI research

    Elixir

  6. crucible_xai crucible_xai Public

    Explainable AI (XAI) tools for the Crucible framework

    Elixir

Repositories

Showing 10 of 37 repositories
  • tinkex Public

    Elixir SDK for the Tinker ML platform—LoRA training, sampling, and service orchestration built on OTP, Finch, and telemetry.

    North-Shore-AI/tinkex’s past year of commit activity
    Elixir 2 Apache-2.0 0 0 0 Updated Dec 15, 2025
  • tinkerer Public

    Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipelines, semantic fact-checking, telemetry, and reviewer-ready CNS docs.

    North-Shore-AI/tinkerer’s past year of commit activity
    Python 1 Apache-2.0 0 0 0 Updated Dec 13, 2025
  • tiktoken_ex Public

    Pure Elixir TikToken-style byte-level BPE tokenizer (Kimi K2 compatible).

    North-Shore-AI/tiktoken_ex’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 13, 2025
  • eval_ex Public

    Model evaluation harness for standardized benchmarking—comprehensive metrics (F1, BLEU, ROUGE, METEOR, BERTScore, pass@k), statistical analysis (confidence intervals, effect size, bootstrap CI, ANOVA), multi-model comparison, and report generation. Research-grade evaluation for LLM and ML experiments.

    North-Shore-AI/eval_ex’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
  • datasets_ex Public

    Dataset management library for ML experiments—loaders for SciFact, FEVER, GSM8K, HumanEval, MMLU, TruthfulQA, HellaSwag; git-like versioning with lineage tracking; transformation pipelines; quality validation with schema checks and duplicate detection; GenStage streaming for large datasets. Built for reproducible AI research.

    North-Shore-AI/datasets_ex’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
  • metrics_ex Public

    Metrics aggregation and alerting for ML experiments—multi-backend export (Prometheus, InfluxDB, Datadog, OpenTelemetry), advanced aggregations (percentiles, histograms, moving averages), threshold-based alerting with anomaly detection (z-score, IQR), and time-series storage. Research-grade observability for the NSAI ecosystem.

    North-Shore-AI/metrics_ex’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
  • embed_ex Public

    Vector embeddings service for Elixir—multi-provider support (OpenAI, Cohere, Voyage AI), intelligent caching with Cachex, batch processing with rate limiting, Nx-powered similarity computations, k-means/DBSCAN clustering, semantic deduplication, and ETS-based vector storage. Built for CNS and ML pipelines.

    North-Shore-AI/embed_ex’s past year of commit activity
    Elixir 1 MIT 0 0 0 Updated Dec 6, 2025
  • nsai_gateway Public

    Unified API gateway for the NSAI ecosystem—authentication (JWT, API keys, OAuth2/OIDC), distributed rate limiting with burst allowance, circuit breakers, request tracing, Prometheus metrics, and service proxying. Production-ready with comprehensive observability and multi-tenant support.

    North-Shore-AI/nsai_gateway’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
  • pilot Public

    Interactive CLI and REPL for the NSAI ecosystem—unified interface to registry, gateway, jobs, experiments, datasets, embeddings, and metrics services; tab completion with bash/zsh scripts; configurable environments; JSON output mode for scripting; escript distribution. The cockpit for North Shore AI operations.

    North-Shore-AI/pilot’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
  • nsai_registry Public

    Service discovery and registry for the NSAI ecosystem—distributed registry with health checking, circuit breakers, multiple storage backends (ETS/PostgreSQL), PubSub event broadcasting, and comprehensive telemetry. Built on OTP with Horde-ready architecture for multi-node deployments.

    North-Shore-AI/nsai_registry’s past year of commit activity
    Elixir 0 MIT 0 0 0 Updated Dec 6, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…