envRL
Sign up
RL environment hub

Build your own environment in minutes

Over 300 tools across 12 categories are open source and available

Browse environmentsDesign your own

Composable reward functions

You can combine signals and weight them

Each tool comes with pre-built ones
load_plugins()

reward = (
    call("slack.message_sent", channel="releases", user="alan.jones") * 0.2 +
    call("git.commits_committed", repo="backend-service", since="2025-02-18T00:00:00Z") * 0.2 +
    call("docker.container_healthy", name="web", host="prod-node-1") * 0.2 +
    call("postgres.table_exists", database="analytics", table="daily_reports") * 0.4
)

print(f"Total reward: {reward:.3f}")
Environment catalog

Pick a domain to explore

Drill into automation packs, reward profiles, and tooling that ship with each environment.

Custom environment

Design your own environment

Describe the workspace you need and pick a base image. We’ll install each tool, run its initialization, and expose the reward hooks those tools provide inside a Docker environment.

Desktop workspace with ticketing datasets, CRM mirrors, and call center tooling.

Select tooling

Available tools

Tools install independently. Mix and match exactly what your environment needs or add more via GitHub.

AWS Amplify Toolkit
What it installs

Amplify workflows for provisioning front-end stacks, auth, and hosting.

Beancount Ledger
What it installs

Plaintext accounting with importers, reconciliation, and reporting scripts.

ClamAV Scanner
What it installs

Signature-based antivirus tooling with quarantine orchestration.

Cursor IDE
What it installs

AI-native IDE with shared memory, agent hand-off tooling, and build integrations.

Docassemble Studio
What it installs

Document assembly with interview flows, redline exports, and precedent sync.

Docker Compose Orchestrator
What it installs

Opinionated Compose runner with health check policies and log shipping.

Docker Engine
What it installs

Build and run OCI containers with BuildKit and hardened daemon defaults.

Gazebo Simulator
What it installs

Simulation runtime with physics plugins and ROS integration presets.

Git Essentials
What it installs

Git 2.x with opinionated aliases, signing, and credential helpers preconfigured.

JupyterLab
What it installs

Interactive notebooks with GPU kernels and RLlib templates.

Ledger CLI
What it installs

Double-entry ledger tooling with register, balance, and CSV export helpers.

Mail Coach
What it installs

Break management and wellbeing monitor with focus prompts for long incidents.

Mailpit Inbox
What it installs

Disposable SMTP inbox with live previews and spam analysis.

Mautic Studio
What it installs

Lifecycle automation with A/B testing, segment sync, and GDPR tooling.

MLflow Tracking
What it installs

Experiment tracking with lineage, metrics, and artifacts.

OHIF Viewer
What it installs

Imaging viewing suite with hanging protocols, annotations, and playlist tooling.

Orthanc DICOM Server
What it installs

Compact DICOM server with anonymisation and modality routing presets.

osquery Fleet
What it installs

Endpoint telemetry with schedule management and log forwarding.

PagerDuty Bridge
What it installs

On-call automation with incident syncing, status templates, and timelines.

Pre-commit Hooks
What it installs

Managed hook runner that keeps repos linted and formatted automatically.

Ray Dashboard
What it installs

Distributed training monitor with autoscaler hooks.

ROS 2 Toolkit
What it installs

ROS 2 command-line tools with deterministic colcon overlays and DDS profiles.

Slack Relay
What it installs

Team notifications with run status, anomaly alerts, and approvals.

Stripe CLI
What it installs

Payments sandbox tooling with webhook replay and product catalogue sync.

SuiteCRM Sandbox
What it installs

CRM workspace seeded with demo data and integration toggles.

Terraform CLI
What it installs

Infrastructure automation with remote state bootstrapping and drift detection.

Trivy Scanner
What it installs

Container and IaC vulnerability scanning with cached feeds.

Unity Build Tools
What it installs

Headless Unity editor with build automation and toggle orchestration.

VS Code Server
What it installs

Remote IDE with GitHub Copilot, Python, and CUDA extensions.

Zammad Helpdesk
What it installs

Ticketing workspace with omnichannel routing, macros, and analytics.

Zotero Library
What it installs

Reference manager sync with shared collections and citation styling.

Blend deployment health, customer sentiment, and delivery cadence into a single score.

Free request

Looking for a specific environment?

Let us know what you need and we will launch it for you—free of charge.