Skip to content

Content Moderation API & Implementation Resources

Learn more about Spectrum Labs' AI solutions and how to implement them on your platform.
Sign Up For a Demo Contact Us
SL_Hero_API
SL_ABS_Graphic_wBackground

Advanced Behavior Systems (ABS)

Leverage Spectrum Labs’ Advanced Behavior Systems to detect a wide range of harmful behaviors, and take fast action to protect your community.

Choose from Spectrum Labs' library of behavior models to proactively stop toxic activity and users.

  • Detect harmful user behaviors in single messages and complex conversations.
  • Respond quickly with appropriate and effective actions.
  • Configure actions – from automatic redaction of content to human review of user-level patterns.
  • Tailor actions to behavior prevalence and risk within your community.

The result is a healthy and beneficial community where users can engage without negative or harmful experiences.

About Our Content Moderation API

Spectrum Labs offers RESTful JSON input and output APIs.

SL_CodeImages_API Input_050823

API Input

Spectrum Labs' APIs takes three types of inputs:

  • Single messages: Typically chat messages, but also could be usernames, descriptions, and more.
  • Batch messages: Groups of up to 100 messages.
  • User reports: The APIs can evaluate content that's flagged by users against existing behavior classifiers.
SL_API_Latency

Latency

Spectrum Labs' APIs have been developed with high performance as the primary driver.

They operate at very low latency, with consistent performance for single-message determinations under 20 milliseconds.
SL_CodeImages_APIWEB_R4.2_API Output

API Output

The APIs’ JSON response includes:

  • Binary determination for a range of behaviors
  • Confidence buckets for each behavior
  • Language detection using a proprietary use case optimized algorithm
  • Arbitrary metadata for Contextual AI
SL_Web_Engineering_IfThen

Real-Time Decisions

In addition to behavior model determinations, rules are evaluated and content action tags are returned in the response in order to action content in real time.

For example, a response may include the tags "show-code-of-conduct" and "shadow-post-message." The customer platform would then execute actions based on these action tags.
SL_CodeImages_APIWEB_R4.2_Webhook

Webhooks

Along with real-time decisions through the action tags, Spectrum Labs offers a powerful event-based webhook framework to action users based on custom-configured rules.

These webhooks use the same JSON format for easy adoption, which enables our customers to automate a lot of content moderation work.

Additionally, the API is secure and is guarded by an account ID and an API key.

Implementation Overview

Spectrum Labs analyzes text-based user-generated content for different online behaviors, and returns determinations for the behaviors evaluated. Communication with the system occurs through Spectrum’s Direct Response API, which supports batch and real-time operations.

In addition to the API response, Spectrum Labs provides webhooks to call a customer’s system when behaviors are uncovered. We also support Offline Batch processing.
 
Spectrum Labs can pipe results into our own Moderation Suite, or integrate into your existing tools.

SL_Web_API_Implementation_Overview_R2.3

Three Phases of Implementation

Implementation Example

Here is an example of how one of our customers implemented Spectrum Labs' solutions:
 
They used the direct response API to make a real-time determination of whether to post the text content. Then, they used webhook integrations to issue user-level actions – some automated and some based on moderator confirmation. Finally, they used Spectrum Labs’ Guardian Moderation Dashboard to review cases and make decisions. 

SL_Web_API_Implementation_wBack

See the API in Action

Set up a demo with Spectrum Labs team to see the API for UGC Moderation in action!