Schemas

Create and manage reusable schemas that define what data to extract

Schemas define the structure of data you want to extract from websites. They specify field names, data types, and descriptions. Schemas can be reused across multiple workflows.

For example, if you need to extract store locations from 5 different websites, you can create one schema and use it for all of them.

Managing Schemas

Schemas can be created and managed in two ways:

In the UI

Create schemas visually using the schema builder, or select from existing templates.

Via Code

Create and manage schemas programmatically with full control over field definitions.

Data Types

When defining schemas, you specify the data type for each field to ensure accurate extraction and validation. Kadoa supports the following data types:

Data Type	Description	Example Use Cases
STRING	String/text content	Product names, descriptions, article headlines
NUMBER	Numeric values (integers, decimals)	Quantities, ratings, scores, counts
BOOLEAN	True/false values	Availability status, feature flags, yes/no indicators
DATE	Date values	Publication dates, deadlines, event dates
DATETIME	Date and time values	Timestamps, scheduled times, last updated
MONEY	Currency and monetary values	Prices, costs, revenue, discounts
IMAGE	Image URLs and references	Product photos, thumbnails, profile pictures
LINK	URLs and hyperlinks	Product pages, external links, social media
OBJECT	Nested/complex JSON structures	Structured metadata, complex configurations
ARRAY	Lists/arrays of values	Tags, categories, multiple images, feature lists

Choose the appropriate data type to ensure your data is extracted and validated correctly.

Data Type Formats

Some data types return structured values:

Data Type	Format	Example
MONEY	{"amount": number, "currencyCode": string}	$124.50 → {"amount": 12450, "currencyCode": "USD"}

The amount field is always in the smallest currency unit (e.g., cents for USD, pence for GBP).

Special Field Types

Beyond regular data fields, Kadoa supports special field types for advanced use cases:

Function Fields

Functions add fields whose values Kadoa computes for you instead of extracting them from the page. Each function has an output data type, and functions marked with an AI badge use generative AI on every record.

• Custom categories — assigns each record to a category from a list you define. Useful for sentiment analysis, content categorization, or priority classification.
• Unique ID — a stable identifier for each record, well suited as a key field.

Functions vary by workspace: the editor lists only yours, the API rejects the rest, and Custom categories is always available.

Learn more about function fields in the SDK →

Raw Content Fields

To keep raw page content, add a regular field that pulls a source value Kadoa already holds — the page URL, the full HTML, or the full Markdown of each page.

Learn more about source fields in the SDK →

Transformations

Some workflows transform data after extraction — categorizing records or computing derived fields, for example. A transformation reads input fields as context and produces output fields, each with a summary of how it is computed when available.

To review a workflow’s transformation:

• In the UI: the Pipeline panel.
• Via the API: the transformation object in Get workflow by ID.

Templates

Schemas can be bundled into templates along with a prompt and notification settings. Templates let you apply the same configuration to multiple workflows and manage it in one place.

Need help creating a custom schema? Contact our support team for assistance.