Amazon S3 Tables Now Accept Semi-Structured Data Without a Fixed Schema
Cloud

Amazon S3 Tables Now Accept Semi-Structured Data Without a Fixed Schema

AWS added Variant data type support to Amazon S3 Tables on July 28, letting teams write JSON without a predefined schema and still get efficient analytical query performance through Apache Iceberg V3 file pruning and automatic compaction.

3 min readJuly 29, 2026
Back to News
Photo by panumas nikhomkhai on Pexels

AWS added Variant data type support to Amazon S3 Tables on July 28, 2026. The feature follows the Apache Iceberg Version 3 (V3) specification. It is now live in 15 AWS regions.

For data platform and analytics teams managing lakehouse environments, the announcement says you can now write semi-structured data like JSON directly to S3 Tables without defining a fixed schema in advance. Metrotechs analysis: that removes a schema design step from the ingestion path, which narrows a common friction point for fast-moving pipelines.

TL;DR
  • -AWS released Variant data type support in Amazon S3 Tables on July 28, 2026, based on the Apache Iceberg V3 specification, across 15 AWS regions.
  • -Teams can now land JSON and semi-structured data without a predefined schema and still benefit from Parquet column statistics, file pruning, and automatic compaction.
  • -Before adopting, verify that every engine touching these tables supports Iceberg V3, confirm regional coverage, and audit governance controls for schemaless columns.

What the Variant Type Actually Does

The Variant type lets you write semi-structured data directly to S3 Tables without a fixed schema. When an Iceberg V3-compatible engine writes Variant data, it shreds the semi-structured content into hidden columns. That shredding generates Parquet column statistics. Query engines use those statistics for file pruning. File pruning reduces how much data a query must scan. The result is schemaless writes without giving up analytical query efficiency.

S3 Tables extend ongoing table maintenance, including compaction, to Variant columns. Compaction consolidates data from small files into larger files that Iceberg engines can read. Automatic compaction removes that maintenance burden.

Why This Changes the Ingestion Decision

Metrotechs analysis: compaction coverage is a practical detail worth noting. Without compaction on Variant columns, a high-volume streaming workload could accumulate small files over time. S3 Tables applies the same maintenance logic to structured and Variant columns alike.

S3 Tables work with any Iceberg-compatible engine, including Apache Spark, Trino, Amazon Athena, Amazon Redshift, and other third-party tools. However, Variant is an Iceberg V3 feature. The AWS Prescriptive Guidance is direct: verify that all engines accessing the table support version 3 before upgrading or creating V3 tables.

Amazon Athena (Trino) does not support version 3 at the time of this writing, per the AWS compatibility table. Amazon EMR for Apache Spark requires EMR release 7.12 or later. AWS Glue and Amazon SageMaker Unified Studio notebooks also support version 3.

The compatibility check is not optional. An engine that does not support Iceberg V3 will fail with a format-version error when it reads a V3 table containing Variant columns.

The Version Upgrade Is One-Way

If your team is considering upgrading existing Iceberg V2 tables to V3, one constraint deserves attention. Version 3 is a one-way upgrade. After a table moves from V2 to V3, it cannot be downgraded back to version 2 through standard operations. Test the upgrade in a non-production environment first.

Confirm that every engine and third-party tool in your pipeline supports V3 before committing production tables.

New tables can set the format-version table property to 3 at creation. That avoids the upgrade path entirely.

Regional Availability

Variant support is live in US East (N. Virginia), US East (Ohio), US West (Oregon), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Europe (Stockholm), and South America (São Paulo).

Teams with workloads outside this list should check AWS documentation before building pipelines that depend on this feature.

What to Evaluate Before Adopting

For data platform, analytics, and cloud architecture leaders, the decision has a bounded scope.

Engine compatibility audit. List every engine that reads or writes the target tables. Confirm each one supports Iceberg V3. Pay close attention to Athena if it is in your query path. The AWS guidance does not list Athena support for version 3.

Regional coverage check. Confirm your primary and any secondary AWS regions appear in the 15 supported. The announcement does not state a timeline for additional regions.

Upgrade path decision. Decide whether to create new V3 tables for semi-structured workloads or upgrade existing V2 tables. The one-way upgrade constraint changes that risk profile. New tables with Variant columns do not carry that constraint.

Governance review. Schemaless ingestion shifts the governance burden downstream. Column statistics generated during shredding help query engines. Your data catalog, access policies, and data quality checks may need updates to account for Variant columns. The announcement and AWS guidance do not describe how existing catalog integrations handle Variant column metadata. Treat that as an open item until you verify it in your environment.

Compaction monitoring. S3 Tables handles compaction automatically. If you have existing monitoring dashboards for table maintenance, the AWS Prescriptive Guidance recommends updating monitoring dashboards for version 3-specific metrics after any upgrade.

The feature is generally available now in supported regions. If your team is already landing JSON to S3 Tables with a schema defined ahead of ingestion, this is the right moment to evaluate whether the Variant type can simplify that pipeline.

Sources and supporting resources
Next
AWS DataSync Enhanced Mode Now Supports HDFS, Azure Blob, Self-Managed Object Storage, and Hyper-V Agents

Get ERP, Cloud, Data, and AI Updates

News, insights, and practical guidance across ERP, Cloud, Data, AI, digital transformation, and technology projects.

No spam. Unsubscribe anytime.